-- Logs begin at Wed 2022-06-22 09:26:26 UTC, end at Wed 2022-06-22 10:33:50 UTC. -- Jun 22 10:01:36.927989 dv-cinder-847131-1-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Jun 22 10:01:36.936626 dv-cinder-847131-1-iscsi devstack@keystone.service[80367]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jun 22 10:01:36.938481 dv-cinder-847131-1-iscsi devstack@keystone.service[80367]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jun 22 10:01:36 2022] *** Jun 22 10:01:36.938481 dv-cinder-847131-1-iscsi devstack@keystone.service[80367]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 22 10:01:36.938481 dv-cinder-847131-1-iscsi devstack@keystone.service[80367]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 22 10:01:36.938481 dv-cinder-847131-1-iscsi devstack@keystone.service[80367]: nodename: dv-cinder-847131-1-iscsi Jun 22 10:01:36.938481 dv-cinder-847131-1-iscsi devstack@keystone.service[80367]: machine: x86_64 Jun 22 10:01:36.938481 dv-cinder-847131-1-iscsi devstack@keystone.service[80367]: clock source: unix Jun 22 10:01:36.938481 dv-cinder-847131-1-iscsi devstack@keystone.service[80367]: pcre jit disabled Jun 22 10:01:36.938481 dv-cinder-847131-1-iscsi devstack@keystone.service[80367]: detected number of CPU cores: 4 Jun 22 10:01:36.938481 dv-cinder-847131-1-iscsi devstack@keystone.service[80367]: current working directory: / Jun 22 10:01:36.938481 dv-cinder-847131-1-iscsi devstack@keystone.service[80367]: detected binary path: /usr/bin/uwsgi-core Jun 22 10:01:36.938481 dv-cinder-847131-1-iscsi devstack@keystone.service[80367]: your processes number limit is 47680 Jun 22 10:01:36.939183 dv-cinder-847131-1-iscsi devstack@keystone.service[80367]: your memory page size is 4096 bytes Jun 22 10:01:36.939183 dv-cinder-847131-1-iscsi devstack@keystone.service[80367]: detected max file descriptor number: 2048 Jun 22 10:01:36.939183 dv-cinder-847131-1-iscsi devstack@keystone.service[80367]: lock engine: pthread robust mutexes Jun 22 10:01:36.939183 dv-cinder-847131-1-iscsi devstack@keystone.service[80367]: thunder lock: enabled Jun 22 10:01:36.939183 dv-cinder-847131-1-iscsi devstack@keystone.service[80367]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jun 22 10:01:36.939183 dv-cinder-847131-1-iscsi devstack@keystone.service[80367]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 22 10:01:36.983877 dv-cinder-847131-1-iscsi devstack@keystone.service[80367]: Python main interpreter initialized at 0x55ab86d099c0 Jun 22 10:01:36.983877 dv-cinder-847131-1-iscsi devstack@keystone.service[80367]: python threads support enabled Jun 22 10:01:36.983877 dv-cinder-847131-1-iscsi devstack@keystone.service[80367]: your server socket listen backlog is limited to 100 connections Jun 22 10:01:36.983877 dv-cinder-847131-1-iscsi devstack@keystone.service[80367]: your mercy for graceful operations on workers is 90 seconds Jun 22 10:01:36.984268 dv-cinder-847131-1-iscsi devstack@keystone.service[80367]: mapped 403077 bytes (393 KB) for 2 cores Jun 22 10:01:36.984352 dv-cinder-847131-1-iscsi devstack@keystone.service[80367]: *** Operational MODE: preforking *** Jun 22 10:01:36.984572 dv-cinder-847131-1-iscsi devstack@keystone.service[80367]: *** uWSGI is running in multiple interpreter mode *** Jun 22 10:01:36.984572 dv-cinder-847131-1-iscsi devstack@keystone.service[80367]: spawned uWSGI master process (pid: 80367) Jun 22 10:01:36.984784 dv-cinder-847131-1-iscsi systemd[1]: Started Devstack devstack@keystone.service. Jun 22 10:01:36.987159 dv-cinder-847131-1-iscsi devstack@keystone.service[80367]: spawned uWSGI worker 1 (pid: 80377, cores: 1) Jun 22 10:01:36.987159 dv-cinder-847131-1-iscsi devstack@keystone.service[80367]: spawned uWSGI worker 2 (pid: 80378, cores: 1) Jun 22 10:01:36.987159 dv-cinder-847131-1-iscsi devstack@keystone.service[80367]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 22 10:01:42.469649 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 22 10:01:42.469649 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: from cryptography.utils import int_from_bytes Jun 22 10:01:42.470476 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 22 10:01:42.470476 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: from cryptography.utils import int_from_bytes Jun 22 10:01:42.472956 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 22 10:01:42.472956 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: from cryptography.utils import int_from_bytes Jun 22 10:01:42.473425 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 22 10:01:42.473425 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: from cryptography.utils import int_from_bytes Jun 22 10:01:42.518637 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 22 10:01:42.518827 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 22 10:01:42.519020 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] command line args: [] {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 22 10:01:42.519286 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 22 10:01:42.519996 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] ================================================================================ {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 22 10:01:42.520305 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] admin_token = **** {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:01:42.520556 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] config_dir = [] {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:01:42.520745 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:01:42.520869 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 22 10:01:42.520957 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] config_source = [] {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:01:42.521074 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 22 10:01:42.521166 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] debug = True {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:01:42.521281 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] command line args: [] {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 22 10:01:42.521361 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:01:42.521585 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 22 10:01:42.521733 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:01:42.521870 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] ================================================================================ {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 22 10:01:42.521979 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:01:42.522079 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] admin_token = **** {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:01:42.522176 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:01:42.522285 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] config_dir = [] {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:01:42.522395 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:01:42.522500 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:01:42.522605 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] list_limit = None {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:01:42.522720 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] config_source = [] {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:01:42.522824 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] log_config_append = None {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:01:42.522927 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] debug = True {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:01:42.523034 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:01:42.523139 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:01:42.523269 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] log_dir = None {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:01:42.523269 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] log_file = None {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:01:42.523458 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:01:42.523458 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:01:42.523648 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:01:42.523723 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:01:42.523791 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:01:42.523860 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:01:42.523979 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:01:42.524064 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] list_limit = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:01:42.524142 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:01:42.524264 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] log_config_append = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:01:42.524340 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:01:42.524461 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:01:42.524543 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:01:42.524624 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] log_dir = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:01:42.524749 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:01:42.524827 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] log_file = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:01:42.524949 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:01:42.525033 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:01:42.525115 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:01:42.525193 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:01:42.525351 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:01:42.525491 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:01:42.525575 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:01:42.525720 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:01:42.525827 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:01:42.525903 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:01:42.526062 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:01:42.526149 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:01:42.526302 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:01:42.526379 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:01:42.526551 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:01:42.526627 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:01:42.526790 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:01:42.527024 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:01:42.527102 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.43/identity {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:01:42.527267 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] publish_errors = False {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:01:42.527770 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:01:42.527887 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:01:42.527997 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:01:42.528136 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:01:42.528255 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:01:42.528392 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:01:42.528505 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:01:42.528622 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:01:42.528706 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:01:42.528817 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:01:42.528817 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] standard_threads = False {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:01:42.528994 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.43/identity {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:01:42.529080 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:01:42.529168 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] publish_errors = False {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:01:42.529257 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:01:42.529369 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:01:42.529458 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:01:42.529458 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] use_journal = False {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:01:42.529635 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:01:42.529724 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] use_json = False {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:01:42.529807 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:01:42.529880 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] use_stderr = False {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:01:42.529955 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:01:42.530025 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] use_syslog = False {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:01:42.530144 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:01:42.530220 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:01:42.530290 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] standard_threads = False {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:01:42.530365 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.530440 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:01:42.530510 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.530674 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:01:42.530755 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.530857 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:01:42.530936 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.531039 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] use_journal = False {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:01:42.531183 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.531271 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] use_json = False {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:01:42.531621 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] use_stderr = False {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:01:42.531711 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.531784 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] use_syslog = False {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:01:42.531859 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.531935 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:01:42.532012 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.532091 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.532161 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.532259 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.532345 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.532523 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.532614 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.532766 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.532851 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.533021 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.533099 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.533252 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.533338 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.533502 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.533581 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.533768 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.533852 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.534008 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.534166 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.534249 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.534320 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.534500 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.534584 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.534738 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.534896 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.534976 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.535123 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.535850 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.535941 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.536118 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.536207 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.536373 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.536452 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.536623 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.536702 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.536856 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.536944 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.537088 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.537166 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.537318 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.537396 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.537552 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.537632 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.537825 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.537906 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.538074 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.538153 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.538306 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.538387 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.538536 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.538620 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.538781 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.538866 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.539027 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.539107 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.539262 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.539346 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.539507 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.539586 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.539739 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.539819 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.539974 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.540053 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.540208 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.540292 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.540437 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.540517 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.540667 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.540746 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.540898 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.541019 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.541172 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.541248 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.541353 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.541469 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.541600 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.541680 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.541854 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.541935 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.542090 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.542171 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.542320 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.542418 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.542555 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.542634 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.542787 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.542865 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.543021 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.543099 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.543252 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.543331 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.543633 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.543762 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.543762 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.543945 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.543945 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.544142 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.544241 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.544337 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.544435 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.544617 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.544743 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.544861 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.544983 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.545100 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.545215 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.545331 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.545447 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.545564 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.545669 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.545830 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.545956 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.546075 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.546200 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.546327 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.546447 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.546576 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.546696 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.546813 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.546935 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.547061 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.547179 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.547297 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.547420 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.547527 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.547643 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.547773 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.547892 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.548018 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.548137 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.548261 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.548369 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.548493 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.548612 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.548729 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.548846 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.548953 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.549068 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.549183 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.549300 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.549417 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.549534 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.549650 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.549779 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.549913 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.550032 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.550176 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.550298 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.550428 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.550555 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.550727 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.550901 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.551016 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.551135 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.551254 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.551372 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.551498 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.551618 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.551618 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.551840 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.551957 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.552074 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.552200 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.552320 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.552437 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.552554 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.552672 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.552672 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.552971 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.553092 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.553210 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.553328 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.553444 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.553562 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.553738 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.553878 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.554007 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.554126 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.554243 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.554360 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.554477 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.554602 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.554721 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.554839 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.554956 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.555073 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.555191 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.555320 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.555438 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.555555 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.555673 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.555797 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] auth.external = None {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.555923 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.556168 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.556292 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.556411 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.556539 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.556659 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.556777 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.556905 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] auth.password = None {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.557024 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.557142 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] auth.token = None {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.557260 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.557377 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.557495 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.557621 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.557785 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.557902 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.557967 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.558026 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.558084 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.558142 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.558201 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] auth.external = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.558270 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.558270 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.558270 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] credential.caching = True {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.558422 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.558480 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.558611 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.558857 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.559092 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.559337 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.559585 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.559711 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.559831 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.559961 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.560083 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.560201 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] auth.password = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.560319 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.560437 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] auth.token = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.560562 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.560689 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.560812 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.560932 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.561051 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.561178 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.561297 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.561424 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.561543 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.561767 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.561891 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.562010 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.562129 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] federation.caching = True {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.562261 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.562381 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.562500 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] credential.caching = True {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.562618 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.562736 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.562853 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.562980 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.563100 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.563219 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.563337 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.563456 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.563574 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.563699 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.563818 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.563937 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.564055 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.564174 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.564291 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.564418 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.564538 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.564656 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.564774 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.564892 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.565010 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] identity.caching = True {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.565136 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.565256 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.565381 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.565500 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.565625 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.565783 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.565783 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.566009 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.566127 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.566275 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.566500 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.566659 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] federation.caching = True {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.566782 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.566908 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.567036 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.567156 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.567274 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.567467 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.567589 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.567708 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.567827 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.567946 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.568065 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.568196 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.568317 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.568437 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.568556 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.568675 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.568793 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.568920 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.569041 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.569161 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.569279 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.569398 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.569518 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.569645 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] identity.caching = True {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.569775 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.569894 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.570013 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.570132 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.570250 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.570380 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.570514 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.570514 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.570739 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.570862 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.570985 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.571111 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.571230 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.571346 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.571463 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.571580 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.571697 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.571823 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.571941 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.572057 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.572174 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.572290 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.572407 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.572532 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.572652 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.572769 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.572886 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.573002 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.573119 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.573247 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.573375 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.573492 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.573609 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.573789 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.573909 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.574039 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.574165 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.574283 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.574398 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.574514 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.574630 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.574755 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.574873 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.574988 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.575104 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.575220 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.575337 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.575461 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.575579 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.575696 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.575812 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.575927 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.576044 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.576168 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.576286 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.576401 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.576518 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.576642 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.576768 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.576885 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.577001 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.577117 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.577233 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.577355 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] ldap.user = None {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.577355 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.577585 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.577585 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.577831 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.577950 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.578067 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.578191 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.578310 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.578427 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.578544 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.578661 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.578777 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.578902 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.579021 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.579137 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.579253 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.579370 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.579486 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.579486 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.579715 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.579832 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.579949 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.580064 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.580180 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.580305 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.580423 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.580539 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.580655 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.580775 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.580892 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.581019 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.581137 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.581254 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.581370 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.581486 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.581602 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.581788 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.582416 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.582578 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.582698 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] ldap.user = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.582822 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.582940 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.583067 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.583186 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.583303 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.583757 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.583878 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.583996 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.584125 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.584244 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.584363 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.584363 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.584594 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.584711 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.584838 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.584958 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.585076 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.585195 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.585313 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.585431 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.585557 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.585676 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.585811 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.585929 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.586046 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.586164 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.586296 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.586415 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.586534 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.586652 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.586770 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.586888 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] resource.caching = True {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.587018 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.587137 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.587256 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.587374 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.587491 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.587609 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.587735 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.587854 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.587972 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.588090 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.588207 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.588325 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.588451 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.588570 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.588688 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.588805 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.588922 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.589040 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.589170 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.589288 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] role.caching = True {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.589407 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.589525 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] role.driver = sql {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.589643 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.589793 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.589925 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.590045 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.590163 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.590280 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.590400 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.590517 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.590644 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.590766 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.590886 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.591004 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.591122 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.591315 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.591437 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.591556 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.591674 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.591791 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.591909 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.592034 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.592154 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] resource.caching = True {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.592272 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.592389 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.592508 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.592626 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.592753 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.592872 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.592990 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.593108 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.593226 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.593344 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.593470 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.593591 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.593727 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.593848 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.593967 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.594085 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.594215 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.594336 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.594454 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.594572 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] role.caching = True {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.594697 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.594817 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] role.driver = sql {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.594943 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.595063 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.595181 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.595299 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.595417 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.595535 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.595667 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.595788 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.595907 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.596025 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.596143 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.596261 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.596388 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.596767 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.596889 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.597008 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.597126 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.597244 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.597370 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.597490 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.598240 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.598373 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.598492 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.598611 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.598743 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] token.caching = True {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.598866 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.598985 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.599104 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.599222 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.599222 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.599455 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.599574 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.599699 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.599819 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.599938 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.600065 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.600185 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.600303 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.600303 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.600525 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.600525 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.600768 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.600889 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.601008 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.601126 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.601244 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.601361 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.601487 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.601607 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.601743 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.601864 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.601982 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.602100 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.602231 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.602351 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.602469 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.602587 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.602705 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.602822 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.602948 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] database.connection = **** {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.603077 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.603208 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.603327 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.603445 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.603563 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.603680 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.603806 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.603925 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.604044 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] token.caching = True {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.604162 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.604279 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.604397 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.604524 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.604643 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.604762 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.604879 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.604996 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.605115 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.605242 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.605361 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.605479 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.605597 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.605765 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.605887 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.606018 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.606139 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.606257 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.606375 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.606493 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.606611 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.606738 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.606858 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.606977 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.607094 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.607214 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.607332 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.607332 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 22 10:01:42.607565 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.607565 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.607565 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.607565 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.607565 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] database.connection = **** {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.607565 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.607565 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.607565 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.607565 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.608546 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.608546 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.608546 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.608546 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.608546 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.609086 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.609086 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.609086 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.609410 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.609528 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.609757 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.609996 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.610242 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.610483 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:01:42.610658 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 22 10:01:42.636008 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80378) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 10:01:42.636238 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80378) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 10:01:42.636469 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80378) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 10:01:42.637103 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80377) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 10:01:42.637342 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80377) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 10:01:42.637577 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80377) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 10:01:42.645606 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80378) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 10:01:42.646754 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80377) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 10:01:42.673090 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80378) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 10:01:42.673318 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80378) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 10:01:42.674545 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80377) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 10:01:42.674784 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80377) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 10:01:42.815942 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80378) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 10:01:42.816124 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80377) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 10:01:42.865765 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80378) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 10:01:42.865995 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80378) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 10:01:42.866764 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80377) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 10:01:42.867005 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80377) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 10:01:42.930112 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80378) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 10:01:42.930267 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80377) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 10:01:42.930350 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80378) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 10:01:42.930445 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80377) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 10:01:42.930554 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80378) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 10:01:42.930638 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80377) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 10:01:42.930775 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80377) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 10:01:42.930857 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80378) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 10:01:42.930991 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80378) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 10:01:42.931083 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80377) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 10:01:42.931207 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80378) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 10:01:42.931290 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80377) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 10:01:42.956316 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80378) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 10:01:42.956546 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80378) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 10:01:42.956652 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80377) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 10:01:42.956774 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80378) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 10:01:42.956857 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80377) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 10:01:42.957108 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80378) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 10:01:42.957282 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80377) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 10:01:42.957442 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80378) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 10:01:42.957519 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80377) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 10:01:42.957647 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80378) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 10:01:42.957755 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80377) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 10:01:42.957830 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80378) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 10:01:42.957917 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80377) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 10:01:42.958056 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80377) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 10:01:42.968735 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80378) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 10:01:42.969305 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80377) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 10:01:42.982598 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80378) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 10:01:42.982831 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80378) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 10:01:42.982971 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80377) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 10:01:42.983071 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80378) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 10:01:42.983144 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80377) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 10:01:42.983262 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80378) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 10:01:42.983344 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80377) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 10:01:42.983482 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80378) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 10:01:42.983565 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80377) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 10:01:42.983698 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80378) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 10:01:42.983780 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80377) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 10:01:42.983910 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80378) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 10:01:42.983999 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80377) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 10:01:42.984163 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80377) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 10:01:43.001600 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:01:43.001911 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 22 10:01:43.001996 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:01:43.002205 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 22 10:01:43.002302 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:01:43.002444 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 22 10:01:43.002524 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:01:43.002714 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:01:43.002795 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 22 10:01:43.002976 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:01:43.003058 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:01:43.003232 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:01:43.003313 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:01:43.003486 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:01:43.003567 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:01:43.003745 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:01:43.014301 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:01:43.014577 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:01:43.014765 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:01:43.014847 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:01:43.015050 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:01:43.015134 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:01:43.015329 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:01:43.015616 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:01:43.023979 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80378) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 10:01:43.024590 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80377) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 10:01:43.027279 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80378) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 10:01:43.027557 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:01:43.027836 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:01:43.027916 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80377) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 10:01:43.028116 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:01:43.028210 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:01:43.028395 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:01:43.028477 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:01:43.028654 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:01:43.028739 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:01:43.028916 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:01:43.028999 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:01:43.029187 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:01:43.029267 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:01:43.029450 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:01:43.029529 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:01:43.029742 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:01:43.029826 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:01:43.030010 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:01:43.030090 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:01:43.030324 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:01:43.030597 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:01:43.057164 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:01:43.057875 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:01:43.058795 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80378) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 10:01:43.059076 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:01:43.059507 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80377) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 10:01:43.059790 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:01:43.064315 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80378) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 10:01:43.064709 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:01:43.064991 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:01:43.065110 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80377) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 10:01:43.065505 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:01:43.065815 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:01:43.072357 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80378) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 10:01:43.072589 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:01:43.073288 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80377) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 10:01:43.073577 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:01:43.077067 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80378) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 10:01:43.077351 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:01:43.077630 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:01:43.077936 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:01:43.078121 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80377) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 10:01:43.078204 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:01:43.078411 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:01:43.078493 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:01:43.078697 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:01:43.078785 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:01:43.078984 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:01:43.079066 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:01:43.079264 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:01:43.079544 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:01:43.079816 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:01:43.080086 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:01:43.098650 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:01:43.098923 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:01:43.101339 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:01:43.101339 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:01:43.104692 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80378) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 10:01:43.105258 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80377) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 10:01:43.107135 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:01:43.107535 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:01:43.109002 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:01:43.109417 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:01:43.112559 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80378) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 10:01:43.115157 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80377) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 10:01:43.116859 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80378) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 10:01:43.118829 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80377) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 10:01:43.120550 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:01:43.120846 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:01:43.121128 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:01:43.121411 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:01:43.121708 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:01:43.121993 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:01:43.122549 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:01:43.122852 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:01:43.123143 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:01:43.123434 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:01:43.123717 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:01:43.123999 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:01:43.141582 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80378) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 10:01:43.141896 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:01:43.142164 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:01:43.142433 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:01:43.143921 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80377) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 10:01:43.144210 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:01:43.144599 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:01:43.144891 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:01:43.150417 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:01:43.152103 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:01:43.152377 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:01:43.152956 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:01:43.154695 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:01:43.154977 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:01:43.155678 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80378) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 10:01:43.155983 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:01:43.156271 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:01:43.156572 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:01:43.156905 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:01:43.158263 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80377) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 10:01:43.158566 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:01:43.158871 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:01:43.159154 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:01:43.159431 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:01:43.170297 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80378) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 10:01:43.170576 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:01:43.170862 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:01:43.171142 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:01:43.172792 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:01:43.173093 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:01:43.173174 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80377) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 10:01:43.173390 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:01:43.173473 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:01:43.173678 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:01:43.173987 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:01:43.176400 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:01:43.176400 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:01:43.177002 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:01:43.192361 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80378) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 10:01:43.195663 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80378) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 10:01:43.195758 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80377) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 10:01:43.198974 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:01:43.199075 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80377) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 10:01:43.200707 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:01:43.202346 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:01:43.202431 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80378) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 10:01:43.202622 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:01:43.202901 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:01:43.204081 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:01:43.205768 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80377) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 10:01:43.206057 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:01:43.206352 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:01:43.210215 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:01:43.211807 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80378) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 10:01:43.213859 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:01:43.215054 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:01:43.215344 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:01:43.215486 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80377) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 10:01:43.215730 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:01:43.216008 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:01:43.218763 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:01:43.219068 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:01:43.219464 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:01:43.219750 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:01:43.225638 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80378) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 10:01:43.225947 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:01:43.226235 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:01:43.229339 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80377) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 10:01:43.229630 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:01:43.229937 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:01:43.234069 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80378) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 10:01:43.234571 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:01:43.234661 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:01:43.234878 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:01:43.235145 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:01:43.235510 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:01:43.235789 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:01:43.236057 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:01:43.236337 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:01:43.236611 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:01:43.236880 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:01:43.237138 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:01:43.237399 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:01:43.237665 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:01:43.237855 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80377) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 10:01:43.238140 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:01:43.238927 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:01:43.239202 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:01:43.239475 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:01:43.239875 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:01:43.240155 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:01:43.240439 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:01:43.240713 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:01:43.240993 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:01:43.241269 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:01:43.241537 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:01:43.241845 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:01:43.242130 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 10:01:43.276448 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55ab86d099c0 pid: 80378 (default app) Jun 22 10:01:43.279868 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02350fe-7950-4825-ab7b-9b983d2a2c80 None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:01:43.280163 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02350fe-7950-4825-ab7b-9b983d2a2c80 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:01:43.280443 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02350fe-7950-4825-ab7b-9b983d2a2c80 None None] PATH_INFO: `/v3` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:01:43.280541 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55ab86d099c0 pid: 80377 (default app) Jun 22 10:01:43.284617 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1/1] 10.222.0.43 () {50 vars in 791 bytes} [Wed Jun 22 10:01:43 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:01:51.020260 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2339bd40-d5e3-4c88-b2c7-3caf7fa71cf2 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:01:51.020929 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2339bd40-d5e3-4c88-b2c7-3caf7fa71cf2 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:01:51.020929 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2339bd40-d5e3-4c88-b2c7-3caf7fa71cf2 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:01:51.025085 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1/2] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:01:51 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 10:01:51.030559 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdad1fd2-9682-4065-ad4e-7b08b6e58887 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:01:51.030964 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdad1fd2-9682-4065-ad4e-7b08b6e58887 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:01:51.031113 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdad1fd2-9682-4065-ad4e-7b08b6e58887 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:01:51.100946 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: INFO dbcounter [None req-cdad1fd2-9682-4065-ad4e-7b08b6e58887 None None] Registered counter for database keystone Jun 22 10:01:51.122481 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG oslo_db.sqlalchemy.engines [None req-cdad1fd2-9682-4065-ad4e-7b08b6e58887 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80378) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 10:01:51.128632 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writer thread running {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 10:01:51.305508 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG passlib.handlers.bcrypt [None req-cdad1fd2-9682-4065-ad4e-7b08b6e58887 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80378) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 22 10:01:51.305874 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG passlib.handlers.bcrypt [None req-cdad1fd2-9682-4065-ad4e-7b08b6e58887 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80378) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 22 10:01:51.360211 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-cdad1fd2-9682-4065-ad4e-7b08b6e58887 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:01:51.361851 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-cdad1fd2-9682-4065-ad4e-7b08b6e58887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:01:51.486243 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 2/3] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:01:51 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 457 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 22 10:01:51.646862 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2339bd40-d5e3-4c88-b2c7-3caf7fa71cf2 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:01:51.716912 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: INFO dbcounter [None req-2339bd40-d5e3-4c88-b2c7-3caf7fa71cf2 None None] Registered counter for database keystone Jun 22 10:01:51.736779 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG oslo_db.sqlalchemy.engines [None req-2339bd40-d5e3-4c88-b2c7-3caf7fa71cf2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80377) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 10:01:51.743772 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writer thread running {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 10:01:51.872652 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2339bd40-d5e3-4c88-b2c7-3caf7fa71cf2 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:01:51.876870 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc1166d-f814-43b0-a9df-1b4521834c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:01:51.877541 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc1166d-f814-43b0-a9df-1b4521834c24 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:01:51.877862 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc1166d-f814-43b0-a9df-1b4521834c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:01:51.878145 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc1166d-f814-43b0-a9df-1b4521834c24 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:01:51.887072 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc1166d-f814-43b0-a9df-1b4521834c24 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:01:51.938879 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: WARNING keystone.common.rbac_enforcer.enforcer [None req-1dc1166d-f814-43b0-a9df-1b4521834c24 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 22 10:01:51.939224 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc1166d-f814-43b0-a9df-1b4521834c24 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:01:51.949302 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 2/4] 10.222.0.43 () {58 vars in 1324 bytes} [Wed Jun 22 10:01:51 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 22 10:01:51.955177 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdad1fd2-9682-4065-ad4e-7b08b6e58887 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:01:51.970155 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdad1fd2-9682-4065-ad4e-7b08b6e58887 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:01:51.975100 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08899a4e-f985-4139-bd15-990a4d043851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:01:51.976214 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08899a4e-f985-4139-bd15-990a4d043851 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:01:51.976499 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08899a4e-f985-4139-bd15-990a4d043851 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:01:51.976777 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08899a4e-f985-4139-bd15-990a4d043851 admin admin] PATH_INFO: `/v3/projects/24726cc2fba44a5087e961da4a7cd653` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:01:51.980867 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08899a4e-f985-4139-bd15-990a4d043851 admin admin] RBAC: Authorizing `identity:get_project(project_id=24726cc2fba44a5087e961da4a7cd653)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:01:52.032452 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: WARNING keystone.common.rbac_enforcer.enforcer [None req-08899a4e-f985-4139-bd15-990a4d043851 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 22 10:01:52.033023 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08899a4e-f985-4139-bd15-990a4d043851 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:01:52.038142 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 3/5] 10.222.0.43 () {56 vars in 1207 bytes} [Wed Jun 22 10:01:51 2022] GET /identity/v3/projects/24726cc2fba44a5087e961da4a7cd653 => generated 344 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:01:54.107637 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46763fbe-55d8-438e-ac27-4733a3025e78 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:01:54.108040 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46763fbe-55d8-438e-ac27-4733a3025e78 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:01:54.108203 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46763fbe-55d8-438e-ac27-4733a3025e78 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:01:54.112338 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 3/6] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:01:54 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:01:54.118431 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2627b1-c30a-4325-98de-bdee1f0baab4 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:01:54.118852 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2627b1-c30a-4325-98de-bdee1f0baab4 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:01:54.118994 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2627b1-c30a-4325-98de-bdee1f0baab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:01:54.137398 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-7f2627b1-c30a-4325-98de-bdee1f0baab4 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:01:54.138966 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-7f2627b1-c30a-4325-98de-bdee1f0baab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:01:54.147076 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 4/7] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:01:54 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jun 22 10:01:54.169501 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46763fbe-55d8-438e-ac27-4733a3025e78 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:01:54.182617 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46763fbe-55d8-438e-ac27-4733a3025e78 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:01:54.186849 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520c7f0d-3249-4171-bdf5-2da8a949cd6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:01:54.187478 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520c7f0d-3249-4171-bdf5-2da8a949cd6b admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:01:54.187766 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520c7f0d-3249-4171-bdf5-2da8a949cd6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:01:54.188046 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520c7f0d-3249-4171-bdf5-2da8a949cd6b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:01:54.195782 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520c7f0d-3249-4171-bdf5-2da8a949cd6b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:01:54.197564 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520c7f0d-3249-4171-bdf5-2da8a949cd6b admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:01:54.206197 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 4/8] 10.222.0.43 () {58 vars in 1324 bytes} [Wed Jun 22 10:01:54 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 22 10:01:54.211845 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2627b1-c30a-4325-98de-bdee1f0baab4 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:01:54.220873 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2627b1-c30a-4325-98de-bdee1f0baab4 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:01:54.226374 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfe7d87-ed12-4b13-9a1c-bb6227da33b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:01:54.227245 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfe7d87-ed12-4b13-9a1c-bb6227da33b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:01:54.227534 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfe7d87-ed12-4b13-9a1c-bb6227da33b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:01:54.227814 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfe7d87-ed12-4b13-9a1c-bb6227da33b3 admin admin] PATH_INFO: `/v3/users/3557bebdc4d94a16b885094566c2bc9a` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:01:54.229190 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfe7d87-ed12-4b13-9a1c-bb6227da33b3 admin admin] RBAC: Authorizing `identity:get_user(user_id=3557bebdc4d94a16b885094566c2bc9a)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:01:54.231049 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfe7d87-ed12-4b13-9a1c-bb6227da33b3 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:01:54.232608 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 5/9] 10.222.0.43 () {56 vars in 1198 bytes} [Wed Jun 22 10:01:54 2022] GET /identity/v3/users/3557bebdc4d94a16b885094566c2bc9a => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:01:56.296479 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd62355-5a6c-4547-966f-c4a21c07f9ae None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:01:56.297045 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd62355-5a6c-4547-966f-c4a21c07f9ae None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:01:56.297045 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd62355-5a6c-4547-966f-c4a21c07f9ae None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:01:56.298452 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 5/10] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:01:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:01:56.304472 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e420504c-3331-468f-8afa-942925db77f6 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:01:56.304943 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e420504c-3331-468f-8afa-942925db77f6 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:01:56.305182 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e420504c-3331-468f-8afa-942925db77f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:01:56.322183 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-e420504c-3331-468f-8afa-942925db77f6 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:01:56.323372 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-e420504c-3331-468f-8afa-942925db77f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:01:56.364905 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e54803-0fb0-4b97-95e1-26f008865980 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:01:56.365124 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e54803-0fb0-4b97-95e1-26f008865980 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:01:56.365409 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e54803-0fb0-4b97-95e1-26f008865980 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:01:56.366826 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 6/11] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:01:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 10:01:56.372140 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b75704c-55c4-4370-a7d6-75cbdb706f54 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:01:56.372434 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b75704c-55c4-4370-a7d6-75cbdb706f54 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:01:56.372746 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b75704c-55c4-4370-a7d6-75cbdb706f54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:01:56.405233 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 6/12] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:01:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 10:01:56.412437 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG passlib.handlers.bcrypt [None req-8b75704c-55c4-4370-a7d6-75cbdb706f54 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80377) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 22 10:01:56.412882 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG passlib.handlers.bcrypt [None req-8b75704c-55c4-4370-a7d6-75cbdb706f54 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80377) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 22 10:01:56.428794 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e420504c-3331-468f-8afa-942925db77f6 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:01:56.451609 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:01:56.458602 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-8b75704c-55c4-4370-a7d6-75cbdb706f54 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:01:56.460222 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-8b75704c-55c4-4370-a7d6-75cbdb706f54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:01:56.532087 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e420504c-3331-468f-8afa-942925db77f6 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:01:56.559993 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 7/13] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:01:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 10:01:56.566587 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6cfd40-c6c0-486a-bd3b-65fe24c72df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:01:56.567416 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6cfd40-c6c0-486a-bd3b-65fe24c72df8 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:01:56.567698 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6cfd40-c6c0-486a-bd3b-65fe24c72df8 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:01:56.567980 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6cfd40-c6c0-486a-bd3b-65fe24c72df8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:01:56.578844 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6cfd40-c6c0-486a-bd3b-65fe24c72df8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:01:56.581915 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b75704c-55c4-4370-a7d6-75cbdb706f54 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:01:56.590990 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-4b6cfd40-c6c0-486a-bd3b-65fe24c72df8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 10:01:56.590990 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:01:56.590990 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:01:56.590990 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:01:56.590990 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:01:56.590990 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:01:56.590990 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:01:56.590990 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:01:56.590990 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:01:56.590990 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:01:56.590990 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:01:56.590990 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:01:56.590990 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:01:56.590990 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:01:56.590990 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:01:56.590990 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:01:56.591891 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:01:56.591891 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:01:56.591891 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:01:56.591891 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:01:56.591891 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:01:56.591891 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:01:56.591891 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:01:56.591891 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:01:56.591891 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:01:56.591891 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:01:56.591891 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:01:56.591891 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( Jun 22 10:01:56.591891 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:01:56.591891 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:01:56.591891 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:01:56.591891 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:01:56.592922 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:01:56.592922 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:01:56.592922 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:01:56.592922 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:01:56.592922 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:01:56.592922 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:01:56.592922 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:01:56.592922 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:01:56.592922 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:01:56.592922 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:01:56.592922 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 10:01:56.592922 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:01:56.592922 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 7/14] 10.222.0.43 () {56 vars in 1096 bytes} [Wed Jun 22 10:01:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 10:01:56.598689 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6cfd40-c6c0-486a-bd3b-65fe24c72df8 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:01:56.687149 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:01:56.695888 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b75704c-55c4-4370-a7d6-75cbdb706f54 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:01:56.698826 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:01:56.708299 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6cfd40-c6c0-486a-bd3b-65fe24c72df8 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:01:56.735996 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759f34db-6c6d-4143-8c34-3a081e4c007f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:01:56.736902 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759f34db-6c6d-4143-8c34-3a081e4c007f None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:01:56.737195 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759f34db-6c6d-4143-8c34-3a081e4c007f None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:01:56.737479 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759f34db-6c6d-4143-8c34-3a081e4c007f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:01:56.744018 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf760509-5784-41c1-99d2-910f7ceb3646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:01:56.744691 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf760509-5784-41c1-99d2-910f7ceb3646 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:01:56.744982 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf760509-5784-41c1-99d2-910f7ceb3646 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:01:56.745265 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf760509-5784-41c1-99d2-910f7ceb3646 None admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:01:56.746061 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf760509-5784-41c1-99d2-910f7ceb3646 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:01:56.746380 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf760509-5784-41c1-99d2-910f7ceb3646 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:01:56.747800 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf760509-5784-41c1-99d2-910f7ceb3646 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:01:56.759730 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 8/15] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Jun 22 10:01:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:01:56.765221 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf760509-5784-41c1-99d2-910f7ceb3646 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:01:56.806610 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759f34db-6c6d-4143-8c34-3a081e4c007f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:01:56.808157 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759f34db-6c6d-4143-8c34-3a081e4c007f None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:01:56.866306 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf760509-5784-41c1-99d2-910f7ceb3646 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:01:56.900978 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754226ff-9ea3-4b9c-a3e5-58e77091ff1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:01:56.901895 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754226ff-9ea3-4b9c-a3e5-58e77091ff1d None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:01:56.902185 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754226ff-9ea3-4b9c-a3e5-58e77091ff1d None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:01:56.902469 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754226ff-9ea3-4b9c-a3e5-58e77091ff1d None admin] PATH_INFO: `/v3/users/3557bebdc4d94a16b885094566c2bc9a` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:01:56.903693 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754226ff-9ea3-4b9c-a3e5-58e77091ff1d None admin] RBAC: Authorizing `identity:get_user(user_id=3557bebdc4d94a16b885094566c2bc9a)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:01:56.905180 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754226ff-9ea3-4b9c-a3e5-58e77091ff1d None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:01:56.906862 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 9/16] 10.222.0.43 () {56 vars in 1177 bytes} [Wed Jun 22 10:01:56 2022] GET /identity/v3/users/3557bebdc4d94a16b885094566c2bc9a => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:01:56.912884 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754226ff-9ea3-4b9c-a3e5-58e77091ff1d None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:01:56.914202 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 8/17] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Jun 22 10:01:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 22 10:01:56.919698 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759f34db-6c6d-4143-8c34-3a081e4c007f None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:01:56.922394 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:01:56.931959 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:01:57.020116 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754226ff-9ea3-4b9c-a3e5-58e77091ff1d None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:01:57.022542 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759f34db-6c6d-4143-8c34-3a081e4c007f None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:01:57.057092 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c306b701-3189-4e51-ae87-f980772fb4a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:01:57.057752 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceb050d-dd62-46f1-a674-6f9714ab0277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:01:57.057920 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c306b701-3189-4e51-ae87-f980772fb4a3 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:01:57.058205 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c306b701-3189-4e51-ae87-f980772fb4a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:01:57.058485 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c306b701-3189-4e51-ae87-f980772fb4a3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:01:57.058595 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceb050d-dd62-46f1-a674-6f9714ab0277 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:01:57.058827 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceb050d-dd62-46f1-a674-6f9714ab0277 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:01:57.059108 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceb050d-dd62-46f1-a674-6f9714ab0277 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:01:57.059662 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c306b701-3189-4e51-ae87-f980772fb4a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:01:57.061138 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c306b701-3189-4e51-ae87-f980772fb4a3 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:01:57.062772 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 10/18] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jun 22 10:01:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:01:57.068417 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c306b701-3189-4e51-ae87-f980772fb4a3 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:01:57.077511 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eceb050d-dd62-46f1-a674-6f9714ab0277 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:01:57.079045 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eceb050d-dd62-46f1-a674-6f9714ab0277 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:01:57.100408 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-eceb050d-dd62-46f1-a674-6f9714ab0277 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:01:57.100408 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:01:57.100408 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:01:57.100408 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:01:57.100408 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:01:57.100408 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:01:57.100408 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:01:57.100408 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:01:57.100408 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:01:57.100408 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:01:57.100408 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:01:57.100408 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:01:57.100408 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:01:57.100408 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:01:57.100408 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:01:57.101277 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:01:57.101277 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:01:57.101277 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:01:57.101277 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:01:57.101277 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:01:57.101277 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:01:57.101277 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:01:57.101277 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:01:57.101277 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jun 22 10:01:57.101277 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:01:57.101277 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:01:57.101277 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:01:57.101277 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:01:57.101277 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:01:57.101277 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:01:57.101277 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:01:57.101277 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:01:57.102518 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:01:57.102518 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:01:57.102518 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:01:57.102518 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:01:57.102518 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 9/19] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jun 22 10:01:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 10:01:57.107253 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceb050d-dd62-46f1-a674-6f9714ab0277 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:01:57.159084 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:01:57.164238 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:01:57.179131 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c306b701-3189-4e51-ae87-f980772fb4a3 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:01:57.211113 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceb050d-dd62-46f1-a674-6f9714ab0277 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:01:57.213692 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc2ca7a-9fec-404f-b12a-3aa2bfb663e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:01:57.214378 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc2ca7a-9fec-404f-b12a-3aa2bfb663e5 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:01:57.214666 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc2ca7a-9fec-404f-b12a-3aa2bfb663e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:01:57.214949 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc2ca7a-9fec-404f-b12a-3aa2bfb663e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:01:57.215779 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc2ca7a-9fec-404f-b12a-3aa2bfb663e5 None admin] RBAC: Adding query filter params (role.id=26d9c2ab5dfc4e6d9ca80c6014123906, scope.domain.id=default, user.id=3557bebdc4d94a16b885094566c2bc9a) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:01:57.216091 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc2ca7a-9fec-404f-b12a-3aa2bfb663e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:01:57.217544 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc2ca7a-9fec-404f-b12a-3aa2bfb663e5 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:01:57.225006 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 11/20] 10.222.0.43 () {56 vars in 1322 bytes} [Wed Jun 22 10:01:57 2022] GET /identity/v3/role_assignments?user.id=3557bebdc4d94a16b885094566c2bc9a&scope.domain.id=default&role.id=26d9c2ab5dfc4e6d9ca80c6014123906 => generated 233 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:01:57.247030 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e821a1-aa47-4b5b-bf60-7b6ed16f5398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:01:57.247724 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e821a1-aa47-4b5b-bf60-7b6ed16f5398 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:01:57.248015 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e821a1-aa47-4b5b-bf60-7b6ed16f5398 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:01:57.248298 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e821a1-aa47-4b5b-bf60-7b6ed16f5398 None admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:01:57.249058 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e821a1-aa47-4b5b-bf60-7b6ed16f5398 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:01:57.249374 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e821a1-aa47-4b5b-bf60-7b6ed16f5398 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:01:57.250880 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e821a1-aa47-4b5b-bf60-7b6ed16f5398 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:01:57.271316 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 10/21] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Jun 22 10:01:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:01:59.459225 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e5f58d-f212-4906-bafa-d20ada35105b None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:01:59.459730 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e5f58d-f212-4906-bafa-d20ada35105b None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:01:59.459906 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e5f58d-f212-4906-bafa-d20ada35105b None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:01:59.461313 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 12/22] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:01:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:01:59.466605 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fddeb6-50e4-405a-a15e-19cd2101b250 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:01:59.467021 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fddeb6-50e4-405a-a15e-19cd2101b250 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:01:59.467192 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fddeb6-50e4-405a-a15e-19cd2101b250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:01:59.490712 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-45fddeb6-50e4-405a-a15e-19cd2101b250 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:01:59.491930 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-45fddeb6-50e4-405a-a15e-19cd2101b250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:01:59.577111 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 11/23] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:01:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 10:01:59.611554 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e5f58d-f212-4906-bafa-d20ada35105b None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:01:59.754815 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e5f58d-f212-4906-bafa-d20ada35105b None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:01:59.803320 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7661e4e-7866-4ec6-a763-70f1defeb28c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:01:59.804130 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7661e4e-7866-4ec6-a763-70f1defeb28c None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:01:59.804419 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7661e4e-7866-4ec6-a763-70f1defeb28c None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:01:59.804701 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7661e4e-7866-4ec6-a763-70f1defeb28c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:01:59.819757 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7661e4e-7866-4ec6-a763-70f1defeb28c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:01:59.827579 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-d7661e4e-7866-4ec6-a763-70f1defeb28c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 10:01:59.827579 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:01:59.827579 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:01:59.827579 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:01:59.827579 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:01:59.827579 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:01:59.827579 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:01:59.827579 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:01:59.827579 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:01:59.827579 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:01:59.827579 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:01:59.827579 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:01:59.827579 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:01:59.827579 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:01:59.827579 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:01:59.827579 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:01:59.828393 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:01:59.828393 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:01:59.828393 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:01:59.828393 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:01:59.828393 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:01:59.828393 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:01:59.828393 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:01:59.828393 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:01:59.828393 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:01:59.828393 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:01:59.828393 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:01:59.828393 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( Jun 22 10:01:59.828393 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:01:59.828393 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:01:59.828393 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:01:59.828393 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:01:59.829130 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:01:59.829130 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:01:59.829130 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:01:59.829130 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:01:59.829130 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:01:59.829130 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:01:59.829130 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:01:59.829130 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:01:59.829130 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:01:59.829130 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:01:59.829130 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 10:01:59.829130 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:01:59.829130 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 13/24] 10.222.0.43 () {56 vars in 1096 bytes} [Wed Jun 22 10:01:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:01:59.837041 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fddeb6-50e4-405a-a15e-19cd2101b250 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:01:59.862907 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477455bc-d5f2-4a4d-8808-7e4fe7ecd34e None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:01:59.863207 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477455bc-d5f2-4a4d-8808-7e4fe7ecd34e None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:01:59.863475 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477455bc-d5f2-4a4d-8808-7e4fe7ecd34e None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:01:59.865642 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 14/25] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:01:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 10:01:59.870401 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d47533-3f51-4c3c-9426-7f0dbc303a5e None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:01:59.870688 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d47533-3f51-4c3c-9426-7f0dbc303a5e None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:01:59.870971 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d47533-3f51-4c3c-9426-7f0dbc303a5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:01:59.879763 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:01:59.892776 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-e1d47533-3f51-4c3c-9426-7f0dbc303a5e None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:01:59.895253 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-e1d47533-3f51-4c3c-9426-7f0dbc303a5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:01:59.921996 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:00.021102 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 15/26] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:01:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 10:02:00.022208 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37112af3-ad4d-416b-964f-209e6b586601 None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:00.022503 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37112af3-ad4d-416b-964f-209e6b586601 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:00.022787 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37112af3-ad4d-416b-964f-209e6b586601 None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:00.024058 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 16/27] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:02:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:02:00.029721 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c45a1d-2f75-433d-8a41-87ca1315d0ac None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:00.030006 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c45a1d-2f75-433d-8a41-87ca1315d0ac None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:00.030292 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c45a1d-2f75-433d-8a41-87ca1315d0ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:00.033597 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fddeb6-50e4-405a-a15e-19cd2101b250 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:00.065400 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-73c45a1d-2f75-433d-8a41-87ca1315d0ac None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:02:00.066624 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-73c45a1d-2f75-433d-8a41-87ca1315d0ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:02:00.110828 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dd72f1-dac0-4e35-a9af-fbdcd06b8e20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:00.111517 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dd72f1-dac0-4e35-a9af-fbdcd06b8e20 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:00.111806 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dd72f1-dac0-4e35-a9af-fbdcd06b8e20 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:00.112089 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dd72f1-dac0-4e35-a9af-fbdcd06b8e20 None admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:00.112859 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dd72f1-dac0-4e35-a9af-fbdcd06b8e20 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:02:00.113172 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dd72f1-dac0-4e35-a9af-fbdcd06b8e20 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:00.115224 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dd72f1-dac0-4e35-a9af-fbdcd06b8e20 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:00.140241 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 12/28] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Jun 22 10:01:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:02:00.140909 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dd72f1-dac0-4e35-a9af-fbdcd06b8e20 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:00.193281 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 17/29] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:02:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 10:02:00.194171 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c45a1d-2f75-433d-8a41-87ca1315d0ac None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:00.265159 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:00.305080 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c45a1d-2f75-433d-8a41-87ca1315d0ac None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:00.344645 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a050f46-9d37-4ba0-a688-31960b348db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:00.346382 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a050f46-9d37-4ba0-a688-31960b348db7 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:00.346845 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a050f46-9d37-4ba0-a688-31960b348db7 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:00.347275 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a050f46-9d37-4ba0-a688-31960b348db7 None admin] PATH_INFO: `/v3/users/3557bebdc4d94a16b885094566c2bc9a` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:00.349579 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a050f46-9d37-4ba0-a688-31960b348db7 None admin] RBAC: Authorizing `identity:get_user(user_id=3557bebdc4d94a16b885094566c2bc9a)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:00.351776 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a050f46-9d37-4ba0-a688-31960b348db7 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:00.353605 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 18/30] 10.222.0.43 () {56 vars in 1177 bytes} [Wed Jun 22 10:02:00 2022] GET /identity/v3/users/3557bebdc4d94a16b885094566c2bc9a => generated 247 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:02:00.354606 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a050f46-9d37-4ba0-a688-31960b348db7 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:00.383378 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dd72f1-dac0-4e35-a9af-fbdcd06b8e20 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:00.400810 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:00.446345 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2614c7a-3c47-437c-a4a3-c54c9cf31373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:00.447157 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2614c7a-3c47-437c-a4a3-c54c9cf31373 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:00.447442 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2614c7a-3c47-437c-a4a3-c54c9cf31373 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:00.448863 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2614c7a-3c47-437c-a4a3-c54c9cf31373 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:00.468899 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2614c7a-3c47-437c-a4a3-c54c9cf31373 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:00.471117 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2614c7a-3c47-437c-a4a3-c54c9cf31373 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:00.499036 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-a2614c7a-3c47-437c-a4a3-c54c9cf31373 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:02:00.499036 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:02:00.499036 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:02:00.499036 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:02:00.499036 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:02:00.499036 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:02:00.499036 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:02:00.499036 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:02:00.499036 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:02:00.499036 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:02:00.499036 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:02:00.499036 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:02:00.499036 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:02:00.499036 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:02:00.499036 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:02:00.499884 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:02:00.499884 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:02:00.499884 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:02:00.499884 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:02:00.499884 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:02:00.499884 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:02:00.499884 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:02:00.499884 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:02:00.499884 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jun 22 10:02:00.499884 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:02:00.499884 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:02:00.499884 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:02:00.499884 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:02:00.499884 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:02:00.499884 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:02:00.499884 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:02:00.499884 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:02:00.500693 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:02:00.500693 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:02:00.500693 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:02:00.500693 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:02:00.511903 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 13/31] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jun 22 10:02:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 371 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:02:00.513045 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2614c7a-3c47-437c-a4a3-c54c9cf31373 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:00.530112 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a050f46-9d37-4ba0-a688-31960b348db7 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:00.555962 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:00.579356 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d85fef-5e06-46b5-836e-d38c11631faa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:00.580049 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d85fef-5e06-46b5-836e-d38c11631faa None admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:00.580346 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d85fef-5e06-46b5-836e-d38c11631faa None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:00.580631 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d85fef-5e06-46b5-836e-d38c11631faa None admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:00.581401 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d85fef-5e06-46b5-836e-d38c11631faa None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:00.583376 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d85fef-5e06-46b5-836e-d38c11631faa None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:00.637139 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2614c7a-3c47-437c-a4a3-c54c9cf31373 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:00.673783 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9a7ddf-0c72-4183-911e-4e32124747af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:00.674968 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9a7ddf-0c72-4183-911e-4e32124747af None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:00.675454 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9a7ddf-0c72-4183-911e-4e32124747af None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:00.675935 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9a7ddf-0c72-4183-911e-4e32124747af None admin] PATH_INFO: `/v3/domains/default` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:00.677635 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9a7ddf-0c72-4183-911e-4e32124747af None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:00.679354 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9a7ddf-0c72-4183-911e-4e32124747af None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:00.681296 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 14/32] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jun 22 10:02:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:02:00.682293 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9a7ddf-0c72-4183-911e-4e32124747af None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:00.732869 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:00.792923 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 19/33] 10.222.0.43 () {60 vars in 1131 bytes} [Wed Jun 22 10:02:00 2022] POST /identity/v3/roles => generated 219 bytes in 438 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:02:00.793952 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d85fef-5e06-46b5-836e-d38c11631faa None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:00.802565 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9a7ddf-0c72-4183-911e-4e32124747af None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:00.860454 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c49dac-596d-4e0b-ac81-b2bebabc5a89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:00.861069 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c49dac-596d-4e0b-ac81-b2bebabc5a89 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:00.862270 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c49dac-596d-4e0b-ac81-b2bebabc5a89 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:00.862789 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c49dac-596d-4e0b-ac81-b2bebabc5a89 None admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:00.863586 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c49dac-596d-4e0b-ac81-b2bebabc5a89 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:02:00.863983 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c49dac-596d-4e0b-ac81-b2bebabc5a89 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:00.868301 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c49dac-596d-4e0b-ac81-b2bebabc5a89 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:00.891715 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 15/34] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Jun 22 10:02:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:02:00.893223 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f89de3-832d-4076-b117-5d109891f8c3 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:00.893516 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f89de3-832d-4076-b117-5d109891f8c3 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:00.897724 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f89de3-832d-4076-b117-5d109891f8c3 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:00.897724 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 16/35] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:02:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:02:00.897724 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79912954-48da-41db-b6af-a4ed7383099d None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:00.897724 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79912954-48da-41db-b6af-a4ed7383099d None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:00.897724 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79912954-48da-41db-b6af-a4ed7383099d None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:00.898832 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 17/36] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:02:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:02:00.900868 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79912954-48da-41db-b6af-a4ed7383099d None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:00.962459 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d85fef-5e06-46b5-836e-d38c11631faa None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:01.002377 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a764f9f-ba8e-42a6-baeb-c36e710d20da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:01.003264 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a764f9f-ba8e-42a6-baeb-c36e710d20da None admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:01.003551 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a764f9f-ba8e-42a6-baeb-c36e710d20da None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:01.003835 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a764f9f-ba8e-42a6-baeb-c36e710d20da None admin] PATH_INFO: `/v3/domains/default/users/3557bebdc4d94a16b885094566c2bc9a/roles/26d9c2ab5dfc4e6d9ca80c6014123906` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:01.006265 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a764f9f-ba8e-42a6-baeb-c36e710d20da None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=3557bebdc4d94a16b885094566c2bc9a, role_id=26d9c2ab5dfc4e6d9ca80c6014123906)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:01.008671 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a764f9f-ba8e-42a6-baeb-c36e710d20da None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:01.026285 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:01.031491 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 20/37] 10.222.0.43 () {58 vars in 1361 bytes} [Wed Jun 22 10:02:00 2022] PUT /identity/v3/domains/default/users/3557bebdc4d94a16b885094566c2bc9a/roles/26d9c2ab5dfc4e6d9ca80c6014123906 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:02:01.032864 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd63b92-c54f-495c-b9e7-4dcc74b03627 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:01.033158 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd63b92-c54f-495c-b9e7-4dcc74b03627 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:01.033441 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd63b92-c54f-495c-b9e7-4dcc74b03627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:01.049611 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79912954-48da-41db-b6af-a4ed7383099d None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:01.058456 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-6fd63b92-c54f-495c-b9e7-4dcc74b03627 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:02:01.060084 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-6fd63b92-c54f-495c-b9e7-4dcc74b03627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:02:01.121461 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7ffb1a-c7d2-4c0f-a28f-38cbbacec812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:01.122095 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7ffb1a-c7d2-4c0f-a28f-38cbbacec812 None admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:01.122387 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7ffb1a-c7d2-4c0f-a28f-38cbbacec812 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:01.122657 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7ffb1a-c7d2-4c0f-a28f-38cbbacec812 None admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:01.125678 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7ffb1a-c7d2-4c0f-a28f-38cbbacec812 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:01.125678 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7ffb1a-c7d2-4c0f-a28f-38cbbacec812 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:01.165420 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:01.192503 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 21/38] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:02:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 10:02:01.194365 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15ef221-10d6-4729-8403-545a17dc30f1 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:01.194927 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15ef221-10d6-4729-8403-545a17dc30f1 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:01.195415 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15ef221-10d6-4729-8403-545a17dc30f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:01.213849 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-a15ef221-10d6-4729-8403-545a17dc30f1 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:02:01.215421 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-a15ef221-10d6-4729-8403-545a17dc30f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:02:01.289246 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 22/39] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:02:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 10:02:01.290600 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15ef221-10d6-4729-8403-545a17dc30f1 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:01.302181 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 18/40] 10.222.0.43 () {60 vars in 1141 bytes} [Wed Jun 22 10:02:00 2022] POST /identity/v3/projects => generated 301 bytes in 401 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 10:02:01.304578 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e295e9-26dd-497e-83d8-bc3a279c7717 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:01.304876 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e295e9-26dd-497e-83d8-bc3a279c7717 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:01.305164 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e295e9-26dd-497e-83d8-bc3a279c7717 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:01.306904 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 19/41] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:02:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 10:02:01.312848 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeb3d2d-7a3d-450f-a8e8-91aac6c1e092 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:01.313144 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeb3d2d-7a3d-450f-a8e8-91aac6c1e092 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:01.313424 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeb3d2d-7a3d-450f-a8e8-91aac6c1e092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:01.334897 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-ffeb3d2d-7a3d-450f-a8e8-91aac6c1e092 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:02:01.336652 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-ffeb3d2d-7a3d-450f-a8e8-91aac6c1e092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:02:01.425805 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15ef221-10d6-4729-8403-545a17dc30f1 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:01.429568 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 20/42] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:02:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 10:02:01.430921 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeb3d2d-7a3d-450f-a8e8-91aac6c1e092 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:01.516953 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:01.558382 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeb3d2d-7a3d-450f-a8e8-91aac6c1e092 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:01.568548 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:01.593774 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9def4083-e8cb-434b-bebf-fa9790d4f742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:01.594466 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9def4083-e8cb-434b-bebf-fa9790d4f742 None admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:01.594765 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9def4083-e8cb-434b-bebf-fa9790d4f742 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:01.595084 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9def4083-e8cb-434b-bebf-fa9790d4f742 None admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:01.595846 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9def4083-e8cb-434b-bebf-fa9790d4f742 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:01.597260 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9def4083-e8cb-434b-bebf-fa9790d4f742 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:01.601544 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3234802-b848-45ac-a2b9-ae1349eaa170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:01.602441 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3234802-b848-45ac-a2b9-ae1349eaa170 None admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:01.602892 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3234802-b848-45ac-a2b9-ae1349eaa170 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:01.603207 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3234802-b848-45ac-a2b9-ae1349eaa170 None admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:01.603924 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3234802-b848-45ac-a2b9-ae1349eaa170 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:01.605490 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3234802-b848-45ac-a2b9-ae1349eaa170 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:01.612558 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 23/43] 10.222.0.43 () {60 vars in 1131 bytes} [Wed Jun 22 10:02:01 2022] POST /identity/v3/roles => generated 223 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:02:01.614400 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9def4083-e8cb-434b-bebf-fa9790d4f742 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:01.628519 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 21/44] 10.222.0.43 () {60 vars in 1131 bytes} [Wed Jun 22 10:02:01 2022] POST /identity/v3/roles => generated 225 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:02:01.761890 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9def4083-e8cb-434b-bebf-fa9790d4f742 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:01.806203 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63744fed-15c8-4c81-9719-8b026f0324e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:01.807012 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63744fed-15c8-4c81-9719-8b026f0324e8 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:01.807299 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63744fed-15c8-4c81-9719-8b026f0324e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:01.807580 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63744fed-15c8-4c81-9719-8b026f0324e8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:01.808818 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63744fed-15c8-4c81-9719-8b026f0324e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:01.810327 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63744fed-15c8-4c81-9719-8b026f0324e8 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:01.812145 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 24/45] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jun 22 10:02:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:02:01.817565 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3234802-b848-45ac-a2b9-ae1349eaa170 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:01.927052 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3234802-b848-45ac-a2b9-ae1349eaa170 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:02.064225 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:02.071409 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba859e1-0255-44fc-a093-87f40eb73144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:02.072073 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba859e1-0255-44fc-a093-87f40eb73144 None admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:02.072361 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba859e1-0255-44fc-a093-87f40eb73144 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:02.072640 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba859e1-0255-44fc-a093-87f40eb73144 None admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:02.073369 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba859e1-0255-44fc-a093-87f40eb73144 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:02.074859 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba859e1-0255-44fc-a093-87f40eb73144 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:02.104401 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 22/46] 10.222.0.43 () {60 vars in 1141 bytes} [Wed Jun 22 10:02:01 2022] POST /identity/v3/projects => generated 312 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:02:03.244724 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652b66f5-255e-4a7e-b383-8fd39140b720 None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:03.245235 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652b66f5-255e-4a7e-b383-8fd39140b720 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:03.245314 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652b66f5-255e-4a7e-b383-8fd39140b720 None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:03.246847 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 25/47] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:02:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:02:03.251812 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f240a2-defd-4008-be43-7c89b235ffac None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:03.252242 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f240a2-defd-4008-be43-7c89b235ffac None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:03.252379 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f240a2-defd-4008-be43-7c89b235ffac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:03.268852 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-a2f240a2-defd-4008-be43-7c89b235ffac None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:02:03.270603 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-a2f240a2-defd-4008-be43-7c89b235ffac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:02:03.334825 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 23/48] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:02:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 10:02:03.357540 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652b66f5-255e-4a7e-b383-8fd39140b720 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:03.400056 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:03.462640 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652b66f5-255e-4a7e-b383-8fd39140b720 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:03.495658 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa10bef8-4ce7-4ef6-adf8-e642e14af341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:03.496447 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa10bef8-4ce7-4ef6-adf8-e642e14af341 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:03.496733 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa10bef8-4ce7-4ef6-adf8-e642e14af341 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:03.497012 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa10bef8-4ce7-4ef6-adf8-e642e14af341 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:03.506866 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa10bef8-4ce7-4ef6-adf8-e642e14af341 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:02:03.514483 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-aa10bef8-4ce7-4ef6-adf8-e642e14af341 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 10:02:03.514483 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:02:03.514483 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:02:03.514483 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:02:03.514483 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:02:03.514483 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:02:03.514483 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:02:03.514483 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:02:03.514483 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:02:03.514483 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:02:03.514483 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:02:03.514483 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:02:03.514483 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:02:03.514483 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:02:03.514483 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:02:03.514483 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:02:03.515325 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:02:03.515325 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:02:03.515325 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:02:03.515325 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:02:03.515325 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:02:03.515325 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:02:03.515325 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:02:03.515325 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:02:03.515325 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:02:03.515325 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:02:03.515325 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:02:03.515325 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( Jun 22 10:02:03.515325 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:02:03.515325 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:02:03.515325 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:02:03.515325 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:02:03.516122 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:02:03.516122 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:02:03.516122 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:02:03.516122 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:02:03.516122 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:02:03.516122 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:02:03.516122 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:02:03.516122 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:02:03.516122 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:02:03.516122 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:02:03.516122 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 10:02:03.516122 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:02:03.516122 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 26/49] 10.222.0.43 () {56 vars in 1096 bytes} [Wed Jun 22 10:02:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:02:03.521968 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f240a2-defd-4008-be43-7c89b235ffac None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:03.619993 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f240a2-defd-4008-be43-7c89b235ffac None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:03.633351 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:03.655856 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609f5047-b973-4eab-acee-1bb370477c6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:03.656559 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609f5047-b973-4eab-acee-1bb370477c6e None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:03.656850 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609f5047-b973-4eab-acee-1bb370477c6e None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:03.657134 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609f5047-b973-4eab-acee-1bb370477c6e None admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:03.657933 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609f5047-b973-4eab-acee-1bb370477c6e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:02:03.658253 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609f5047-b973-4eab-acee-1bb370477c6e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:03.659662 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609f5047-b973-4eab-acee-1bb370477c6e None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:03.668212 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 24/50] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Jun 22 10:02:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:02:03.673816 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa10bef8-4ce7-4ef6-adf8-e642e14af341 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:03.769071 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:03.772534 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa10bef8-4ce7-4ef6-adf8-e642e14af341 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:03.808670 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc23df1-2c08-4319-8d39-650b0d624dea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:03.809539 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc23df1-2c08-4319-8d39-650b0d624dea None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:03.809854 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc23df1-2c08-4319-8d39-650b0d624dea None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:03.810135 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc23df1-2c08-4319-8d39-650b0d624dea None admin] PATH_INFO: `/v3/users/3557bebdc4d94a16b885094566c2bc9a` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:03.811317 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc23df1-2c08-4319-8d39-650b0d624dea None admin] RBAC: Authorizing `identity:get_user(user_id=3557bebdc4d94a16b885094566c2bc9a)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:03.812784 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc23df1-2c08-4319-8d39-650b0d624dea None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:03.814624 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 27/51] 10.222.0.43 () {56 vars in 1177 bytes} [Wed Jun 22 10:02:03 2022] GET /identity/v3/users/3557bebdc4d94a16b885094566c2bc9a => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:02:03.821014 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609f5047-b973-4eab-acee-1bb370477c6e None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:03.924287 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609f5047-b973-4eab-acee-1bb370477c6e None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:03.960348 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ded1e4d-0034-4cc0-a449-c678b690588b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:03.961721 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ded1e4d-0034-4cc0-a449-c678b690588b None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:03.962271 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ded1e4d-0034-4cc0-a449-c678b690588b None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:03.962770 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ded1e4d-0034-4cc0-a449-c678b690588b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:03.964822 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ded1e4d-0034-4cc0-a449-c678b690588b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:03.966637 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ded1e4d-0034-4cc0-a449-c678b690588b None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:03.968836 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 25/52] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jun 22 10:02:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:02:03.975745 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc23df1-2c08-4319-8d39-650b0d624dea None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:04.077794 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc23df1-2c08-4319-8d39-650b0d624dea None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:04.111345 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69754ed6-696b-4f0d-8903-ee9e042ac8f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:04.112032 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69754ed6-696b-4f0d-8903-ee9e042ac8f7 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:04.112315 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69754ed6-696b-4f0d-8903-ee9e042ac8f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:04.112594 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69754ed6-696b-4f0d-8903-ee9e042ac8f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:04.113428 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69754ed6-696b-4f0d-8903-ee9e042ac8f7 None admin] RBAC: Adding query filter params (role.id=26d9c2ab5dfc4e6d9ca80c6014123906, scope.domain.id=default, user.id=3557bebdc4d94a16b885094566c2bc9a) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:02:04.114262 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69754ed6-696b-4f0d-8903-ee9e042ac8f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:04.116009 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69754ed6-696b-4f0d-8903-ee9e042ac8f7 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:04.121817 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 28/53] 10.222.0.43 () {56 vars in 1322 bytes} [Wed Jun 22 10:02:03 2022] GET /identity/v3/role_assignments?user.id=3557bebdc4d94a16b885094566c2bc9a&scope.domain.id=default&role.id=26d9c2ab5dfc4e6d9ca80c6014123906 => generated 530 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:02:04.137470 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c19ec78-95a4-4c5b-a397-4df3ed20636d None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:04.137798 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c19ec78-95a4-4c5b-a397-4df3ed20636d None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:04.138090 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c19ec78-95a4-4c5b-a397-4df3ed20636d None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:04.139536 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 26/54] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:02:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:02:04.145370 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06730566-9d78-4e7a-be7a-49ba0aa37bd3 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:04.145658 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06730566-9d78-4e7a-be7a-49ba0aa37bd3 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:04.145978 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06730566-9d78-4e7a-be7a-49ba0aa37bd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:04.163964 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-06730566-9d78-4e7a-be7a-49ba0aa37bd3 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:02:04.165178 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-06730566-9d78-4e7a-be7a-49ba0aa37bd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:02:04.194610 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:04.242032 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 29/55] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:02:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 10:02:04.266196 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c19ec78-95a4-4c5b-a397-4df3ed20636d None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:04.331216 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:04.396716 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c19ec78-95a4-4c5b-a397-4df3ed20636d None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:04.432704 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cc64c3-940f-4f1c-85a9-fa9648dabe77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:04.433510 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cc64c3-940f-4f1c-85a9-fa9648dabe77 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:04.433829 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cc64c3-940f-4f1c-85a9-fa9648dabe77 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:04.434117 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cc64c3-940f-4f1c-85a9-fa9648dabe77 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:04.435326 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cc64c3-940f-4f1c-85a9-fa9648dabe77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:04.436774 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cc64c3-940f-4f1c-85a9-fa9648dabe77 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:04.438594 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 27/56] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jun 22 10:02:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:02:04.444816 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06730566-9d78-4e7a-be7a-49ba0aa37bd3 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:04.547437 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06730566-9d78-4e7a-be7a-49ba0aa37bd3 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:04.581345 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7202d0ca-f2a7-48c6-b55e-02d64e9f1083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:04.582035 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7202d0ca-f2a7-48c6-b55e-02d64e9f1083 None admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:04.582326 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7202d0ca-f2a7-48c6-b55e-02d64e9f1083 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:04.583091 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7202d0ca-f2a7-48c6-b55e-02d64e9f1083 None admin] PATH_INFO: `/v3/projects` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:04.583807 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7202d0ca-f2a7-48c6-b55e-02d64e9f1083 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:04.585275 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7202d0ca-f2a7-48c6-b55e-02d64e9f1083 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:04.612120 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 30/57] 10.222.0.43 () {60 vars in 1140 bytes} [Wed Jun 22 10:02:04 2022] POST /identity/v3/projects => generated 298 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:02:06.672140 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e3132f-22cc-421c-93a5-f18535e580e5 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:06.672684 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e3132f-22cc-421c-93a5-f18535e580e5 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:06.672792 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e3132f-22cc-421c-93a5-f18535e580e5 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:06.674139 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 28/58] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:02:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:02:06.679727 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30c59d7-690b-469d-8878-69dbc7111529 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:06.680155 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30c59d7-690b-469d-8878-69dbc7111529 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:06.680289 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30c59d7-690b-469d-8878-69dbc7111529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:06.696765 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-a30c59d7-690b-469d-8878-69dbc7111529 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:02:06.697984 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-a30c59d7-690b-469d-8878-69dbc7111529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:02:06.706887 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:06.764959 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 31/59] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:02:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 10:02:06.791730 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e3132f-22cc-421c-93a5-f18535e580e5 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:06.890780 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e3132f-22cc-421c-93a5-f18535e580e5 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:06.900876 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:06.923852 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcc6ea8-7cf5-4055-8a9a-a0aaa78a7a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:06.924579 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcc6ea8-7cf5-4055-8a9a-a0aaa78a7a59 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:06.924863 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcc6ea8-7cf5-4055-8a9a-a0aaa78a7a59 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:06.925142 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcc6ea8-7cf5-4055-8a9a-a0aaa78a7a59 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:06.926885 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcc6ea8-7cf5-4055-8a9a-a0aaa78a7a59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:06.928333 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcc6ea8-7cf5-4055-8a9a-a0aaa78a7a59 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:06.929970 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 29/60] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jun 22 10:02:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:02:06.935429 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30c59d7-690b-469d-8878-69dbc7111529 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:07.031677 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30c59d7-690b-469d-8878-69dbc7111529 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:07.066676 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100e263c-e501-4c77-bf28-b2eeb0860801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:07.067382 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100e263c-e501-4c77-bf28-b2eeb0860801 None admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:07.067672 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100e263c-e501-4c77-bf28-b2eeb0860801 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:07.067956 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100e263c-e501-4c77-bf28-b2eeb0860801 None admin] PATH_INFO: `/v3/users` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:07.068677 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100e263c-e501-4c77-bf28-b2eeb0860801 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:07.070151 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100e263c-e501-4c77-bf28-b2eeb0860801 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:07.092295 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:07.097370 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 32/61] 10.222.0.43 () {60 vars in 1132 bytes} [Wed Jun 22 10:02:06 2022] POST /identity/v3/users => generated 275 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:02:10.236999 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8a8e15-c478-4343-81a0-b2bd53ab9af0 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:10.238039 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8a8e15-c478-4343-81a0-b2bd53ab9af0 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:10.238540 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8a8e15-c478-4343-81a0-b2bd53ab9af0 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:10.240663 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 30/62] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:02:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:02:10.246111 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b6a7d8-7386-474b-9464-0d79119a0112 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:10.246958 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b6a7d8-7386-474b-9464-0d79119a0112 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:10.247442 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b6a7d8-7386-474b-9464-0d79119a0112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:10.271248 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-d1b6a7d8-7386-474b-9464-0d79119a0112 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:02:10.272828 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-d1b6a7d8-7386-474b-9464-0d79119a0112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:02:10.367015 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 33/63] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:02:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 10:02:10.402348 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8a8e15-c478-4343-81a0-b2bd53ab9af0 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:10.551948 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8a8e15-c478-4343-81a0-b2bd53ab9af0 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:10.596722 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afa23c0-cca9-489e-a837-b776f261d825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:10.597540 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afa23c0-cca9-489e-a837-b776f261d825 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:10.597864 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afa23c0-cca9-489e-a837-b776f261d825 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:10.598397 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afa23c0-cca9-489e-a837-b776f261d825 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:10.603400 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe52066f-02f7-4fc6-8ff9-ec5cdb20699c None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:10.603940 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe52066f-02f7-4fc6-8ff9-ec5cdb20699c None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:10.604430 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe52066f-02f7-4fc6-8ff9-ec5cdb20699c None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:10.606078 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 34/64] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:02:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:02:10.611420 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80afd6f8-4efb-44d4-8c34-97314c1979ef None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:10.611715 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80afd6f8-4efb-44d4-8c34-97314c1979ef None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:10.612001 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80afd6f8-4efb-44d4-8c34-97314c1979ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:10.615556 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afa23c0-cca9-489e-a837-b776f261d825 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:02:10.624798 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-1afa23c0-cca9-489e-a837-b776f261d825 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 10:02:10.624798 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:02:10.624798 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:02:10.624798 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:02:10.624798 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:02:10.624798 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:02:10.624798 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:02:10.624798 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:02:10.624798 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:02:10.624798 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:02:10.624798 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:02:10.624798 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:02:10.624798 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:02:10.624798 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:02:10.624798 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:02:10.624798 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:02:10.625620 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:02:10.625620 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:02:10.625620 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:02:10.625620 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:02:10.625620 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:02:10.625620 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:02:10.625620 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:02:10.625620 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:02:10.625620 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:02:10.625620 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:02:10.625620 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:02:10.625620 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jun 22 10:02:10.625620 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:02:10.625620 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:02:10.625620 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:02:10.625620 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:02:10.626411 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:02:10.626411 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:02:10.626411 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:02:10.626411 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:02:10.626411 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:02:10.626411 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:02:10.626411 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:02:10.626411 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:02:10.626411 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:02:10.626411 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:02:10.626411 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 10:02:10.626411 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:02:10.626411 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 31/65] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Jun 22 10:02:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:02:10.631776 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afa23c0-cca9-489e-a837-b776f261d825 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:10.650767 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-80afd6f8-4efb-44d4-8c34-97314c1979ef None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:02:10.651979 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-80afd6f8-4efb-44d4-8c34-97314c1979ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:02:10.680846 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:10.744577 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 35/66] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:02:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 10:02:10.746260 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8aa1cc-3229-4c7e-9a89-a56b30b10533 None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:10.746737 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8aa1cc-3229-4c7e-9a89-a56b30b10533 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:10.747198 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8aa1cc-3229-4c7e-9a89-a56b30b10533 None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:10.748691 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 36/67] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:02:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:02:10.750015 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5600b1b-02b6-497f-af0b-eb35e4f81af7 None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:10.750524 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5600b1b-02b6-497f-af0b-eb35e4f81af7 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:10.750689 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afa23c0-cca9-489e-a837-b776f261d825 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:10.751105 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5600b1b-02b6-497f-af0b-eb35e4f81af7 None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:10.752539 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 37/68] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:02:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:02:10.758472 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2764a2a7-9b89-4ab7-88b0-f315a9a58388 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:10.758761 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2764a2a7-9b89-4ab7-88b0-f315a9a58388 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:10.759048 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2764a2a7-9b89-4ab7-88b0-f315a9a58388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:10.781991 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-2764a2a7-9b89-4ab7-88b0-f315a9a58388 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:02:10.783179 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-2764a2a7-9b89-4ab7-88b0-f315a9a58388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:02:10.799649 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0271cd07-6af1-4c58-a070-f20389f702d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:10.800336 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0271cd07-6af1-4c58-a070-f20389f702d0 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:10.800629 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0271cd07-6af1-4c58-a070-f20389f702d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:10.800915 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0271cd07-6af1-4c58-a070-f20389f702d0 None admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:10.802300 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0271cd07-6af1-4c58-a070-f20389f702d0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:02:10.802620 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0271cd07-6af1-4c58-a070-f20389f702d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:10.804046 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0271cd07-6af1-4c58-a070-f20389f702d0 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:10.812664 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 32/69] 10.222.0.43 () {56 vars in 1101 bytes} [Wed Jun 22 10:02:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:02:10.813827 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25be1d5-11a3-4134-93ae-f3ad2c3028e1 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:10.814127 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25be1d5-11a3-4134-93ae-f3ad2c3028e1 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:10.814417 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25be1d5-11a3-4134-93ae-f3ad2c3028e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:10.832076 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-e25be1d5-11a3-4134-93ae-f3ad2c3028e1 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:02:10.833400 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-e25be1d5-11a3-4134-93ae-f3ad2c3028e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:02:10.853736 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:10.867146 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 38/70] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:02:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 10:02:10.868162 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2764a2a7-9b89-4ab7-88b0-f315a9a58388 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:10.922248 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 33/71] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:02:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 10:02:10.923118 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25be1d5-11a3-4134-93ae-f3ad2c3028e1 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:10.953151 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:10.975340 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2764a2a7-9b89-4ab7-88b0-f315a9a58388 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:11.010358 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa5b3f2-6c62-43fa-932b-9b2f80b8fda1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:11.011157 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa5b3f2-6c62-43fa-932b-9b2f80b8fda1 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:11.011444 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa5b3f2-6c62-43fa-932b-9b2f80b8fda1 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:11.011722 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa5b3f2-6c62-43fa-932b-9b2f80b8fda1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:11.022113 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa5b3f2-6c62-43fa-932b-9b2f80b8fda1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:02:11.024129 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25be1d5-11a3-4134-93ae-f3ad2c3028e1 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:11.029764 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-eaa5b3f2-6c62-43fa-932b-9b2f80b8fda1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 10:02:11.029764 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:02:11.029764 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:02:11.029764 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:02:11.029764 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:02:11.029764 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:02:11.029764 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:02:11.029764 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:02:11.029764 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:02:11.029764 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:02:11.029764 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:02:11.029764 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:02:11.029764 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:02:11.029764 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:02:11.029764 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:02:11.029764 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:02:11.030713 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:02:11.030713 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:02:11.030713 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:02:11.030713 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:02:11.030713 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:02:11.030713 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:02:11.030713 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:02:11.030713 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:02:11.030713 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:02:11.030713 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:02:11.030713 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:02:11.030713 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( Jun 22 10:02:11.030713 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:02:11.030713 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:02:11.030713 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:02:11.030713 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:02:11.031543 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:02:11.031543 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:02:11.031543 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:02:11.031543 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:02:11.031543 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:02:11.031543 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:02:11.031543 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:02:11.031543 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:02:11.031543 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:02:11.031543 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:02:11.031543 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 10:02:11.031543 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:02:11.031543 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 39/72] 10.222.0.43 () {56 vars in 1096 bytes} [Wed Jun 22 10:02:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:02:11.032204 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa5b3f2-6c62-43fa-932b-9b2f80b8fda1 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:11.059883 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f201da4b-abbc-4105-b77a-7f44996468ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:11.060763 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f201da4b-abbc-4105-b77a-7f44996468ae None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:11.061054 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f201da4b-abbc-4105-b77a-7f44996468ae None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:11.061339 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f201da4b-abbc-4105-b77a-7f44996468ae None admin] PATH_INFO: `/v3/users/0f1078f8c5e549218cce1ee68f96ea91` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:11.077644 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f201da4b-abbc-4105-b77a-7f44996468ae None admin] RBAC: Authorizing `identity:get_user(user_id=0f1078f8c5e549218cce1ee68f96ea91)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:11.079209 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f201da4b-abbc-4105-b77a-7f44996468ae None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:11.080875 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 34/73] 10.222.0.43 () {56 vars in 1177 bytes} [Wed Jun 22 10:02:10 2022] GET /identity/v3/users/0f1078f8c5e549218cce1ee68f96ea91 => generated 275 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:02:11.082090 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:11.082197 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815c16b6-e952-4b2a-b30c-3fa2ebe69d1e None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:11.082384 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815c16b6-e952-4b2a-b30c-3fa2ebe69d1e None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:11.082765 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815c16b6-e952-4b2a-b30c-3fa2ebe69d1e None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:11.084896 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 35/74] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:02:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:02:11.085544 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815c16b6-e952-4b2a-b30c-3fa2ebe69d1e None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:11.137497 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa5b3f2-6c62-43fa-932b-9b2f80b8fda1 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:11.170324 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a76a8a-fafe-4ee9-b901-672b331d30c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:11.171133 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a76a8a-fafe-4ee9-b901-672b331d30c9 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:11.171422 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a76a8a-fafe-4ee9-b901-672b331d30c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:11.171706 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a76a8a-fafe-4ee9-b901-672b331d30c9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:11.179714 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:11.182953 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a76a8a-fafe-4ee9-b901-672b331d30c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:02:11.190824 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-a8a76a8a-fafe-4ee9-b901-672b331d30c9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 10:02:11.190824 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:02:11.190824 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:02:11.190824 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:02:11.190824 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:02:11.190824 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:02:11.190824 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:02:11.190824 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:02:11.190824 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:02:11.190824 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:02:11.190824 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:02:11.190824 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:02:11.190824 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:02:11.190824 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:02:11.190824 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:02:11.190824 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:02:11.191665 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:02:11.191665 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:02:11.191665 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:02:11.191665 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:02:11.191665 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:02:11.191665 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:02:11.191665 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:02:11.191665 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:02:11.191665 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:02:11.191665 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:02:11.191665 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:02:11.191665 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( Jun 22 10:02:11.191665 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:02:11.191665 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:02:11.191665 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:02:11.191665 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:02:11.193207 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:02:11.193207 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:02:11.193207 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:02:11.193207 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:02:11.193207 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:02:11.193207 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:02:11.193207 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:02:11.193207 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:02:11.193207 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:02:11.193207 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:02:11.193207 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 10:02:11.193207 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:02:11.193207 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 40/75] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Jun 22 10:02:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:02:11.193889 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815c16b6-e952-4b2a-b30c-3fa2ebe69d1e None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:11.193956 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a76a8a-fafe-4ee9-b901-672b331d30c9 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:11.228223 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c704e738-ad27-4211-8b79-6993e6939228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:11.229043 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c704e738-ad27-4211-8b79-6993e6939228 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:11.229330 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c704e738-ad27-4211-8b79-6993e6939228 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:11.229611 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c704e738-ad27-4211-8b79-6993e6939228 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:11.240061 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c704e738-ad27-4211-8b79-6993e6939228 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:02:11.248156 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-c704e738-ad27-4211-8b79-6993e6939228 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 10:02:11.248156 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:02:11.248156 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:02:11.248156 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:02:11.248156 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:02:11.248156 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:02:11.248156 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:02:11.248156 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:02:11.248156 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:02:11.248156 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:02:11.248156 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:02:11.248156 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:02:11.248156 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:02:11.248156 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:02:11.248156 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:02:11.248156 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:02:11.248980 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:02:11.248980 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:02:11.248980 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:02:11.248980 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:02:11.248980 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:02:11.248980 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:02:11.248980 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:02:11.248980 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:02:11.248980 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:02:11.248980 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:02:11.248980 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:02:11.248980 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jun 22 10:02:11.248980 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:02:11.248980 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:02:11.248980 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:02:11.248980 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:02:11.254802 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:02:11.254802 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:02:11.254802 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:02:11.254802 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:02:11.254802 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:02:11.254802 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:02:11.254802 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:02:11.254802 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:02:11.254802 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:02:11.254802 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:02:11.254802 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 10:02:11.254802 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:02:11.254802 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 36/76] 10.222.0.43 () {56 vars in 1114 bytes} [Wed Jun 22 10:02:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:02:11.254802 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c704e738-ad27-4211-8b79-6993e6939228 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:11.292733 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a76a8a-fafe-4ee9-b901-672b331d30c9 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:11.303403 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:11.327081 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29d91ae-4311-431b-9e8d-8552aa2b9f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:11.327757 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29d91ae-4311-431b-9e8d-8552aa2b9f0e None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:11.328050 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29d91ae-4311-431b-9e8d-8552aa2b9f0e None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:11.328336 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29d91ae-4311-431b-9e8d-8552aa2b9f0e None admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:11.329094 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29d91ae-4311-431b-9e8d-8552aa2b9f0e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:02:11.329408 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29d91ae-4311-431b-9e8d-8552aa2b9f0e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:11.330855 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29d91ae-4311-431b-9e8d-8552aa2b9f0e None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:11.339172 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 41/77] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Jun 22 10:02:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:02:11.340361 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf448bd6-682c-469d-b4f2-c4dd6c79402e None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:11.340657 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf448bd6-682c-469d-b4f2-c4dd6c79402e None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:11.340945 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf448bd6-682c-469d-b4f2-c4dd6c79402e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:11.352489 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c704e738-ad27-4211-8b79-6993e6939228 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:11.359002 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-bf448bd6-682c-469d-b4f2-c4dd6c79402e None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:02:11.360195 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-bf448bd6-682c-469d-b4f2-c4dd6c79402e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:02:11.386566 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb87bb7-66ac-448e-949a-af0249ad94cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:11.387438 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb87bb7-66ac-448e-949a-af0249ad94cf None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:11.387730 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb87bb7-66ac-448e-949a-af0249ad94cf None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:11.388016 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb87bb7-66ac-448e-949a-af0249ad94cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:11.405262 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:11.428286 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 42/78] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:02:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 10:02:11.429215 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf448bd6-682c-469d-b4f2-c4dd6c79402e None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:11.456685 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb87bb7-66ac-448e-949a-af0249ad94cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:11.458759 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb87bb7-66ac-448e-949a-af0249ad94cf None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:11.544845 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf448bd6-682c-469d-b4f2-c4dd6c79402e None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:11.548090 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:11.562949 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 37/79] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Jun 22 10:02:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 10:02:11.563805 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb87bb7-66ac-448e-949a-af0249ad94cf None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:11.586020 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ec40f8-05cd-4a7f-8fd0-222768282cd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:11.586701 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ec40f8-05cd-4a7f-8fd0-222768282cd9 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:11.586987 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ec40f8-05cd-4a7f-8fd0-222768282cd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:11.587274 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ec40f8-05cd-4a7f-8fd0-222768282cd9 None admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:11.588032 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ec40f8-05cd-4a7f-8fd0-222768282cd9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:02:11.588344 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ec40f8-05cd-4a7f-8fd0-222768282cd9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:11.589780 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ec40f8-05cd-4a7f-8fd0-222768282cd9 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:11.597798 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 43/80] 10.222.0.43 () {56 vars in 1101 bytes} [Wed Jun 22 10:02:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:02:11.599093 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ec40f8-05cd-4a7f-8fd0-222768282cd9 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:11.612683 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:11.664835 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb87bb7-66ac-448e-949a-af0249ad94cf None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:11.699242 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ec40f8-05cd-4a7f-8fd0-222768282cd9 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:11.700732 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3462023a-0a46-49cb-8bf2-c803d35b3faf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:11.701408 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3462023a-0a46-49cb-8bf2-c803d35b3faf None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:11.701727 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3462023a-0a46-49cb-8bf2-c803d35b3faf None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:11.702014 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3462023a-0a46-49cb-8bf2-c803d35b3faf None admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:11.702780 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3462023a-0a46-49cb-8bf2-c803d35b3faf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:02:11.703097 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3462023a-0a46-49cb-8bf2-c803d35b3faf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:11.704499 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3462023a-0a46-49cb-8bf2-c803d35b3faf None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:11.712484 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 38/81] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Jun 22 10:02:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:02:11.713222 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3462023a-0a46-49cb-8bf2-c803d35b3faf None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:11.736116 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a251e33e-0f77-4896-885d-ea99d644ebd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:11.737011 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a251e33e-0f77-4896-885d-ea99d644ebd9 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:11.737305 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a251e33e-0f77-4896-885d-ea99d644ebd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:11.737589 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a251e33e-0f77-4896-885d-ea99d644ebd9 None admin] PATH_INFO: `/v3/users/3557bebdc4d94a16b885094566c2bc9a` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:11.739354 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a251e33e-0f77-4896-885d-ea99d644ebd9 None admin] RBAC: Authorizing `identity:get_user(user_id=3557bebdc4d94a16b885094566c2bc9a)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:11.740876 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a251e33e-0f77-4896-885d-ea99d644ebd9 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:11.743914 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 44/82] 10.222.0.43 () {56 vars in 1177 bytes} [Wed Jun 22 10:02:11 2022] GET /identity/v3/users/3557bebdc4d94a16b885094566c2bc9a => generated 247 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:02:11.743914 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a251e33e-0f77-4896-885d-ea99d644ebd9 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:11.775399 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:11.818803 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3462023a-0a46-49cb-8bf2-c803d35b3faf None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:11.834197 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:11.847007 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a251e33e-0f77-4896-885d-ea99d644ebd9 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:11.860826 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969e0cfc-abf8-480b-bc7d-80236f8b5354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:11.861635 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969e0cfc-abf8-480b-bc7d-80236f8b5354 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:11.861961 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969e0cfc-abf8-480b-bc7d-80236f8b5354 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:11.862242 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969e0cfc-abf8-480b-bc7d-80236f8b5354 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:11.863437 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969e0cfc-abf8-480b-bc7d-80236f8b5354 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:11.865421 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969e0cfc-abf8-480b-bc7d-80236f8b5354 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:11.867338 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 39/83] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jun 22 10:02:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:02:11.868112 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969e0cfc-abf8-480b-bc7d-80236f8b5354 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:11.886332 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63413e7-aadb-4318-84ba-a6b8cd664e2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:11.887203 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63413e7-aadb-4318-84ba-a6b8cd664e2c None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:11.887488 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63413e7-aadb-4318-84ba-a6b8cd664e2c None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:11.887764 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63413e7-aadb-4318-84ba-a6b8cd664e2c None admin] PATH_INFO: `/v3/projects/6008ad7344a543cdae5546c3d2f389b1` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:11.888952 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63413e7-aadb-4318-84ba-a6b8cd664e2c None admin] RBAC: Authorizing `identity:get_project(project_id=6008ad7344a543cdae5546c3d2f389b1)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:11.890448 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63413e7-aadb-4318-84ba-a6b8cd664e2c None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:11.892145 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 45/84] 10.222.0.43 () {56 vars in 1186 bytes} [Wed Jun 22 10:02:11 2022] GET /identity/v3/projects/6008ad7344a543cdae5546c3d2f389b1 => generated 298 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:02:11.893616 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63413e7-aadb-4318-84ba-a6b8cd664e2c None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:11.972795 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969e0cfc-abf8-480b-bc7d-80236f8b5354 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:11.994515 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:11.997829 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63413e7-aadb-4318-84ba-a6b8cd664e2c None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:12.011932 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7efac96-077b-48ec-a047-3bf76cd68cb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:12.012905 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7efac96-077b-48ec-a047-3bf76cd68cb9 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:12.013205 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7efac96-077b-48ec-a047-3bf76cd68cb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:12.013493 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7efac96-077b-48ec-a047-3bf76cd68cb9 None admin] PATH_INFO: `/v3/users/0f1078f8c5e549218cce1ee68f96ea91` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:12.014747 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7efac96-077b-48ec-a047-3bf76cd68cb9 None admin] RBAC: Authorizing `identity:get_user(user_id=0f1078f8c5e549218cce1ee68f96ea91)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:12.016229 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7efac96-077b-48ec-a047-3bf76cd68cb9 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:12.018271 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 40/85] 10.222.0.43 () {56 vars in 1177 bytes} [Wed Jun 22 10:02:11 2022] GET /identity/v3/users/0f1078f8c5e549218cce1ee68f96ea91 => generated 275 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:02:12.018680 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7efac96-077b-48ec-a047-3bf76cd68cb9 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:12.032182 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c31e01-8301-47e5-8f78-fc1ef095a343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:12.033058 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c31e01-8301-47e5-8f78-fc1ef095a343 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:12.033345 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c31e01-8301-47e5-8f78-fc1ef095a343 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:12.033625 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c31e01-8301-47e5-8f78-fc1ef095a343 None admin] PATH_INFO: `/v3/users/0f1078f8c5e549218cce1ee68f96ea91` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:12.034838 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c31e01-8301-47e5-8f78-fc1ef095a343 None admin] RBAC: Authorizing `identity:get_user(user_id=0f1078f8c5e549218cce1ee68f96ea91)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:12.036837 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c31e01-8301-47e5-8f78-fc1ef095a343 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:12.038488 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 46/86] 10.222.0.43 () {56 vars in 1177 bytes} [Wed Jun 22 10:02:11 2022] GET /identity/v3/users/0f1078f8c5e549218cce1ee68f96ea91 => generated 275 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:02:12.039218 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c31e01-8301-47e5-8f78-fc1ef095a343 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:12.071644 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:12.131306 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7efac96-077b-48ec-a047-3bf76cd68cb9 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:12.139942 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c31e01-8301-47e5-8f78-fc1ef095a343 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:12.164703 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaee45a2-a498-4b6a-a5a7-14ba681f4baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:12.165367 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaee45a2-a498-4b6a-a5a7-14ba681f4baf None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:12.165663 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaee45a2-a498-4b6a-a5a7-14ba681f4baf None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:12.165985 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaee45a2-a498-4b6a-a5a7-14ba681f4baf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:12.173449 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1246ca2a-844d-4e8b-b1c8-8a92ca345fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:12.174154 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1246ca2a-844d-4e8b-b1c8-8a92ca345fd6 None admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:12.174433 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1246ca2a-844d-4e8b-b1c8-8a92ca345fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:12.174713 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1246ca2a-844d-4e8b-b1c8-8a92ca345fd6 None admin] PATH_INFO: `/v3/users` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:12.175438 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1246ca2a-844d-4e8b-b1c8-8a92ca345fd6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:12.177608 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1246ca2a-844d-4e8b-b1c8-8a92ca345fd6 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:12.199138 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 47/87] 10.222.0.43 () {60 vars in 1132 bytes} [Wed Jun 22 10:02:12 2022] POST /identity/v3/users => generated 289 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:02:12.199987 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1246ca2a-844d-4e8b-b1c8-8a92ca345fd6 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:12.232109 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:12.260142 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaee45a2-a498-4b6a-a5a7-14ba681f4baf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:12.263637 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaee45a2-a498-4b6a-a5a7-14ba681f4baf None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:12.348490 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:12.354444 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1246ca2a-844d-4e8b-b1c8-8a92ca345fd6 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:12.409339 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef5fadb-0a37-4859-ac68-331e83f55d95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:12.410057 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef5fadb-0a37-4859-ac68-331e83f55d95 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:12.410346 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef5fadb-0a37-4859-ac68-331e83f55d95 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:12.410626 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef5fadb-0a37-4859-ac68-331e83f55d95 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:12.411475 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef5fadb-0a37-4859-ac68-331e83f55d95 None admin] RBAC: Adding query filter params (role.id=9f88c83743f745a9a785a2f454753f06, scope.project.id=6008ad7344a543cdae5546c3d2f389b1, user.id=0f1078f8c5e549218cce1ee68f96ea91) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:02:12.411790 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef5fadb-0a37-4859-ac68-331e83f55d95 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:12.413273 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef5fadb-0a37-4859-ac68-331e83f55d95 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:12.419877 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 48/88] 10.222.0.43 () {56 vars in 1374 bytes} [Wed Jun 22 10:02:12 2022] GET /identity/v3/role_assignments?user.id=0f1078f8c5e549218cce1ee68f96ea91&scope.project.id=6008ad7344a543cdae5546c3d2f389b1&role.id=9f88c83743f745a9a785a2f454753f06 => generated 259 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:02:12.420631 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef5fadb-0a37-4859-ac68-331e83f55d95 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:12.422298 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 41/89] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Jun 22 10:02:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 10:02:12.423163 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaee45a2-a498-4b6a-a5a7-14ba681f4baf None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:12.561722 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:12.581560 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaee45a2-a498-4b6a-a5a7-14ba681f4baf None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:12.581776 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef5fadb-0a37-4859-ac68-331e83f55d95 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:12.630804 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67842f04-83c1-452f-bd17-36b22328e1c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:12.631477 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67842f04-83c1-452f-bd17-36b22328e1c4 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:12.631767 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67842f04-83c1-452f-bd17-36b22328e1c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:12.632052 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67842f04-83c1-452f-bd17-36b22328e1c4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:12.632568 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a4fef0-4b0b-4a4d-a8f7-734fc89e4e9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:12.633331 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a4fef0-4b0b-4a4d-a8f7-734fc89e4e9e None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:12.633631 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a4fef0-4b0b-4a4d-a8f7-734fc89e4e9e None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:12.633959 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a4fef0-4b0b-4a4d-a8f7-734fc89e4e9e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:12.655025 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:12.721592 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67842f04-83c1-452f-bd17-36b22328e1c4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:12.723861 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67842f04-83c1-452f-bd17-36b22328e1c4 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:12.726649 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a4fef0-4b0b-4a4d-a8f7-734fc89e4e9e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:12.729081 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a4fef0-4b0b-4a4d-a8f7-734fc89e4e9e None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:12.849102 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:12.862928 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 49/90] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Jun 22 10:02:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 10:02:12.864324 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67842f04-83c1-452f-bd17-36b22328e1c4 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:12.969430 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67842f04-83c1-452f-bd17-36b22328e1c4 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:12.992404 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 42/91] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Jun 22 10:02:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 570 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 10:02:12.993319 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a4fef0-4b0b-4a4d-a8f7-734fc89e4e9e None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:13.012552 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5482fa-91cb-46d1-aa43-8fe422c1d104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:13.013578 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5482fa-91cb-46d1-aa43-8fe422c1d104 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:13.013977 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5482fa-91cb-46d1-aa43-8fe422c1d104 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:13.014338 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5482fa-91cb-46d1-aa43-8fe422c1d104 None admin] PATH_INFO: `/v3/projects/6008ad7344a543cdae5546c3d2f389b1` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:13.015748 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5482fa-91cb-46d1-aa43-8fe422c1d104 None admin] RBAC: Authorizing `identity:get_project(project_id=6008ad7344a543cdae5546c3d2f389b1)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:13.017317 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5482fa-91cb-46d1-aa43-8fe422c1d104 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:13.019299 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 50/92] 10.222.0.43 () {56 vars in 1186 bytes} [Wed Jun 22 10:02:12 2022] GET /identity/v3/projects/6008ad7344a543cdae5546c3d2f389b1 => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:02:13.020855 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5482fa-91cb-46d1-aa43-8fe422c1d104 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:13.094127 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:13.110042 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:13.190619 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5482fa-91cb-46d1-aa43-8fe422c1d104 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:13.206079 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a4fef0-4b0b-4a4d-a8f7-734fc89e4e9e None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:13.249714 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba6dd15-2d42-48fd-aaae-57197a52d374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:13.249714 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba6dd15-2d42-48fd-aaae-57197a52d374 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:13.249714 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba6dd15-2d42-48fd-aaae-57197a52d374 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:13.249714 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba6dd15-2d42-48fd-aaae-57197a52d374 None admin] PATH_INFO: `/v3/projects/81c599c329414b5996c1a83c3743148c` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:13.250119 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba6dd15-2d42-48fd-aaae-57197a52d374 None admin] RBAC: Authorizing `identity:get_project(project_id=81c599c329414b5996c1a83c3743148c)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:13.250119 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba6dd15-2d42-48fd-aaae-57197a52d374 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:13.250119 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 43/93] 10.222.0.43 () {56 vars in 1186 bytes} [Wed Jun 22 10:02:12 2022] GET /identity/v3/projects/81c599c329414b5996c1a83c3743148c => generated 312 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:02:13.251010 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba6dd15-2d42-48fd-aaae-57197a52d374 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:13.257754 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259ecd81-e6ec-4d4c-aa74-9268cdca57e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:13.258938 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259ecd81-e6ec-4d4c-aa74-9268cdca57e7 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:13.259431 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259ecd81-e6ec-4d4c-aa74-9268cdca57e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:13.259914 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259ecd81-e6ec-4d4c-aa74-9268cdca57e7 None admin] PATH_INFO: `/v3/projects/6008ad7344a543cdae5546c3d2f389b1` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:13.261365 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259ecd81-e6ec-4d4c-aa74-9268cdca57e7 None admin] RBAC: Authorizing `identity:get_project(project_id=6008ad7344a543cdae5546c3d2f389b1)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:13.263082 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259ecd81-e6ec-4d4c-aa74-9268cdca57e7 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:13.265106 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 51/94] 10.222.0.43 () {56 vars in 1186 bytes} [Wed Jun 22 10:02:13 2022] GET /identity/v3/projects/6008ad7344a543cdae5546c3d2f389b1 => generated 298 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:02:13.266263 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259ecd81-e6ec-4d4c-aa74-9268cdca57e7 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:13.365644 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba6dd15-2d42-48fd-aaae-57197a52d374 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:13.380973 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:13.403151 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1a97c5-8c5e-435e-971c-683beba7d9b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:13.403759 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1a97c5-8c5e-435e-971c-683beba7d9b2 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:13.404058 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1a97c5-8c5e-435e-971c-683beba7d9b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:13.404343 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1a97c5-8c5e-435e-971c-683beba7d9b2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:13.405197 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1a97c5-8c5e-435e-971c-683beba7d9b2 None admin] RBAC: Adding query filter params (role.id=26d9c2ab5dfc4e6d9ca80c6014123906, scope.project.id=6008ad7344a543cdae5546c3d2f389b1, user.id=3557bebdc4d94a16b885094566c2bc9a) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:02:13.405720 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1a97c5-8c5e-435e-971c-683beba7d9b2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:13.407033 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1a97c5-8c5e-435e-971c-683beba7d9b2 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:13.416550 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 44/95] 10.222.0.43 () {56 vars in 1374 bytes} [Wed Jun 22 10:02:13 2022] GET /identity/v3/role_assignments?user.id=3557bebdc4d94a16b885094566c2bc9a&scope.project.id=6008ad7344a543cdae5546c3d2f389b1&role.id=26d9c2ab5dfc4e6d9ca80c6014123906 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:02:13.417306 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1a97c5-8c5e-435e-971c-683beba7d9b2 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:13.430159 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259ecd81-e6ec-4d4c-aa74-9268cdca57e7 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:13.474106 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:13.490813 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acda9d64-0675-4d6f-8923-cedf840db891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:13.491608 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acda9d64-0675-4d6f-8923-cedf840db891 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:13.492002 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acda9d64-0675-4d6f-8923-cedf840db891 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:13.492368 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acda9d64-0675-4d6f-8923-cedf840db891 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:13.493321 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acda9d64-0675-4d6f-8923-cedf840db891 None admin] RBAC: Adding query filter params (role.id=9f88c83743f745a9a785a2f454753f06, scope.project.id=81c599c329414b5996c1a83c3743148c, user.id=0f1078f8c5e549218cce1ee68f96ea91) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:02:13.493735 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acda9d64-0675-4d6f-8923-cedf840db891 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:13.495330 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acda9d64-0675-4d6f-8923-cedf840db891 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:13.510183 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 52/96] 10.222.0.43 () {56 vars in 1374 bytes} [Wed Jun 22 10:02:13 2022] GET /identity/v3/role_assignments?user.id=0f1078f8c5e549218cce1ee68f96ea91&scope.project.id=81c599c329414b5996c1a83c3743148c&role.id=9f88c83743f745a9a785a2f454753f06 => generated 259 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:02:13.537857 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1a97c5-8c5e-435e-971c-683beba7d9b2 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:13.578967 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f88d27-9522-47bf-b50f-2f7d6963c509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:13.579716 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f88d27-9522-47bf-b50f-2f7d6963c509 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:13.580024 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f88d27-9522-47bf-b50f-2f7d6963c509 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:13.580312 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f88d27-9522-47bf-b50f-2f7d6963c509 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:13.581199 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f88d27-9522-47bf-b50f-2f7d6963c509 None admin] RBAC: Adding query filter params (role.id=23a6a1fcd69d4210a8f2b45559b65aea, scope.project.id=6008ad7344a543cdae5546c3d2f389b1, user.id=0f1078f8c5e549218cce1ee68f96ea91) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:02:13.581524 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f88d27-9522-47bf-b50f-2f7d6963c509 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:13.583184 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f88d27-9522-47bf-b50f-2f7d6963c509 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:13.590476 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 45/97] 10.222.0.43 () {56 vars in 1374 bytes} [Wed Jun 22 10:02:13 2022] GET /identity/v3/role_assignments?user.id=0f1078f8c5e549218cce1ee68f96ea91&scope.project.id=6008ad7344a543cdae5546c3d2f389b1&role.id=23a6a1fcd69d4210a8f2b45559b65aea => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:02:14.902190 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695c72b7-d439-469a-b96f-b4da84afad69 None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:14.903225 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695c72b7-d439-469a-b96f-b4da84afad69 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:14.903743 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695c72b7-d439-469a-b96f-b4da84afad69 None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:14.905331 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 53/98] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:02:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:02:14.922490 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377ac2a9-a9c6-45bd-b3c0-e65e5fe8b890 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:14.923449 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377ac2a9-a9c6-45bd-b3c0-e65e5fe8b890 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:14.923936 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377ac2a9-a9c6-45bd-b3c0-e65e5fe8b890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:14.950689 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-377ac2a9-a9c6-45bd-b3c0-e65e5fe8b890 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:02:14.952229 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-377ac2a9-a9c6-45bd-b3c0-e65e5fe8b890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:02:14.998487 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:15.039642 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 46/99] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:02:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 10:02:15.092239 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695c72b7-d439-469a-b96f-b4da84afad69 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:15.243406 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695c72b7-d439-469a-b96f-b4da84afad69 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:15.289450 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fe770e-74ba-4ebd-9453-9eaa8135a9ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:15.290660 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fe770e-74ba-4ebd-9453-9eaa8135a9ee None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:15.291152 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fe770e-74ba-4ebd-9453-9eaa8135a9ee None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:15.291632 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fe770e-74ba-4ebd-9453-9eaa8135a9ee None admin] PATH_INFO: `/v3/roles/member` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:15.303420 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcab2dc1-4541-460e-ac34-78314ff98905 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:15.304088 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcab2dc1-4541-460e-ac34-78314ff98905 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:15.304850 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcab2dc1-4541-460e-ac34-78314ff98905 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:15.305208 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fe770e-74ba-4ebd-9453-9eaa8135a9ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:02:15.306986 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 47/100] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:02:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:02:15.314428 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-d5fe770e-74ba-4ebd-9453-9eaa8135a9ee None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 10:02:15.314428 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:02:15.314428 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:02:15.314428 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:02:15.314428 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:02:15.314428 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:02:15.314428 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:02:15.314428 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:02:15.314428 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:02:15.314428 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:02:15.314428 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:02:15.314428 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:02:15.314428 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:02:15.314428 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:02:15.314428 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:02:15.314428 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:02:15.315258 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:02:15.315258 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:02:15.315258 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:02:15.315258 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:02:15.315258 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:02:15.315258 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:02:15.315258 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:02:15.315258 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:02:15.315258 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:02:15.315258 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:02:15.315258 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:02:15.315258 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( Jun 22 10:02:15.315258 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:02:15.315258 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:02:15.315258 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:02:15.315258 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:02:15.316000 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:02:15.316000 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:02:15.316000 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:02:15.316000 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:02:15.316000 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:02:15.316000 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:02:15.316000 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:02:15.316000 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:02:15.316000 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:02:15.316000 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:02:15.316000 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 10:02:15.316000 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:02:15.316000 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 54/101] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Jun 22 10:02:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:02:15.320961 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9137c539-495e-4401-9591-9a7c3a67a383 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:15.321482 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9137c539-495e-4401-9591-9a7c3a67a383 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:15.321999 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9137c539-495e-4401-9591-9a7c3a67a383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:15.327629 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fe770e-74ba-4ebd-9453-9eaa8135a9ee None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:15.357948 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-9137c539-495e-4401-9591-9a7c3a67a383 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:02:15.359670 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-9137c539-495e-4401-9591-9a7c3a67a383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:02:15.430061 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:15.513889 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 48/102] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:02:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 10:02:15.519175 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ec8d97-14dc-4166-ab6e-88a704bae35d None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:15.519476 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ec8d97-14dc-4166-ab6e-88a704bae35d None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:15.519768 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ec8d97-14dc-4166-ab6e-88a704bae35d None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:15.521979 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 49/103] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:02:15 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:02:15.537435 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fe770e-74ba-4ebd-9453-9eaa8135a9ee None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:15.539073 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4753dfb1-f0f1-40f8-910a-7363510fc85d None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:15.539374 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4753dfb1-f0f1-40f8-910a-7363510fc85d None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:15.539668 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4753dfb1-f0f1-40f8-910a-7363510fc85d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:15.561996 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-4753dfb1-f0f1-40f8-910a-7363510fc85d None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:02:15.563205 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-4753dfb1-f0f1-40f8-910a-7363510fc85d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:02:15.623140 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe64677a-fa24-43af-b80c-a90180fbf627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:15.623843 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe64677a-fa24-43af-b80c-a90180fbf627 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:15.624138 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe64677a-fa24-43af-b80c-a90180fbf627 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:15.624431 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe64677a-fa24-43af-b80c-a90180fbf627 None admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:15.625212 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe64677a-fa24-43af-b80c-a90180fbf627 None admin] RBAC: Adding query filter params (name=member) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:02:15.625529 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe64677a-fa24-43af-b80c-a90180fbf627 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:15.634753 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe64677a-fa24-43af-b80c-a90180fbf627 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:15.645572 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 55/104] 10.222.0.43 () {56 vars in 1101 bytes} [Wed Jun 22 10:02:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:02:15.646278 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe64677a-fa24-43af-b80c-a90180fbf627 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:15.665834 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 50/105] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:02:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 10:02:15.667206 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4753dfb1-f0f1-40f8-910a-7363510fc85d None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:15.715568 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:15.768870 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe64677a-fa24-43af-b80c-a90180fbf627 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:15.779858 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:15.799668 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4753dfb1-f0f1-40f8-910a-7363510fc85d None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:15.806509 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83d190d-8389-4365-b561-8a22b5296756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:15.807325 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83d190d-8389-4365-b561-8a22b5296756 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:15.807619 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83d190d-8389-4365-b561-8a22b5296756 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:15.807895 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83d190d-8389-4365-b561-8a22b5296756 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:15.809294 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83d190d-8389-4365-b561-8a22b5296756 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:15.810801 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83d190d-8389-4365-b561-8a22b5296756 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:15.812645 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 56/106] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jun 22 10:02:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:02:15.813237 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83d190d-8389-4365-b561-8a22b5296756 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:15.847102 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e77164-099f-4e11-9440-311597e35759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:15.847996 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e77164-099f-4e11-9440-311597e35759 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:15.848932 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e77164-099f-4e11-9440-311597e35759 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:15.849262 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e77164-099f-4e11-9440-311597e35759 None admin] PATH_INFO: `/v3/users/0f1078f8c5e549218cce1ee68f96ea91` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:15.850718 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e77164-099f-4e11-9440-311597e35759 None admin] RBAC: Authorizing `identity:get_user(user_id=0f1078f8c5e549218cce1ee68f96ea91)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:15.852221 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e77164-099f-4e11-9440-311597e35759 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:15.853925 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 51/107] 10.222.0.43 () {56 vars in 1177 bytes} [Wed Jun 22 10:02:15 2022] GET /identity/v3/users/0f1078f8c5e549218cce1ee68f96ea91 => generated 275 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:02:15.854756 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e77164-099f-4e11-9440-311597e35759 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:15.963408 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:15.967213 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e77164-099f-4e11-9440-311597e35759 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:16.005630 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c106ebd7-c565-4cbb-bce6-8dc1d0a53a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:16.006328 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c106ebd7-c565-4cbb-bce6-8dc1d0a53a6c None admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:16.006625 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c106ebd7-c565-4cbb-bce6-8dc1d0a53a6c None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:16.006912 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c106ebd7-c565-4cbb-bce6-8dc1d0a53a6c None admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:16.007642 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c106ebd7-c565-4cbb-bce6-8dc1d0a53a6c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:16.009108 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c106ebd7-c565-4cbb-bce6-8dc1d0a53a6c None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:16.050356 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 52/108] 10.222.0.43 () {60 vars in 1141 bytes} [Wed Jun 22 10:02:15 2022] POST /identity/v3/projects => generated 302 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:02:16.050884 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83d190d-8389-4365-b561-8a22b5296756 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:16.051909 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c106ebd7-c565-4cbb-bce6-8dc1d0a53a6c None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:16.107909 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500c49cc-cab1-4d98-b079-1d75f1420766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:16.108737 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500c49cc-cab1-4d98-b079-1d75f1420766 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:16.109032 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500c49cc-cab1-4d98-b079-1d75f1420766 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:16.109318 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500c49cc-cab1-4d98-b079-1d75f1420766 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:16.136394 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500c49cc-cab1-4d98-b079-1d75f1420766 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:02:16.145782 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-500c49cc-cab1-4d98-b079-1d75f1420766 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 10:02:16.145782 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:02:16.145782 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:02:16.145782 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:02:16.145782 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:02:16.145782 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:02:16.145782 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:02:16.145782 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:02:16.145782 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:02:16.145782 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:02:16.145782 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:02:16.145782 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:02:16.145782 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:02:16.145782 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:02:16.145782 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:02:16.145782 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:02:16.146747 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:02:16.146747 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:02:16.146747 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:02:16.146747 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:02:16.146747 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:02:16.146747 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:02:16.146747 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:02:16.146747 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:02:16.146747 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:02:16.146747 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:02:16.146747 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:02:16.146747 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( Jun 22 10:02:16.146747 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:02:16.146747 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:02:16.146747 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:02:16.146747 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:02:16.147532 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:02:16.147532 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:02:16.147532 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:02:16.147532 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:02:16.147532 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:02:16.147532 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:02:16.147532 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:02:16.147532 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:02:16.147532 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:02:16.147532 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:02:16.147532 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 10:02:16.147532 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:02:16.153905 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 57/109] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Jun 22 10:02:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:02:16.161541 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500c49cc-cab1-4d98-b079-1d75f1420766 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:16.232910 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:16.339839 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c106ebd7-c565-4cbb-bce6-8dc1d0a53a6c None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:16.354894 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500c49cc-cab1-4d98-b079-1d75f1420766 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:16.402653 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82218d18-fdeb-458b-b78b-3117d2662a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:16.403526 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82218d18-fdeb-458b-b78b-3117d2662a15 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:16.403811 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82218d18-fdeb-458b-b78b-3117d2662a15 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:16.404274 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82218d18-fdeb-458b-b78b-3117d2662a15 None admin] PATH_INFO: `/v3/projects/6008ad7344a543cdae5546c3d2f389b1` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:16.405425 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c042c7-ad1f-4fc2-a61c-b85382d06118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:16.405603 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82218d18-fdeb-458b-b78b-3117d2662a15 None admin] RBAC: Authorizing `identity:get_project(project_id=6008ad7344a543cdae5546c3d2f389b1)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:16.406421 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c042c7-ad1f-4fc2-a61c-b85382d06118 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:16.406873 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c042c7-ad1f-4fc2-a61c-b85382d06118 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:16.407099 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82218d18-fdeb-458b-b78b-3117d2662a15 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:16.407468 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c042c7-ad1f-4fc2-a61c-b85382d06118 None admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:16.408366 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c042c7-ad1f-4fc2-a61c-b85382d06118 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:02:16.408802 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 53/110] 10.222.0.43 () {56 vars in 1186 bytes} [Wed Jun 22 10:02:16 2022] GET /identity/v3/projects/6008ad7344a543cdae5546c3d2f389b1 => generated 298 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:02:16.408957 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c042c7-ad1f-4fc2-a61c-b85382d06118 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:16.410074 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc05ab8-e45a-4f29-8eef-8cfbc2ecae58 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:16.410366 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc05ab8-e45a-4f29-8eef-8cfbc2ecae58 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:16.410650 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc05ab8-e45a-4f29-8eef-8cfbc2ecae58 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:16.411812 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c042c7-ad1f-4fc2-a61c-b85382d06118 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:16.412416 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 54/111] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:02:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:02:16.413487 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2260c840-4c0b-437e-a709-dc11a87cebba None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:16.417806 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2260c840-4c0b-437e-a709-dc11a87cebba None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:16.418273 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2260c840-4c0b-437e-a709-dc11a87cebba None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:16.419756 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 55/112] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:02:16 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:02:16.420681 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2260c840-4c0b-437e-a709-dc11a87cebba None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:16.423407 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 58/113] 10.222.0.43 () {56 vars in 1101 bytes} [Wed Jun 22 10:02:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:02:16.424942 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddbf2cb-fe67-431e-a35e-656872a48074 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:16.425391 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddbf2cb-fe67-431e-a35e-656872a48074 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:16.425678 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddbf2cb-fe67-431e-a35e-656872a48074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:16.446147 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-eddbf2cb-fe67-431e-a35e-656872a48074 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:02:16.447592 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-eddbf2cb-fe67-431e-a35e-656872a48074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:02:16.448911 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:16.541019 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 59/114] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:02:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 10:02:16.547016 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc41f82-4daa-4cb4-8b41-f9c33555323f None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:16.548283 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc41f82-4daa-4cb4-8b41-f9c33555323f None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:16.549465 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc41f82-4daa-4cb4-8b41-f9c33555323f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:16.560682 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2260c840-4c0b-437e-a709-dc11a87cebba None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:16.583940 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-cfc41f82-4daa-4cb4-8b41-f9c33555323f None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:02:16.585632 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-cfc41f82-4daa-4cb4-8b41-f9c33555323f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:02:16.609465 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86bfc14-d48d-4c27-9e57-272a644d18a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:16.610731 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86bfc14-d48d-4c27-9e57-272a644d18a3 None admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:16.611223 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86bfc14-d48d-4c27-9e57-272a644d18a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:16.611691 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86bfc14-d48d-4c27-9e57-272a644d18a3 None admin] PATH_INFO: `/v3/projects/6008ad7344a543cdae5546c3d2f389b1/users/0f1078f8c5e549218cce1ee68f96ea91/roles/9f88c83743f745a9a785a2f454753f06` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:16.614562 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86bfc14-d48d-4c27-9e57-272a644d18a3 None admin] RBAC: Authorizing `identity:create_grant(project_id=6008ad7344a543cdae5546c3d2f389b1, user_id=0f1078f8c5e549218cce1ee68f96ea91, role_id=9f88c83743f745a9a785a2f454753f06)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:16.616345 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86bfc14-d48d-4c27-9e57-272a644d18a3 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:16.618193 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:16.636365 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 56/115] 10.222.0.43 () {58 vars in 1439 bytes} [Wed Jun 22 10:02:16 2022] PUT /identity/v3/projects/6008ad7344a543cdae5546c3d2f389b1/users/0f1078f8c5e549218cce1ee68f96ea91/roles/9f88c83743f745a9a785a2f454753f06 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:02:16.637575 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86bfc14-d48d-4c27-9e57-272a644d18a3 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:16.708895 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 60/116] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:02:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 10:02:16.710971 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc41f82-4daa-4cb4-8b41-f9c33555323f None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:16.824836 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:16.855791 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86bfc14-d48d-4c27-9e57-272a644d18a3 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:16.874038 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc41f82-4daa-4cb4-8b41-f9c33555323f None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:16.916940 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8ca7eb-b97b-4b48-89f8-0c629a9e5adf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:16.918748 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8ca7eb-b97b-4b48-89f8-0c629a9e5adf None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:16.919122 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8ca7eb-b97b-4b48-89f8-0c629a9e5adf None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:16.919416 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8ca7eb-b97b-4b48-89f8-0c629a9e5adf None admin] PATH_INFO: `/v3/users/746db3b3fef048fa861458dc0af700de` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:16.933817 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88b3ff9-9965-4374-a90a-2e147ca92a19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:16.935018 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88b3ff9-9965-4374-a90a-2e147ca92a19 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:16.935519 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88b3ff9-9965-4374-a90a-2e147ca92a19 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:16.936008 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88b3ff9-9965-4374-a90a-2e147ca92a19 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:16.951752 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8ca7eb-b97b-4b48-89f8-0c629a9e5adf None admin] RBAC: Authorizing `identity:get_user(user_id=746db3b3fef048fa861458dc0af700de)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:16.953571 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8ca7eb-b97b-4b48-89f8-0c629a9e5adf None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:16.960914 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 57/117] 10.222.0.43 () {56 vars in 1177 bytes} [Wed Jun 22 10:02:16 2022] GET /identity/v3/users/746db3b3fef048fa861458dc0af700de => generated 289 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:02:16.962073 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8ca7eb-b97b-4b48-89f8-0c629a9e5adf None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:16.968584 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88b3ff9-9965-4374-a90a-2e147ca92a19 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:02:16.984031 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-d88b3ff9-9965-4374-a90a-2e147ca92a19 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 10:02:16.984031 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:02:16.984031 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:02:16.984031 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:02:16.984031 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:02:16.984031 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:02:16.984031 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:02:16.984031 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:02:16.984031 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:02:16.984031 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:02:16.984031 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:02:16.984031 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:02:16.984031 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:02:16.984031 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:02:16.984031 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:02:16.984031 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:02:16.984922 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:02:16.984922 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:02:16.984922 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:02:16.984922 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:02:16.984922 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:02:16.984922 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:02:16.984922 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:02:16.984922 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:02:16.984922 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:02:16.984922 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:02:16.984922 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:02:16.984922 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( Jun 22 10:02:16.984922 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:02:16.984922 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:02:16.984922 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:02:16.984922 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:02:16.986456 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:02:16.986456 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:02:16.986456 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:02:16.986456 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:02:16.986456 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:02:16.986456 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:02:16.986456 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:02:16.986456 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:02:16.986456 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:02:16.986456 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:02:16.986456 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 10:02:16.986456 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:02:16.986456 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 61/118] 10.222.0.43 () {56 vars in 1096 bytes} [Wed Jun 22 10:02:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:02:16.990211 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88b3ff9-9965-4374-a90a-2e147ca92a19 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:17.029022 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:17.079088 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8ca7eb-b97b-4b48-89f8-0c629a9e5adf None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:17.115289 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88b3ff9-9965-4374-a90a-2e147ca92a19 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:17.122742 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b43483-d2b3-43aa-808a-4203ccd612f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:17.123941 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b43483-d2b3-43aa-808a-4203ccd612f8 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:17.124488 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b43483-d2b3-43aa-808a-4203ccd612f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:17.124990 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b43483-d2b3-43aa-808a-4203ccd612f8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:17.133631 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:17.139974 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b43483-d2b3-43aa-808a-4203ccd612f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:02:17.149620 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-56b43483-d2b3-43aa-808a-4203ccd612f8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 10:02:17.149620 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:02:17.149620 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:02:17.149620 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:02:17.149620 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:02:17.149620 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:02:17.149620 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:02:17.149620 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:02:17.149620 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:02:17.149620 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:02:17.149620 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:02:17.149620 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:02:17.149620 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:02:17.149620 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:02:17.149620 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:02:17.149620 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:02:17.150500 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:02:17.150500 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:02:17.150500 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:02:17.150500 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:02:17.150500 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:02:17.150500 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:02:17.150500 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:02:17.150500 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:02:17.150500 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:02:17.150500 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:02:17.150500 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:02:17.150500 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jun 22 10:02:17.150500 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:02:17.150500 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:02:17.150500 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:02:17.150500 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:02:17.151235 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:02:17.151235 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:02:17.151235 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:02:17.151235 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:02:17.151235 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:02:17.151235 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:02:17.151235 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:02:17.151235 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:02:17.151235 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:02:17.151235 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:02:17.151235 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 10:02:17.151235 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:02:17.154114 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 58/119] 10.222.0.43 () {56 vars in 1114 bytes} [Wed Jun 22 10:02:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:02:17.155482 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b43483-d2b3-43aa-808a-4203ccd612f8 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:17.155905 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d225a777-1843-43c4-9b35-892060839ec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:17.156542 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d225a777-1843-43c4-9b35-892060839ec4 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:17.156848 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d225a777-1843-43c4-9b35-892060839ec4 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:17.157119 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d225a777-1843-43c4-9b35-892060839ec4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:17.239465 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d225a777-1843-43c4-9b35-892060839ec4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:17.241097 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d225a777-1843-43c4-9b35-892060839ec4 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:17.266050 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:17.279600 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b43483-d2b3-43aa-808a-4203ccd612f8 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:17.319957 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064c4917-f34c-4f97-9726-7c8c700ec450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:17.320635 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064c4917-f34c-4f97-9726-7c8c700ec450 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:17.320923 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064c4917-f34c-4f97-9726-7c8c700ec450 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:17.321203 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064c4917-f34c-4f97-9726-7c8c700ec450 None admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:17.321995 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064c4917-f34c-4f97-9726-7c8c700ec450 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:02:17.322305 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064c4917-f34c-4f97-9726-7c8c700ec450 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:17.323693 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064c4917-f34c-4f97-9726-7c8c700ec450 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:17.332318 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 59/120] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Jun 22 10:02:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:02:17.338136 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f3a3f2-77ab-423c-8dac-8ef67cebd284 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:17.338363 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f3a3f2-77ab-423c-8dac-8ef67cebd284 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:17.338664 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f3a3f2-77ab-423c-8dac-8ef67cebd284 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:17.340017 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 60/121] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:02:17 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:02:17.340736 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f3a3f2-77ab-423c-8dac-8ef67cebd284 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:17.368768 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 62/122] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Jun 22 10:02:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 10:02:17.369629 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d225a777-1843-43c4-9b35-892060839ec4 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:17.411563 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:17.458340 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f3a3f2-77ab-423c-8dac-8ef67cebd284 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:17.499964 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9827dd-6bb2-4718-a997-a5a04ffd6e3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:17.500956 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9827dd-6bb2-4718-a997-a5a04ffd6e3b None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:17.501251 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9827dd-6bb2-4718-a997-a5a04ffd6e3b None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:17.501535 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9827dd-6bb2-4718-a997-a5a04ffd6e3b None admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:17.503010 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9827dd-6bb2-4718-a997-a5a04ffd6e3b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:02:17.503335 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9827dd-6bb2-4718-a997-a5a04ffd6e3b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:17.505121 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9827dd-6bb2-4718-a997-a5a04ffd6e3b None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:17.506014 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d225a777-1843-43c4-9b35-892060839ec4 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:17.517903 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 61/123] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Jun 22 10:02:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:02:17.519256 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb996c90-b59b-4d3d-ab2e-4b48acac9934 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:17.520700 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb996c90-b59b-4d3d-ab2e-4b48acac9934 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:17.521113 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb996c90-b59b-4d3d-ab2e-4b48acac9934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:17.533822 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:17.541928 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-bb996c90-b59b-4d3d-ab2e-4b48acac9934 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:02:17.543150 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-bb996c90-b59b-4d3d-ab2e-4b48acac9934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:02:17.553573 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6faef83-fa19-40a8-b2a6-f5bd4117a0c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:17.554506 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6faef83-fa19-40a8-b2a6-f5bd4117a0c1 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:17.554898 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6faef83-fa19-40a8-b2a6-f5bd4117a0c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:17.555195 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6faef83-fa19-40a8-b2a6-f5bd4117a0c1 None admin] PATH_INFO: `/v3/users/3557bebdc4d94a16b885094566c2bc9a` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:17.556556 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6faef83-fa19-40a8-b2a6-f5bd4117a0c1 None admin] RBAC: Authorizing `identity:get_user(user_id=3557bebdc4d94a16b885094566c2bc9a)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:17.558244 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6faef83-fa19-40a8-b2a6-f5bd4117a0c1 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:17.560301 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 63/124] 10.222.0.43 () {56 vars in 1177 bytes} [Wed Jun 22 10:02:17 2022] GET /identity/v3/users/3557bebdc4d94a16b885094566c2bc9a => generated 247 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:02:17.560920 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6faef83-fa19-40a8-b2a6-f5bd4117a0c1 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:17.612888 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 62/125] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:02:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 10:02:17.613534 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb996c90-b59b-4d3d-ab2e-4b48acac9934 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:17.667954 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:17.675263 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6faef83-fa19-40a8-b2a6-f5bd4117a0c1 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:17.714880 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa1b910-19b7-474f-9888-2b3b4079370a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:17.716118 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb996c90-b59b-4d3d-ab2e-4b48acac9934 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:17.716296 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa1b910-19b7-474f-9888-2b3b4079370a None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:17.716824 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa1b910-19b7-474f-9888-2b3b4079370a None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:17.717350 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa1b910-19b7-474f-9888-2b3b4079370a None admin] PATH_INFO: `/v3/projects/6008ad7344a543cdae5546c3d2f389b1` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:17.719881 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa1b910-19b7-474f-9888-2b3b4079370a None admin] RBAC: Authorizing `identity:get_project(project_id=6008ad7344a543cdae5546c3d2f389b1)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:17.722063 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa1b910-19b7-474f-9888-2b3b4079370a None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:17.724657 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 64/126] 10.222.0.43 () {56 vars in 1186 bytes} [Wed Jun 22 10:02:17 2022] GET /identity/v3/projects/6008ad7344a543cdae5546c3d2f389b1 => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:02:17.725445 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa1b910-19b7-474f-9888-2b3b4079370a None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:17.753859 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c939dc6-b7b4-4f48-895d-09a3a43136b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:17.755059 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c939dc6-b7b4-4f48-895d-09a3a43136b0 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:17.755345 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c939dc6-b7b4-4f48-895d-09a3a43136b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:17.755883 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c939dc6-b7b4-4f48-895d-09a3a43136b0 None admin] PATH_INFO: `/v3/users/0f1078f8c5e549218cce1ee68f96ea91` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:17.757903 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c939dc6-b7b4-4f48-895d-09a3a43136b0 None admin] RBAC: Authorizing `identity:get_user(user_id=0f1078f8c5e549218cce1ee68f96ea91)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:17.760038 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c939dc6-b7b4-4f48-895d-09a3a43136b0 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:17.761980 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 63/127] 10.222.0.43 () {56 vars in 1177 bytes} [Wed Jun 22 10:02:17 2022] GET /identity/v3/users/0f1078f8c5e549218cce1ee68f96ea91 => generated 275 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:02:17.762744 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c939dc6-b7b4-4f48-895d-09a3a43136b0 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:17.789974 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:17.855371 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa1b910-19b7-474f-9888-2b3b4079370a None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:17.884434 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c939dc6-b7b4-4f48-895d-09a3a43136b0 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:17.905132 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd600b6-7cc5-4b72-8f79-fb392dba88f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:17.906434 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:17.907201 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd600b6-7cc5-4b72-8f79-fb392dba88f8 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:17.907494 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd600b6-7cc5-4b72-8f79-fb392dba88f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:17.907926 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd600b6-7cc5-4b72-8f79-fb392dba88f8 None admin] PATH_INFO: `/v3/projects/6008ad7344a543cdae5546c3d2f389b1` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:17.909559 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd600b6-7cc5-4b72-8f79-fb392dba88f8 None admin] RBAC: Authorizing `identity:get_project(project_id=6008ad7344a543cdae5546c3d2f389b1)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:17.912929 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd600b6-7cc5-4b72-8f79-fb392dba88f8 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:17.915384 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 65/128] 10.222.0.43 () {56 vars in 1186 bytes} [Wed Jun 22 10:02:17 2022] GET /identity/v3/projects/6008ad7344a543cdae5546c3d2f389b1 => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:02:17.916463 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd600b6-7cc5-4b72-8f79-fb392dba88f8 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:17.923026 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4329e598-6a26-4999-a0e6-e8ab86ddeeac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:17.923781 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4329e598-6a26-4999-a0e6-e8ab86ddeeac None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:17.924071 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4329e598-6a26-4999-a0e6-e8ab86ddeeac None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:17.924359 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4329e598-6a26-4999-a0e6-e8ab86ddeeac None admin] PATH_INFO: `/v3/roles/member` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:17.935812 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4329e598-6a26-4999-a0e6-e8ab86ddeeac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:02:17.944417 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-4329e598-6a26-4999-a0e6-e8ab86ddeeac None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 10:02:17.944417 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:02:17.944417 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:02:17.944417 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:02:17.944417 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:02:17.944417 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:02:17.944417 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:02:17.944417 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:02:17.944417 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:02:17.944417 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:02:17.944417 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:02:17.944417 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:02:17.944417 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:02:17.944417 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:02:17.944417 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:02:17.944417 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:02:17.946543 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:02:17.946543 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:02:17.946543 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:02:17.946543 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:02:17.946543 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:02:17.946543 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:02:17.946543 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:02:17.946543 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:02:17.946543 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:02:17.946543 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:02:17.946543 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:02:17.946543 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jun 22 10:02:17.946543 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:02:17.946543 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:02:17.946543 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:02:17.946543 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:02:17.948622 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:02:17.948622 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:02:17.948622 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:02:17.948622 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:02:17.948622 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:02:17.948622 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:02:17.948622 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:02:17.948622 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:02:17.948622 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:02:17.948622 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:02:17.948622 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 10:02:17.948622 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:02:17.948622 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 64/129] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Jun 22 10:02:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:02:17.948622 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4329e598-6a26-4999-a0e6-e8ab86ddeeac None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:18.056977 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd600b6-7cc5-4b72-8f79-fb392dba88f8 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:18.071350 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4329e598-6a26-4999-a0e6-e8ab86ddeeac None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:18.094140 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:18.112677 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9490d59-173e-4b5c-813e-d096f334b5fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:18.113529 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9490d59-173e-4b5c-813e-d096f334b5fc None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:18.114606 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9490d59-173e-4b5c-813e-d096f334b5fc None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:18.115116 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9490d59-173e-4b5c-813e-d096f334b5fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:18.116116 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9490d59-173e-4b5c-813e-d096f334b5fc None admin] RBAC: Adding query filter params (role.id=4a03c0e749d84649a230831b1e6644a4, scope.project.id=6008ad7344a543cdae5546c3d2f389b1, user.id=746db3b3fef048fa861458dc0af700de) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:02:18.116659 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f88658-93f5-49ee-87ea-cacc17026552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:18.117032 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f88658-93f5-49ee-87ea-cacc17026552 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:18.117318 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f88658-93f5-49ee-87ea-cacc17026552 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:18.117608 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f88658-93f5-49ee-87ea-cacc17026552 None admin] PATH_INFO: `/v3/projects/6008ad7344a543cdae5546c3d2f389b1` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:18.117793 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9490d59-173e-4b5c-813e-d096f334b5fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:18.118875 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f88658-93f5-49ee-87ea-cacc17026552 None admin] RBAC: Authorizing `identity:get_project(project_id=6008ad7344a543cdae5546c3d2f389b1)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:18.119608 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9490d59-173e-4b5c-813e-d096f334b5fc None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:18.120334 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f88658-93f5-49ee-87ea-cacc17026552 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:18.122725 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 65/130] 10.222.0.43 () {56 vars in 1186 bytes} [Wed Jun 22 10:02:17 2022] GET /identity/v3/projects/6008ad7344a543cdae5546c3d2f389b1 => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:02:18.123318 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f88658-93f5-49ee-87ea-cacc17026552 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:18.126823 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 66/131] 10.222.0.43 () {56 vars in 1374 bytes} [Wed Jun 22 10:02:17 2022] GET /identity/v3/role_assignments?user.id=746db3b3fef048fa861458dc0af700de&scope.project.id=6008ad7344a543cdae5546c3d2f389b1&role.id=4a03c0e749d84649a230831b1e6644a4 => generated 259 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:02:18.128116 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9490d59-173e-4b5c-813e-d096f334b5fc None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:18.246764 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:18.326391 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9490d59-173e-4b5c-813e-d096f334b5fc None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:18.330375 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f88658-93f5-49ee-87ea-cacc17026552 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:18.375960 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5029e4a-7ecc-41b3-8167-530691478e39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:18.378030 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5029e4a-7ecc-41b3-8167-530691478e39 None admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:18.379854 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5029e4a-7ecc-41b3-8167-530691478e39 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:18.381602 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5029e4a-7ecc-41b3-8167-530691478e39 None admin] PATH_INFO: `/v3/projects/6008ad7344a543cdae5546c3d2f389b1/users/3557bebdc4d94a16b885094566c2bc9a/roles/26d9c2ab5dfc4e6d9ca80c6014123906` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:18.385847 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5029e4a-7ecc-41b3-8167-530691478e39 None admin] RBAC: Authorizing `identity:create_grant(project_id=6008ad7344a543cdae5546c3d2f389b1, user_id=3557bebdc4d94a16b885094566c2bc9a, role_id=26d9c2ab5dfc4e6d9ca80c6014123906)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:18.388237 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5029e4a-7ecc-41b3-8167-530691478e39 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:18.395925 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4443d815-9be0-4d1e-9f07-a0cf9ceabc34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:18.397031 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4443d815-9be0-4d1e-9f07-a0cf9ceabc34 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:18.397580 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4443d815-9be0-4d1e-9f07-a0cf9ceabc34 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:18.398162 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4443d815-9be0-4d1e-9f07-a0cf9ceabc34 None admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:18.399132 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4443d815-9be0-4d1e-9f07-a0cf9ceabc34 None admin] RBAC: Adding query filter params (name=member) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:02:18.399685 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4443d815-9be0-4d1e-9f07-a0cf9ceabc34 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:18.401302 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4443d815-9be0-4d1e-9f07-a0cf9ceabc34 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:18.409911 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 66/132] 10.222.0.43 () {58 vars in 1439 bytes} [Wed Jun 22 10:02:18 2022] PUT /identity/v3/projects/6008ad7344a543cdae5546c3d2f389b1/users/3557bebdc4d94a16b885094566c2bc9a/roles/26d9c2ab5dfc4e6d9ca80c6014123906 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:02:18.411488 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5029e4a-7ecc-41b3-8167-530691478e39 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:18.429365 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 67/133] 10.222.0.43 () {56 vars in 1101 bytes} [Wed Jun 22 10:02:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:02:18.434805 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4443d815-9be0-4d1e-9f07-a0cf9ceabc34 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:18.530178 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:18.586631 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4443d815-9be0-4d1e-9f07-a0cf9ceabc34 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:18.621645 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5029e4a-7ecc-41b3-8167-530691478e39 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:18.630268 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b6a1b9-2459-4660-bbe1-25a30f01f066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:18.630268 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b6a1b9-2459-4660-bbe1-25a30f01f066 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:18.630268 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b6a1b9-2459-4660-bbe1-25a30f01f066 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:18.630268 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b6a1b9-2459-4660-bbe1-25a30f01f066 None admin] PATH_INFO: `/v3/users/0f1078f8c5e549218cce1ee68f96ea91` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:18.631533 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b6a1b9-2459-4660-bbe1-25a30f01f066 None admin] RBAC: Authorizing `identity:get_user(user_id=0f1078f8c5e549218cce1ee68f96ea91)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:18.633515 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b6a1b9-2459-4660-bbe1-25a30f01f066 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:18.635371 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 68/134] 10.222.0.43 () {56 vars in 1177 bytes} [Wed Jun 22 10:02:18 2022] GET /identity/v3/users/0f1078f8c5e549218cce1ee68f96ea91 => generated 275 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:02:18.636547 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dea4a61-6692-4371-a5f1-2262b3318e3a None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:18.636945 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dea4a61-6692-4371-a5f1-2262b3318e3a None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:18.637337 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dea4a61-6692-4371-a5f1-2262b3318e3a None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:18.638772 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 69/135] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:02:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:02:18.645715 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:18.645893 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3913de6-d8fe-4aa3-abf9-c2050f5f971f None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:18.645893 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3913de6-d8fe-4aa3-abf9-c2050f5f971f None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:18.646023 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3913de6-d8fe-4aa3-abf9-c2050f5f971f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:18.665683 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-a3913de6-d8fe-4aa3-abf9-c2050f5f971f None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:02:18.667030 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-a3913de6-d8fe-4aa3-abf9-c2050f5f971f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:02:18.683593 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8fc17f-7adf-49a6-a274-84ab1f5fcf71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:18.685124 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8fc17f-7adf-49a6-a274-84ab1f5fcf71 None admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:18.685414 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8fc17f-7adf-49a6-a274-84ab1f5fcf71 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:18.685719 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8fc17f-7adf-49a6-a274-84ab1f5fcf71 None admin] PATH_INFO: `/v3/projects/6008ad7344a543cdae5546c3d2f389b1/users/0f1078f8c5e549218cce1ee68f96ea91/roles/23a6a1fcd69d4210a8f2b45559b65aea` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:18.688415 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8fc17f-7adf-49a6-a274-84ab1f5fcf71 None admin] RBAC: Authorizing `identity:create_grant(project_id=6008ad7344a543cdae5546c3d2f389b1, user_id=0f1078f8c5e549218cce1ee68f96ea91, role_id=23a6a1fcd69d4210a8f2b45559b65aea)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:18.690338 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8fc17f-7adf-49a6-a274-84ab1f5fcf71 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:18.707996 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 67/136] 10.222.0.43 () {58 vars in 1439 bytes} [Wed Jun 22 10:02:18 2022] PUT /identity/v3/projects/6008ad7344a543cdae5546c3d2f389b1/users/0f1078f8c5e549218cce1ee68f96ea91/roles/23a6a1fcd69d4210a8f2b45559b65aea => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:02:18.709854 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8fc17f-7adf-49a6-a274-84ab1f5fcf71 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:18.827261 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 70/137] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:02:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 10:02:18.859690 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3913de6-d8fe-4aa3-abf9-c2050f5f971f None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:18.888633 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8fc17f-7adf-49a6-a274-84ab1f5fcf71 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:18.927688 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af51a48-4236-4f24-bf6a-9975fe1f322c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:18.929022 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af51a48-4236-4f24-bf6a-9975fe1f322c None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:18.929506 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af51a48-4236-4f24-bf6a-9975fe1f322c None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:18.930015 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af51a48-4236-4f24-bf6a-9975fe1f322c None admin] PATH_INFO: `/v3/projects/81c599c329414b5996c1a83c3743148c` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:18.931747 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af51a48-4236-4f24-bf6a-9975fe1f322c None admin] RBAC: Authorizing `identity:get_project(project_id=81c599c329414b5996c1a83c3743148c)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:18.933482 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af51a48-4236-4f24-bf6a-9975fe1f322c None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:18.935518 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 68/138] 10.222.0.43 () {56 vars in 1186 bytes} [Wed Jun 22 10:02:18 2022] GET /identity/v3/projects/81c599c329414b5996c1a83c3743148c => generated 312 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:02:18.943496 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af51a48-4236-4f24-bf6a-9975fe1f322c None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:18.963927 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:19.018954 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:19.073376 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3913de6-d8fe-4aa3-abf9-c2050f5f971f None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:19.146441 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f9d8fa-1e6b-441a-9a48-867b46782295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:19.147309 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f9d8fa-1e6b-441a-9a48-867b46782295 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:19.147534 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f9d8fa-1e6b-441a-9a48-867b46782295 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:19.147816 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f9d8fa-1e6b-441a-9a48-867b46782295 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:19.150928 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f9d8fa-1e6b-441a-9a48-867b46782295 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:19.152401 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f9d8fa-1e6b-441a-9a48-867b46782295 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:19.156011 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af51a48-4236-4f24-bf6a-9975fe1f322c None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:19.163524 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 71/139] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jun 22 10:02:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:02:19.176153 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f436d1-2d71-41dc-9440-88db4f83c4b2 None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:19.177004 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f436d1-2d71-41dc-9440-88db4f83c4b2 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:19.177467 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f436d1-2d71-41dc-9440-88db4f83c4b2 None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:19.180025 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 72/140] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:02:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 10:02:19.180957 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f436d1-2d71-41dc-9440-88db4f83c4b2 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:19.219921 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71363fb2-61f0-4bdb-a27a-62a43fbd4d9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:19.220823 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71363fb2-61f0-4bdb-a27a-62a43fbd4d9c None admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:19.221112 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71363fb2-61f0-4bdb-a27a-62a43fbd4d9c None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:19.221397 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71363fb2-61f0-4bdb-a27a-62a43fbd4d9c None admin] PATH_INFO: `/v3/projects/81c599c329414b5996c1a83c3743148c/users/0f1078f8c5e549218cce1ee68f96ea91/roles/9f88c83743f745a9a785a2f454753f06` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:19.224996 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71363fb2-61f0-4bdb-a27a-62a43fbd4d9c None admin] RBAC: Authorizing `identity:create_grant(project_id=81c599c329414b5996c1a83c3743148c, user_id=0f1078f8c5e549218cce1ee68f96ea91, role_id=9f88c83743f745a9a785a2f454753f06)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:19.227946 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71363fb2-61f0-4bdb-a27a-62a43fbd4d9c None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:19.253197 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 69/141] 10.222.0.43 () {58 vars in 1439 bytes} [Wed Jun 22 10:02:18 2022] PUT /identity/v3/projects/81c599c329414b5996c1a83c3743148c/users/0f1078f8c5e549218cce1ee68f96ea91/roles/9f88c83743f745a9a785a2f454753f06 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:02:19.254742 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b15b1ef-7a54-4be7-892b-b2ca483d8819 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:19.256729 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b15b1ef-7a54-4be7-892b-b2ca483d8819 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:19.257070 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b15b1ef-7a54-4be7-892b-b2ca483d8819 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:19.290798 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-2b15b1ef-7a54-4be7-892b-b2ca483d8819 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:02:19.293433 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-2b15b1ef-7a54-4be7-892b-b2ca483d8819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:02:19.388931 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f436d1-2d71-41dc-9440-88db4f83c4b2 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:19.421600 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:19.433327 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 70/142] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:02:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 10:02:19.449946 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca08874-f54b-4e80-a3d8-0c4da3322502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:19.450640 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca08874-f54b-4e80-a3d8-0c4da3322502 None admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:19.450938 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca08874-f54b-4e80-a3d8-0c4da3322502 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:19.451227 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca08874-f54b-4e80-a3d8-0c4da3322502 None admin] PATH_INFO: `/v3/users` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:19.452020 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca08874-f54b-4e80-a3d8-0c4da3322502 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:19.453536 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca08874-f54b-4e80-a3d8-0c4da3322502 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:19.478304 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 73/143] 10.222.0.43 () {60 vars in 1132 bytes} [Wed Jun 22 10:02:19 2022] POST /identity/v3/users => generated 283 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:02:19.488885 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b15b1ef-7a54-4be7-892b-b2ca483d8819 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:19.534370 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:19.635216 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b15b1ef-7a54-4be7-892b-b2ca483d8819 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:19.682678 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d10bebe-3808-47f0-b0dc-4d89628f5dff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:19.683518 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d10bebe-3808-47f0-b0dc-4d89628f5dff None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:19.683810 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d10bebe-3808-47f0-b0dc-4d89628f5dff None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:19.684096 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d10bebe-3808-47f0-b0dc-4d89628f5dff None admin] PATH_INFO: `/v3/roles/member` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:19.702323 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d10bebe-3808-47f0-b0dc-4d89628f5dff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:02:19.710683 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-5d10bebe-3808-47f0-b0dc-4d89628f5dff None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 10:02:19.710683 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:02:19.710683 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:02:19.710683 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:02:19.710683 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:02:19.710683 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:02:19.710683 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:02:19.710683 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:02:19.710683 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:02:19.710683 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:02:19.710683 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:02:19.710683 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:02:19.710683 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:02:19.710683 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:02:19.710683 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:02:19.710683 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:02:19.711571 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:02:19.711571 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:02:19.711571 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:02:19.711571 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:02:19.711571 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:02:19.711571 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:02:19.711571 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:02:19.711571 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:02:19.711571 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:02:19.711571 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:02:19.711571 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:02:19.711571 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jun 22 10:02:19.711571 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:02:19.711571 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:02:19.711571 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:02:19.711571 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:02:19.712362 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:02:19.712362 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:02:19.712362 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:02:19.712362 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:02:19.712362 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:02:19.712362 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:02:19.712362 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:02:19.712362 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:02:19.712362 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:02:19.712362 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:02:19.712362 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 10:02:19.712362 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:02:19.712362 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 71/144] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Jun 22 10:02:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:02:19.719221 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca08874-f54b-4e80-a3d8-0c4da3322502 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:19.838801 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca08874-f54b-4e80-a3d8-0c4da3322502 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:19.875234 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd8d0cc-ad5b-4b50-a569-07f3d8fa6ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:19.875917 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd8d0cc-ad5b-4b50-a569-07f3d8fa6ae3 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:19.876207 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd8d0cc-ad5b-4b50-a569-07f3d8fa6ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:19.876486 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd8d0cc-ad5b-4b50-a569-07f3d8fa6ae3 None admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:19.877246 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd8d0cc-ad5b-4b50-a569-07f3d8fa6ae3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:02:19.877556 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd8d0cc-ad5b-4b50-a569-07f3d8fa6ae3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:19.879055 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd8d0cc-ad5b-4b50-a569-07f3d8fa6ae3 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:19.888254 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 74/145] 10.222.0.43 () {56 vars in 1101 bytes} [Wed Jun 22 10:02:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:02:19.894157 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d10bebe-3808-47f0-b0dc-4d89628f5dff None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:20.023534 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:20.041245 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d10bebe-3808-47f0-b0dc-4d89628f5dff None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:20.086634 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308e6421-1147-476f-9e61-df4e1d7579e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:20.087610 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308e6421-1147-476f-9e61-df4e1d7579e6 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:20.087915 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308e6421-1147-476f-9e61-df4e1d7579e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:20.088435 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308e6421-1147-476f-9e61-df4e1d7579e6 None admin] PATH_INFO: `/v3/users/0f1078f8c5e549218cce1ee68f96ea91` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:20.089955 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308e6421-1147-476f-9e61-df4e1d7579e6 None admin] RBAC: Authorizing `identity:get_user(user_id=0f1078f8c5e549218cce1ee68f96ea91)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:20.092362 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308e6421-1147-476f-9e61-df4e1d7579e6 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:20.094119 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 72/146] 10.222.0.43 () {56 vars in 1177 bytes} [Wed Jun 22 10:02:19 2022] GET /identity/v3/users/0f1078f8c5e549218cce1ee68f96ea91 => generated 275 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:02:20.103240 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd8d0cc-ad5b-4b50-a569-07f3d8fa6ae3 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:20.148342 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:20.216208 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd8d0cc-ad5b-4b50-a569-07f3d8fa6ae3 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:20.251818 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b316ef-b843-4e7b-b68f-33581d8671bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:20.252481 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b316ef-b843-4e7b-b68f-33581d8671bd None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:20.252774 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b316ef-b843-4e7b-b68f-33581d8671bd None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:20.253055 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b316ef-b843-4e7b-b68f-33581d8671bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:20.340924 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b316ef-b843-4e7b-b68f-33581d8671bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:20.342508 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b316ef-b843-4e7b-b68f-33581d8671bd None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:20.377285 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:20.462954 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 75/147] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Jun 22 10:02:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 10:02:20.468858 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308e6421-1147-476f-9e61-df4e1d7579e6 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:20.623363 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308e6421-1147-476f-9e61-df4e1d7579e6 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:20.682247 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06674dbc-b586-4aa2-af39-0f8d3ded3b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:20.683417 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06674dbc-b586-4aa2-af39-0f8d3ded3b55 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:20.683932 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06674dbc-b586-4aa2-af39-0f8d3ded3b55 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:20.684434 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06674dbc-b586-4aa2-af39-0f8d3ded3b55 None admin] PATH_INFO: `/v3/projects/6008ad7344a543cdae5546c3d2f389b1` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:20.688809 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06674dbc-b586-4aa2-af39-0f8d3ded3b55 None admin] RBAC: Authorizing `identity:get_project(project_id=6008ad7344a543cdae5546c3d2f389b1)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:20.690352 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06674dbc-b586-4aa2-af39-0f8d3ded3b55 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:20.692845 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 73/148] 10.222.0.43 () {56 vars in 1186 bytes} [Wed Jun 22 10:02:20 2022] GET /identity/v3/projects/6008ad7344a543cdae5546c3d2f389b1 => generated 298 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:02:20.698840 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b316ef-b843-4e7b-b68f-33581d8671bd None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:20.841482 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b316ef-b843-4e7b-b68f-33581d8671bd None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:20.900542 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43d604a-41d6-4770-aff5-f882931c6de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:20.901210 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43d604a-41d6-4770-aff5-f882931c6de0 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:20.901505 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43d604a-41d6-4770-aff5-f882931c6de0 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:20.901813 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43d604a-41d6-4770-aff5-f882931c6de0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:20.902671 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43d604a-41d6-4770-aff5-f882931c6de0 None admin] RBAC: Adding query filter params (role.id=9f88c83743f745a9a785a2f454753f06, scope.project.id=6008ad7344a543cdae5546c3d2f389b1, user.id=0f1078f8c5e549218cce1ee68f96ea91) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:02:20.902992 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43d604a-41d6-4770-aff5-f882931c6de0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:20.904463 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43d604a-41d6-4770-aff5-f882931c6de0 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:20.907858 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:20.912073 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 76/149] 10.222.0.43 () {56 vars in 1374 bytes} [Wed Jun 22 10:02:20 2022] GET /identity/v3/role_assignments?user.id=0f1078f8c5e549218cce1ee68f96ea91&scope.project.id=6008ad7344a543cdae5546c3d2f389b1&role.id=9f88c83743f745a9a785a2f454753f06 => generated 608 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:02:21.447229 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a344859-ff92-4675-aadd-dc82ff0a66c3 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:21.447758 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a344859-ff92-4675-aadd-dc82ff0a66c3 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:21.448187 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a344859-ff92-4675-aadd-dc82ff0a66c3 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:21.449990 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 74/150] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:02:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:02:21.456432 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b0b973-d239-43dd-8f2a-0afe19d8b501 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:21.457346 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b0b973-d239-43dd-8f2a-0afe19d8b501 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:21.458468 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b0b973-d239-43dd-8f2a-0afe19d8b501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:21.479947 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-24b0b973-d239-43dd-8f2a-0afe19d8b501 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:02:21.481476 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-24b0b973-d239-43dd-8f2a-0afe19d8b501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:02:21.562672 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 77/151] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:02:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 10:02:21.587079 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a344859-ff92-4675-aadd-dc82ff0a66c3 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:21.628304 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:21.727092 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9177f8-fbc3-43ad-9b11-99e32410c12b None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:21.727695 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9177f8-fbc3-43ad-9b11-99e32410c12b None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:21.728178 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9177f8-fbc3-43ad-9b11-99e32410c12b None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:21.729818 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 78/152] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:02:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:02:21.743737 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8844680-404f-452b-bcf8-034931885402 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:21.744343 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8844680-404f-452b-bcf8-034931885402 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:21.744822 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8844680-404f-452b-bcf8-034931885402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:21.765434 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a344859-ff92-4675-aadd-dc82ff0a66c3 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:21.776692 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-c8844680-404f-452b-bcf8-034931885402 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:02:21.782294 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-c8844680-404f-452b-bcf8-034931885402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:02:21.841424 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5baa78-4ca8-4bf5-ad32-5d1b48bef04b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:21.842605 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5baa78-4ca8-4bf5-ad32-5d1b48bef04b None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:21.843115 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5baa78-4ca8-4bf5-ad32-5d1b48bef04b None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:21.843613 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5baa78-4ca8-4bf5-ad32-5d1b48bef04b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:21.872840 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5baa78-4ca8-4bf5-ad32-5d1b48bef04b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:02:21.881587 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-fe5baa78-4ca8-4bf5-ad32-5d1b48bef04b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 10:02:21.881587 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:02:21.881587 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:02:21.881587 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:02:21.881587 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:02:21.881587 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:02:21.881587 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:02:21.881587 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:02:21.881587 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:02:21.881587 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:02:21.881587 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:02:21.881587 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:02:21.881587 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:02:21.881587 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:02:21.881587 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:02:21.881587 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:02:21.882610 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:02:21.882610 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:02:21.882610 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:02:21.882610 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:02:21.882610 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:02:21.882610 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:02:21.882610 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:02:21.882610 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:02:21.882610 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:02:21.882610 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:02:21.882610 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:02:21.882610 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jun 22 10:02:21.882610 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:02:21.882610 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:02:21.882610 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:02:21.882610 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:02:21.883397 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:02:21.883397 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:02:21.883397 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:02:21.883397 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:02:21.883397 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:02:21.883397 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:02:21.883397 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:02:21.883397 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:02:21.883397 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:02:21.883397 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:02:21.883397 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 10:02:21.883397 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:02:21.883397 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 75/153] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Jun 22 10:02:21 2022] GET /identity/v3/roles/reader => generated 84 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:02:21.888945 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5baa78-4ca8-4bf5-ad32-5d1b48bef04b None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:21.892478 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 79/154] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:02:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 10:02:21.936131 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8844680-404f-452b-bcf8-034931885402 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:22.030455 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:22.091005 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:22.094303 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8844680-404f-452b-bcf8-034931885402 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:22.152146 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5baa78-4ca8-4bf5-ad32-5d1b48bef04b None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:22.158931 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8afb942-cb3e-430a-995e-6270b797aeef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:22.159759 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8afb942-cb3e-430a-995e-6270b797aeef None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:22.160047 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8afb942-cb3e-430a-995e-6270b797aeef None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:22.160326 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8afb942-cb3e-430a-995e-6270b797aeef None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:22.182629 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8afb942-cb3e-430a-995e-6270b797aeef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:02:22.191222 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-b8afb942-cb3e-430a-995e-6270b797aeef None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 10:02:22.191222 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:02:22.191222 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:02:22.191222 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:02:22.191222 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:02:22.191222 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:02:22.191222 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:02:22.191222 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:02:22.191222 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:02:22.191222 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:02:22.191222 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:02:22.191222 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:02:22.191222 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:02:22.191222 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:02:22.191222 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:02:22.191222 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:02:22.192737 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:02:22.192737 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:02:22.192737 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:02:22.192737 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:02:22.192737 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:02:22.192737 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:02:22.192737 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:02:22.192737 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:02:22.192737 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:02:22.192737 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:02:22.192737 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:02:22.192737 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( Jun 22 10:02:22.192737 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:02:22.192737 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:02:22.192737 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:02:22.192737 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:02:22.193892 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:02:22.193892 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:02:22.193892 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:02:22.193892 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:02:22.193892 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:02:22.193892 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:02:22.193892 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:02:22.193892 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:02:22.193892 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:02:22.193892 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:02:22.193892 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 10:02:22.193892 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:02:22.196432 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 80/155] 10.222.0.43 () {56 vars in 1114 bytes} [Wed Jun 22 10:02:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 10:02:22.202232 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8afb942-cb3e-430a-995e-6270b797aeef None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:22.230415 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d882ba2d-4812-4a67-9354-1a875f39cf83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:22.231371 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d882ba2d-4812-4a67-9354-1a875f39cf83 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:22.231829 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d882ba2d-4812-4a67-9354-1a875f39cf83 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:22.232304 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d882ba2d-4812-4a67-9354-1a875f39cf83 None admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:22.233224 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d882ba2d-4812-4a67-9354-1a875f39cf83 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:02:22.233712 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d882ba2d-4812-4a67-9354-1a875f39cf83 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:22.235264 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d882ba2d-4812-4a67-9354-1a875f39cf83 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:22.251954 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 76/156] 10.222.0.43 () {56 vars in 1101 bytes} [Wed Jun 22 10:02:21 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:02:22.262067 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d882ba2d-4812-4a67-9354-1a875f39cf83 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:22.406232 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8afb942-cb3e-430a-995e-6270b797aeef None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:22.424193 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d882ba2d-4812-4a67-9354-1a875f39cf83 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:22.445223 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:22.484813 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b08851e-2fe9-4394-b761-730a4f32c601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:22.485816 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b08851e-2fe9-4394-b761-730a4f32c601 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:22.486264 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b08851e-2fe9-4394-b761-730a4f32c601 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:22.486708 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b08851e-2fe9-4394-b761-730a4f32c601 None admin] PATH_INFO: `/v3/users/746db3b3fef048fa861458dc0af700de` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:22.487970 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b08851e-2fe9-4394-b761-730a4f32c601 None admin] RBAC: Authorizing `identity:get_user(user_id=746db3b3fef048fa861458dc0af700de)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:22.489596 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b08851e-2fe9-4394-b761-730a4f32c601 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:22.494942 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 77/157] 10.222.0.43 () {56 vars in 1177 bytes} [Wed Jun 22 10:02:22 2022] GET /identity/v3/users/746db3b3fef048fa861458dc0af700de => generated 289 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:02:22.496180 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86596fc0-a02e-4276-9127-1b249a0af4be None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:22.496474 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86596fc0-a02e-4276-9127-1b249a0af4be None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:22.496760 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86596fc0-a02e-4276-9127-1b249a0af4be None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:22.498739 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee7b996-ef53-47b8-b839-1204ce2f8cc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:22.499421 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee7b996-ef53-47b8-b839-1204ce2f8cc5 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:22.499706 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee7b996-ef53-47b8-b839-1204ce2f8cc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:22.499985 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee7b996-ef53-47b8-b839-1204ce2f8cc5 None admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:22.500758 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee7b996-ef53-47b8-b839-1204ce2f8cc5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:02:22.501072 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee7b996-ef53-47b8-b839-1204ce2f8cc5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:22.502519 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee7b996-ef53-47b8-b839-1204ce2f8cc5 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:22.503290 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 78/158] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:02:22 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:02:22.504424 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d170d5-be35-406d-80bf-a4346b6cbb49 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:22.505545 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d170d5-be35-406d-80bf-a4346b6cbb49 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:22.505545 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d170d5-be35-406d-80bf-a4346b6cbb49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:22.525319 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 81/159] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Jun 22 10:02:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:02:22.526214 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee7b996-ef53-47b8-b839-1204ce2f8cc5 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:22.550729 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-26d170d5-be35-406d-80bf-a4346b6cbb49 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:02:22.552310 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-26d170d5-be35-406d-80bf-a4346b6cbb49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:02:22.564707 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:22.740744 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 79/160] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:02:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 10:02:22.741651 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d170d5-be35-406d-80bf-a4346b6cbb49 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:22.760600 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee7b996-ef53-47b8-b839-1204ce2f8cc5 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:22.845342 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d32e18f-8291-4636-a6f2-f1183391c947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:22.846291 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d32e18f-8291-4636-a6f2-f1183391c947 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:22.846583 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d32e18f-8291-4636-a6f2-f1183391c947 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:22.846916 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d32e18f-8291-4636-a6f2-f1183391c947 None admin] PATH_INFO: `/v3/projects/6008ad7344a543cdae5546c3d2f389b1` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:22.850420 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d32e18f-8291-4636-a6f2-f1183391c947 None admin] RBAC: Authorizing `identity:get_project(project_id=6008ad7344a543cdae5546c3d2f389b1)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:22.852007 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d32e18f-8291-4636-a6f2-f1183391c947 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:22.854086 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 82/161] 10.222.0.43 () {56 vars in 1186 bytes} [Wed Jun 22 10:02:22 2022] GET /identity/v3/projects/6008ad7344a543cdae5546c3d2f389b1 => generated 298 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:02:22.854866 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d32e18f-8291-4636-a6f2-f1183391c947 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:22.939921 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:22.976320 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d170d5-be35-406d-80bf-a4346b6cbb49 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:23.052509 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d32e18f-8291-4636-a6f2-f1183391c947 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:23.059444 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eea63ef-88a5-472b-a71a-804ba8338569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:23.060454 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eea63ef-88a5-472b-a71a-804ba8338569 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:23.060860 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eea63ef-88a5-472b-a71a-804ba8338569 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:23.061244 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eea63ef-88a5-472b-a71a-804ba8338569 None admin] PATH_INFO: `/v3/users/0f1078f8c5e549218cce1ee68f96ea91` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:23.069716 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eea63ef-88a5-472b-a71a-804ba8338569 None admin] RBAC: Authorizing `identity:get_user(user_id=0f1078f8c5e549218cce1ee68f96ea91)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:23.069716 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eea63ef-88a5-472b-a71a-804ba8338569 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:23.069716 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 80/162] 10.222.0.43 () {56 vars in 1177 bytes} [Wed Jun 22 10:02:22 2022] GET /identity/v3/users/0f1078f8c5e549218cce1ee68f96ea91 => generated 275 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:02:23.070789 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eea63ef-88a5-472b-a71a-804ba8338569 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:23.102052 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:23.134428 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37a470c-b8d3-47a7-ba49-04b3454be9c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:23.135363 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37a470c-b8d3-47a7-ba49-04b3454be9c2 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:23.135662 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37a470c-b8d3-47a7-ba49-04b3454be9c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:23.136053 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37a470c-b8d3-47a7-ba49-04b3454be9c2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:23.159061 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37a470c-b8d3-47a7-ba49-04b3454be9c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:02:23.167902 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-b37a470c-b8d3-47a7-ba49-04b3454be9c2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 10:02:23.167902 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:02:23.167902 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:02:23.167902 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:02:23.167902 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:02:23.167902 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:02:23.167902 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:02:23.167902 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:02:23.167902 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:02:23.167902 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:02:23.167902 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:02:23.167902 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:02:23.167902 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:02:23.167902 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:02:23.167902 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:02:23.167902 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:02:23.168785 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:02:23.168785 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:02:23.168785 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:02:23.168785 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:02:23.168785 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:02:23.168785 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:02:23.168785 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:02:23.168785 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:02:23.168785 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:02:23.168785 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:02:23.168785 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:02:23.168785 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( Jun 22 10:02:23.168785 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:02:23.168785 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:02:23.168785 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:02:23.168785 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:02:23.169564 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:02:23.169564 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:02:23.169564 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:02:23.169564 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:02:23.169564 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:02:23.169564 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:02:23.169564 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:02:23.169564 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:02:23.169564 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:02:23.169564 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:02:23.169564 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 10:02:23.169564 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:02:23.175518 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 83/163] 10.222.0.43 () {56 vars in 1096 bytes} [Wed Jun 22 10:02:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:02:23.176583 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37a470c-b8d3-47a7-ba49-04b3454be9c2 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:23.275752 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eea63ef-88a5-472b-a71a-804ba8338569 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:23.320891 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070b86ed-cef9-45c0-ad39-3e10c1023288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:23.322450 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070b86ed-cef9-45c0-ad39-3e10c1023288 None admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:23.322936 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070b86ed-cef9-45c0-ad39-3e10c1023288 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:23.323918 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070b86ed-cef9-45c0-ad39-3e10c1023288 None admin] PATH_INFO: `/v3/projects/6008ad7344a543cdae5546c3d2f389b1/users/746db3b3fef048fa861458dc0af700de/roles/4a03c0e749d84649a230831b1e6644a4` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:23.326262 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070b86ed-cef9-45c0-ad39-3e10c1023288 None admin] RBAC: Authorizing `identity:create_grant(project_id=6008ad7344a543cdae5546c3d2f389b1, user_id=746db3b3fef048fa861458dc0af700de, role_id=4a03c0e749d84649a230831b1e6644a4)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:23.327995 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070b86ed-cef9-45c0-ad39-3e10c1023288 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:23.353409 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 81/164] 10.222.0.43 () {58 vars in 1439 bytes} [Wed Jun 22 10:02:23 2022] PUT /identity/v3/projects/6008ad7344a543cdae5546c3d2f389b1/users/746db3b3fef048fa861458dc0af700de/roles/4a03c0e749d84649a230831b1e6644a4 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:02:23.354663 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070b86ed-cef9-45c0-ad39-3e10c1023288 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:23.371901 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37a470c-b8d3-47a7-ba49-04b3454be9c2 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:23.384021 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:23.426450 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7152ca64-753c-4bb5-91da-736f1dee28f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:23.427710 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7152ca64-753c-4bb5-91da-736f1dee28f4 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:23.428261 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7152ca64-753c-4bb5-91da-736f1dee28f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:23.428683 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7152ca64-753c-4bb5-91da-736f1dee28f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:23.446103 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:23.480256 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070b86ed-cef9-45c0-ad39-3e10c1023288 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:23.555218 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7152ca64-753c-4bb5-91da-736f1dee28f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:23.556709 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7152ca64-753c-4bb5-91da-736f1dee28f4 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:23.562936 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a159f8-86be-401e-8c8e-66816964163f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:23.563716 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a159f8-86be-401e-8c8e-66816964163f None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:23.564006 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a159f8-86be-401e-8c8e-66816964163f None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:23.564287 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a159f8-86be-401e-8c8e-66816964163f None admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:23.565083 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a159f8-86be-401e-8c8e-66816964163f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:02:23.565395 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a159f8-86be-401e-8c8e-66816964163f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:23.566873 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a159f8-86be-401e-8c8e-66816964163f None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:23.586340 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 82/165] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Jun 22 10:02:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:02:23.587624 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8055d83-2e52-4206-831c-3de72bf0e612 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:23.587913 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8055d83-2e52-4206-831c-3de72bf0e612 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:23.588189 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8055d83-2e52-4206-831c-3de72bf0e612 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:23.589717 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 83/166] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:02:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:02:23.594660 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8055d83-2e52-4206-831c-3de72bf0e612 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:23.740149 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 84/167] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Jun 22 10:02:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 564 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 10:02:23.748877 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e832177-ba18-4d99-941b-31930bc18fb2 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:23.748877 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e832177-ba18-4d99-941b-31930bc18fb2 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:23.748877 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e832177-ba18-4d99-941b-31930bc18fb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:23.779004 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-4e832177-ba18-4d99-941b-31930bc18fb2 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:02:23.780309 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-4e832177-ba18-4d99-941b-31930bc18fb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:02:23.782680 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:23.800074 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8055d83-2e52-4206-831c-3de72bf0e612 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:23.840353 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:23.846285 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8d3102-f990-40ff-9904-3b65a698a201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:23.847342 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8d3102-f990-40ff-9904-3b65a698a201 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:23.847775 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8d3102-f990-40ff-9904-3b65a698a201 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:23.848053 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8d3102-f990-40ff-9904-3b65a698a201 None admin] PATH_INFO: `/v3/users/3557bebdc4d94a16b885094566c2bc9a` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:23.850339 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8d3102-f990-40ff-9904-3b65a698a201 None admin] RBAC: Authorizing `identity:get_user(user_id=3557bebdc4d94a16b885094566c2bc9a)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:23.851966 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8d3102-f990-40ff-9904-3b65a698a201 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:23.854460 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 84/168] 10.222.0.43 () {56 vars in 1177 bytes} [Wed Jun 22 10:02:23 2022] GET /identity/v3/users/3557bebdc4d94a16b885094566c2bc9a => generated 247 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:02:23.855501 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8d3102-f990-40ff-9904-3b65a698a201 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:23.868820 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 85/169] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:02:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 10:02:23.870197 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a5a8d1-0e70-4978-bd29-e62f9884cb8b None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:23.870491 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a5a8d1-0e70-4978-bd29-e62f9884cb8b None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:23.870767 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a5a8d1-0e70-4978-bd29-e62f9884cb8b None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:23.872052 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 86/170] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:02:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:02:23.873116 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fdb68c-60f6-4588-9c01-aeef41ac910b None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:23.873752 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fdb68c-60f6-4588-9c01-aeef41ac910b None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:23.873752 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fdb68c-60f6-4588-9c01-aeef41ac910b None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:23.879179 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 87/171] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:02:23 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:02:23.880331 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fdb68c-60f6-4588-9c01-aeef41ac910b None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:23.990138 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8d3102-f990-40ff-9904-3b65a698a201 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:24.024235 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fdb68c-60f6-4588-9c01-aeef41ac910b None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:24.031909 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f1bca2-9c89-4528-8899-0a7f77335935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:24.033080 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f1bca2-9c89-4528-8899-0a7f77335935 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:24.033558 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f1bca2-9c89-4528-8899-0a7f77335935 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:24.034053 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f1bca2-9c89-4528-8899-0a7f77335935 None admin] PATH_INFO: `/v3/projects/6008ad7344a543cdae5546c3d2f389b1` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:24.035557 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f1bca2-9c89-4528-8899-0a7f77335935 None admin] RBAC: Authorizing `identity:get_project(project_id=6008ad7344a543cdae5546c3d2f389b1)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:24.037483 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f1bca2-9c89-4528-8899-0a7f77335935 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:24.039579 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 85/172] 10.222.0.43 () {56 vars in 1186 bytes} [Wed Jun 22 10:02:23 2022] GET /identity/v3/projects/6008ad7344a543cdae5546c3d2f389b1 => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:02:24.041154 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4352de-5e4b-44ef-8e2b-03ac624c0d1b None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:24.041705 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4352de-5e4b-44ef-8e2b-03ac624c0d1b None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:24.042201 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4352de-5e4b-44ef-8e2b-03ac624c0d1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:24.060970 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-ce4352de-5e4b-44ef-8e2b-03ac624c0d1b None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:02:24.062705 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-ce4352de-5e4b-44ef-8e2b-03ac624c0d1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:02:24.070156 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67352de9-1ec1-4b25-a09c-ee213df50349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:24.071034 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67352de9-1ec1-4b25-a09c-ee213df50349 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:24.071485 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67352de9-1ec1-4b25-a09c-ee213df50349 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:24.071912 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67352de9-1ec1-4b25-a09c-ee213df50349 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:24.088287 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:24.154231 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:24.162375 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 86/173] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:02:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 10:02:24.163964 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293623e0-f65c-4488-88fe-760b93b381fe None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:24.164460 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293623e0-f65c-4488-88fe-760b93b381fe None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:24.164980 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293623e0-f65c-4488-88fe-760b93b381fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:24.184038 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67352de9-1ec1-4b25-a09c-ee213df50349 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:24.185237 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-293623e0-f65c-4488-88fe-760b93b381fe None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:02:24.185578 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67352de9-1ec1-4b25-a09c-ee213df50349 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:24.186880 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-293623e0-f65c-4488-88fe-760b93b381fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:02:24.278674 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 87/174] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:02:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 10:02:24.279594 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293623e0-f65c-4488-88fe-760b93b381fe None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:24.335756 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 88/175] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Jun 22 10:02:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 10:02:24.336620 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67352de9-1ec1-4b25-a09c-ee213df50349 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:24.378006 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:24.397581 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293623e0-f65c-4488-88fe-760b93b381fe None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:24.433266 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:24.442699 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c4fc91-a3ca-4a3f-8a41-f4e2f96cb7f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:24.443835 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c4fc91-a3ca-4a3f-8a41-f4e2f96cb7f6 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:24.444315 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c4fc91-a3ca-4a3f-8a41-f4e2f96cb7f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:24.444423 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c4fc91-a3ca-4a3f-8a41-f4e2f96cb7f6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:24.453179 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67352de9-1ec1-4b25-a09c-ee213df50349 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:24.456308 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c4fc91-a3ca-4a3f-8a41-f4e2f96cb7f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:02:24.465614 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-34c4fc91-a3ca-4a3f-8a41-f4e2f96cb7f6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 10:02:24.465614 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:02:24.465614 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:02:24.465614 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:02:24.465614 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:02:24.465614 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:02:24.465614 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:02:24.465614 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:02:24.465614 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:02:24.465614 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:02:24.465614 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:02:24.465614 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:02:24.465614 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:02:24.465614 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:02:24.465614 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:02:24.465614 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:02:24.466539 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:02:24.466539 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:02:24.466539 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:02:24.466539 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:02:24.466539 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:02:24.466539 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:02:24.466539 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:02:24.466539 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:02:24.466539 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:02:24.466539 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:02:24.466539 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:02:24.466539 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jun 22 10:02:24.466539 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:02:24.466539 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:02:24.466539 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:02:24.466539 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:02:24.467345 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:02:24.467345 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:02:24.467345 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:02:24.467345 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:02:24.467345 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:02:24.467345 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:02:24.467345 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:02:24.467345 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:02:24.467345 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:02:24.467345 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:02:24.467345 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 10:02:24.467345 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:02:24.467345 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 88/176] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Jun 22 10:02:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:02:24.467980 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c4fc91-a3ca-4a3f-8a41-f4e2f96cb7f6 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:24.496877 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a1d10f-69c2-4e6c-9227-e111db34154e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:24.498121 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a1d10f-69c2-4e6c-9227-e111db34154e None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:24.498813 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a1d10f-69c2-4e6c-9227-e111db34154e None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:24.499277 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a1d10f-69c2-4e6c-9227-e111db34154e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:24.500336 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a1d10f-69c2-4e6c-9227-e111db34154e None admin] RBAC: Adding query filter params (role.id=23a6a1fcd69d4210a8f2b45559b65aea, scope.project.id=6008ad7344a543cdae5546c3d2f389b1, user.id=0f1078f8c5e549218cce1ee68f96ea91) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:02:24.500791 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a1d10f-69c2-4e6c-9227-e111db34154e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:24.502688 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a1d10f-69c2-4e6c-9227-e111db34154e None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:24.510292 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 89/177] 10.222.0.43 () {56 vars in 1374 bytes} [Wed Jun 22 10:02:24 2022] GET /identity/v3/role_assignments?user.id=0f1078f8c5e549218cce1ee68f96ea91&scope.project.id=6008ad7344a543cdae5546c3d2f389b1&role.id=23a6a1fcd69d4210a8f2b45559b65aea => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:02:24.511405 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a1d10f-69c2-4e6c-9227-e111db34154e None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:24.595385 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c4fc91-a3ca-4a3f-8a41-f4e2f96cb7f6 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:24.634901 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1706ab-2365-4599-971f-bfe6a599f224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:24.636019 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1706ab-2365-4599-971f-bfe6a599f224 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:24.636019 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1706ab-2365-4599-971f-bfe6a599f224 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:24.636372 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1706ab-2365-4599-971f-bfe6a599f224 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:24.649813 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1706ab-2365-4599-971f-bfe6a599f224 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:02:24.657935 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-df1706ab-2365-4599-971f-bfe6a599f224 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 10:02:24.657935 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:02:24.657935 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:02:24.657935 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:02:24.657935 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:02:24.657935 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:02:24.657935 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:02:24.657935 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:02:24.657935 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:02:24.657935 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:02:24.657935 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:02:24.657935 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:02:24.657935 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:02:24.657935 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:02:24.657935 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:02:24.657935 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:02:24.658880 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:02:24.658880 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:02:24.658880 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:02:24.658880 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:02:24.658880 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:02:24.658880 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:02:24.658880 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:02:24.658880 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:02:24.658880 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:02:24.658880 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:02:24.658880 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:02:24.658880 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jun 22 10:02:24.658880 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:02:24.658880 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:02:24.658880 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:02:24.658880 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:02:24.659649 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:02:24.659649 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:02:24.659649 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:02:24.659649 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:02:24.659649 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:02:24.659649 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:02:24.659649 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:02:24.659649 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:02:24.659649 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:02:24.659649 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:02:24.659649 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 10:02:24.659649 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:02:24.659649 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 89/178] 10.222.0.43 () {56 vars in 1096 bytes} [Wed Jun 22 10:02:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:02:24.660272 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1706ab-2365-4599-971f-bfe6a599f224 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:24.666281 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a1d10f-69c2-4e6c-9227-e111db34154e None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:24.668544 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:24.706479 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a709c1-db6a-4152-8a89-cd3bc987d1df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:24.707565 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a709c1-db6a-4152-8a89-cd3bc987d1df None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:24.707882 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a709c1-db6a-4152-8a89-cd3bc987d1df None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:24.708162 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a709c1-db6a-4152-8a89-cd3bc987d1df None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:24.720707 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a709c1-db6a-4152-8a89-cd3bc987d1df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:02:24.727233 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:24.730948 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-c1a709c1-db6a-4152-8a89-cd3bc987d1df None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 10:02:24.730948 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:02:24.730948 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:02:24.730948 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:02:24.730948 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:02:24.730948 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:02:24.730948 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:02:24.730948 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:02:24.730948 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:02:24.730948 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:02:24.730948 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:02:24.730948 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:02:24.730948 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:02:24.730948 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:02:24.730948 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:02:24.730948 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:02:24.731824 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:02:24.731824 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:02:24.731824 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:02:24.731824 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:02:24.731824 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:02:24.731824 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:02:24.731824 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:02:24.731824 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:02:24.731824 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:02:24.731824 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:02:24.731824 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:02:24.731824 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( Jun 22 10:02:24.731824 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:02:24.731824 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:02:24.731824 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:02:24.731824 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:02:24.732644 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:02:24.732644 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:02:24.732644 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:02:24.732644 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:02:24.732644 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:02:24.732644 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:02:24.732644 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:02:24.732644 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:02:24.732644 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:02:24.732644 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:02:24.732644 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 10:02:24.732644 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:02:24.733242 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 90/179] 10.222.0.43 () {56 vars in 1114 bytes} [Wed Jun 22 10:02:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:02:24.737713 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c595bb-4e8b-4a7a-951b-0eb257885f1b None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:24.737713 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c595bb-4e8b-4a7a-951b-0eb257885f1b None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:24.737713 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c595bb-4e8b-4a7a-951b-0eb257885f1b None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:24.737713 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 91/180] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:02:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:02:24.737713 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c595bb-4e8b-4a7a-951b-0eb257885f1b None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:24.804090 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1706ab-2365-4599-971f-bfe6a599f224 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:24.839450 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b931ac0e-46b8-43f1-b6bd-81f3d65f7270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:24.840344 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b931ac0e-46b8-43f1-b6bd-81f3d65f7270 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:24.840793 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b931ac0e-46b8-43f1-b6bd-81f3d65f7270 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:24.840793 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b931ac0e-46b8-43f1-b6bd-81f3d65f7270 None admin] PATH_INFO: `/v3/projects/6008ad7344a543cdae5546c3d2f389b1` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:24.842935 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b931ac0e-46b8-43f1-b6bd-81f3d65f7270 None admin] RBAC: Authorizing `identity:get_project(project_id=6008ad7344a543cdae5546c3d2f389b1)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:24.844408 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b931ac0e-46b8-43f1-b6bd-81f3d65f7270 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:24.851696 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 90/181] 10.222.0.43 () {56 vars in 1186 bytes} [Wed Jun 22 10:02:24 2022] GET /identity/v3/projects/6008ad7344a543cdae5546c3d2f389b1 => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:02:24.851696 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b931ac0e-46b8-43f1-b6bd-81f3d65f7270 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:24.859792 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c595bb-4e8b-4a7a-951b-0eb257885f1b None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:24.897400 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6b4266-91f3-4eda-a75c-ad4dc8d3a155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:24.898043 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6b4266-91f3-4eda-a75c-ad4dc8d3a155 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:24.898358 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6b4266-91f3-4eda-a75c-ad4dc8d3a155 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:24.898640 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6b4266-91f3-4eda-a75c-ad4dc8d3a155 None admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:24.899412 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6b4266-91f3-4eda-a75c-ad4dc8d3a155 None admin] RBAC: Adding query filter params (name=member) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:02:24.899704 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6b4266-91f3-4eda-a75c-ad4dc8d3a155 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:24.901102 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6b4266-91f3-4eda-a75c-ad4dc8d3a155 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:24.910149 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 92/182] 10.222.0.43 () {56 vars in 1101 bytes} [Wed Jun 22 10:02:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:02:24.911383 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6b4266-91f3-4eda-a75c-ad4dc8d3a155 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:24.938971 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:24.968179 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b931ac0e-46b8-43f1-b6bd-81f3d65f7270 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:24.985959 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:25.006058 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426f9b34-de71-4e49-8998-9d079ea9f55d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:25.006732 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426f9b34-de71-4e49-8998-9d079ea9f55d None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:25.007045 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426f9b34-de71-4e49-8998-9d079ea9f55d None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:25.007310 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426f9b34-de71-4e49-8998-9d079ea9f55d None admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:25.008055 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426f9b34-de71-4e49-8998-9d079ea9f55d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:02:25.008367 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426f9b34-de71-4e49-8998-9d079ea9f55d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:25.009772 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426f9b34-de71-4e49-8998-9d079ea9f55d None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:25.017904 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 91/183] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Jun 22 10:02:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:02:25.018739 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6b4266-91f3-4eda-a75c-ad4dc8d3a155 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:25.023205 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffffa77c-8214-4ece-bef5-ff49ef976fae None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:25.023500 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffffa77c-8214-4ece-bef5-ff49ef976fae None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:25.023786 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffffa77c-8214-4ece-bef5-ff49ef976fae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:25.039965 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-ffffa77c-8214-4ece-bef5-ff49ef976fae None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:02:25.041152 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-ffffa77c-8214-4ece-bef5-ff49ef976fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:02:25.059781 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d39dcfd-33f2-4d93-b30b-d2c8be8e72a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:25.060687 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d39dcfd-33f2-4d93-b30b-d2c8be8e72a6 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:25.061170 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d39dcfd-33f2-4d93-b30b-d2c8be8e72a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:25.061615 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d39dcfd-33f2-4d93-b30b-d2c8be8e72a6 None admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:25.062561 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d39dcfd-33f2-4d93-b30b-d2c8be8e72a6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:02:25.062871 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d39dcfd-33f2-4d93-b30b-d2c8be8e72a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:25.064262 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d39dcfd-33f2-4d93-b30b-d2c8be8e72a6 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:25.072861 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 93/184] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Jun 22 10:02:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:02:25.072861 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d39dcfd-33f2-4d93-b30b-d2c8be8e72a6 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:25.121784 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 92/185] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:02:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 10:02:25.122646 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffffa77c-8214-4ece-bef5-ff49ef976fae None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:25.182095 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:25.202504 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d39dcfd-33f2-4d93-b30b-d2c8be8e72a6 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:25.240342 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5a2cbc-42ac-45b0-9b96-24f18629f622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:25.241028 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5a2cbc-42ac-45b0-9b96-24f18629f622 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:25.241132 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffffa77c-8214-4ece-bef5-ff49ef976fae None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:25.241322 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5a2cbc-42ac-45b0-9b96-24f18629f622 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:25.241570 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5a2cbc-42ac-45b0-9b96-24f18629f622 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:25.242436 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5a2cbc-42ac-45b0-9b96-24f18629f622 None admin] RBAC: Adding query filter params (role.id=26d9c2ab5dfc4e6d9ca80c6014123906, scope.project.id=6008ad7344a543cdae5546c3d2f389b1, user.id=3557bebdc4d94a16b885094566c2bc9a) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:02:25.242756 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5a2cbc-42ac-45b0-9b96-24f18629f622 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:25.244373 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5a2cbc-42ac-45b0-9b96-24f18629f622 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:25.257737 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 94/186] 10.222.0.43 () {56 vars in 1374 bytes} [Wed Jun 22 10:02:25 2022] GET /identity/v3/role_assignments?user.id=3557bebdc4d94a16b885094566c2bc9a&scope.project.id=6008ad7344a543cdae5546c3d2f389b1&role.id=26d9c2ab5dfc4e6d9ca80c6014123906 => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:02:25.257737 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5a2cbc-42ac-45b0-9b96-24f18629f622 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:25.260927 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:25.296244 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bca76ab-9ab7-46d5-9045-7d289812f928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:25.297146 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bca76ab-9ab7-46d5-9045-7d289812f928 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:25.297432 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bca76ab-9ab7-46d5-9045-7d289812f928 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:25.297734 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bca76ab-9ab7-46d5-9045-7d289812f928 None admin] PATH_INFO: `/v3/users/0f1078f8c5e549218cce1ee68f96ea91` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:25.299150 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bca76ab-9ab7-46d5-9045-7d289812f928 None admin] RBAC: Authorizing `identity:get_user(user_id=0f1078f8c5e549218cce1ee68f96ea91)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:25.301253 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bca76ab-9ab7-46d5-9045-7d289812f928 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:25.304580 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 93/187] 10.222.0.43 () {56 vars in 1177 bytes} [Wed Jun 22 10:02:25 2022] GET /identity/v3/users/0f1078f8c5e549218cce1ee68f96ea91 => generated 275 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:02:25.305559 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bca76ab-9ab7-46d5-9045-7d289812f928 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:25.373991 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5a2cbc-42ac-45b0-9b96-24f18629f622 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:25.413520 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4c1f2d-9fba-42e6-bec0-184e8fd41ddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:25.414560 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4c1f2d-9fba-42e6-bec0-184e8fd41ddf None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:25.414849 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4c1f2d-9fba-42e6-bec0-184e8fd41ddf None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:25.415246 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4c1f2d-9fba-42e6-bec0-184e8fd41ddf None admin] PATH_INFO: `/v3/users/feadd6c7a81147e4b44da3c54c894735` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:25.425025 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bca76ab-9ab7-46d5-9045-7d289812f928 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:25.432786 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4c1f2d-9fba-42e6-bec0-184e8fd41ddf None admin] RBAC: Authorizing `identity:get_user(user_id=feadd6c7a81147e4b44da3c54c894735)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:25.434257 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4c1f2d-9fba-42e6-bec0-184e8fd41ddf None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:25.436491 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 95/188] 10.222.0.43 () {56 vars in 1177 bytes} [Wed Jun 22 10:02:25 2022] GET /identity/v3/users/feadd6c7a81147e4b44da3c54c894735 => generated 283 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:02:25.437298 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4c1f2d-9fba-42e6-bec0-184e8fd41ddf None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:25.449490 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:25.483432 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7745574-0b70-4136-a274-9d430e9db3e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:25.484317 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7745574-0b70-4136-a274-9d430e9db3e0 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:25.484605 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7745574-0b70-4136-a274-9d430e9db3e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:25.484887 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7745574-0b70-4136-a274-9d430e9db3e0 None admin] PATH_INFO: `/v3/users/feadd6c7a81147e4b44da3c54c894735` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:25.486217 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7745574-0b70-4136-a274-9d430e9db3e0 None admin] RBAC: Authorizing `identity:get_user(user_id=feadd6c7a81147e4b44da3c54c894735)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:25.487961 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7745574-0b70-4136-a274-9d430e9db3e0 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:25.490157 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 94/189] 10.222.0.43 () {56 vars in 1177 bytes} [Wed Jun 22 10:02:25 2022] GET /identity/v3/users/feadd6c7a81147e4b44da3c54c894735 => generated 283 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:02:25.491166 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7745574-0b70-4136-a274-9d430e9db3e0 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:25.561076 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:25.572541 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4c1f2d-9fba-42e6-bec0-184e8fd41ddf None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:25.611872 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7745574-0b70-4136-a274-9d430e9db3e0 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:25.615070 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96dbfd7-487f-4a7b-bb33-685aaab2da0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:25.615928 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96dbfd7-487f-4a7b-bb33-685aaab2da0f None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:25.616217 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96dbfd7-487f-4a7b-bb33-685aaab2da0f None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:25.616496 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96dbfd7-487f-4a7b-bb33-685aaab2da0f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:25.617713 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96dbfd7-487f-4a7b-bb33-685aaab2da0f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:25.619200 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96dbfd7-487f-4a7b-bb33-685aaab2da0f None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:25.620983 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 96/190] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jun 22 10:02:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:02:25.621674 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96dbfd7-487f-4a7b-bb33-685aaab2da0f None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:25.653760 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaa5418-6146-4c5b-8832-4e6383946178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:25.654738 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaa5418-6146-4c5b-8832-4e6383946178 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:25.655222 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaa5418-6146-4c5b-8832-4e6383946178 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:25.655698 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaa5418-6146-4c5b-8832-4e6383946178 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:25.703714 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:25.732215 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaa5418-6146-4c5b-8832-4e6383946178 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:25.732398 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96dbfd7-487f-4a7b-bb33-685aaab2da0f None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:25.733892 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaa5418-6146-4c5b-8832-4e6383946178 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:25.770115 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422e7fc0-16c9-412f-82ee-3b550a91e795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:25.771524 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422e7fc0-16c9-412f-82ee-3b550a91e795 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:25.771823 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422e7fc0-16c9-412f-82ee-3b550a91e795 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:25.772101 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422e7fc0-16c9-412f-82ee-3b550a91e795 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:25.783917 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:25.844539 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422e7fc0-16c9-412f-82ee-3b550a91e795 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:25.846015 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 95/191] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Jun 22 10:02:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 10:02:25.846495 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422e7fc0-16c9-412f-82ee-3b550a91e795 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:25.846867 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaa5418-6146-4c5b-8832-4e6383946178 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:25.927743 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:25.946190 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaa5418-6146-4c5b-8832-4e6383946178 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:25.951828 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 97/192] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Jun 22 10:02:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 10:02:25.952630 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422e7fc0-16c9-412f-82ee-3b550a91e795 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:25.980699 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bc949a-3b61-44a9-9f77-2d657f63dd99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:25.981280 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bc949a-3b61-44a9-9f77-2d657f63dd99 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:25.981602 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bc949a-3b61-44a9-9f77-2d657f63dd99 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:25.981910 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bc949a-3b61-44a9-9f77-2d657f63dd99 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:25.996061 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:26.049789 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bc949a-3b61-44a9-9f77-2d657f63dd99 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:26.051279 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bc949a-3b61-44a9-9f77-2d657f63dd99 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:26.053330 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422e7fc0-16c9-412f-82ee-3b550a91e795 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:26.087350 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb82c81-9000-4c3a-8cb1-1ad5c5ef11ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:26.088057 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb82c81-9000-4c3a-8cb1-1ad5c5ef11ba None admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:26.088383 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb82c81-9000-4c3a-8cb1-1ad5c5ef11ba None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:26.088770 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb82c81-9000-4c3a-8cb1-1ad5c5ef11ba None admin] PATH_INFO: `/v3/users` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:26.089507 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb82c81-9000-4c3a-8cb1-1ad5c5ef11ba None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:26.091030 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb82c81-9000-4c3a-8cb1-1ad5c5ef11ba None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:26.114836 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 98/193] 10.222.0.43 () {60 vars in 1132 bytes} [Wed Jun 22 10:02:25 2022] POST /identity/v3/users => generated 297 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:02:26.116150 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309ab426-064a-4566-9819-3a7eb7f2baef None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:26.116444 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309ab426-064a-4566-9819-3a7eb7f2baef None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:26.116734 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309ab426-064a-4566-9819-3a7eb7f2baef None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:26.118064 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 99/194] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:02:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:02:26.118810 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309ab426-064a-4566-9819-3a7eb7f2baef None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:26.163784 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:26.178508 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 96/195] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Jun 22 10:02:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 10:02:26.179385 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bc949a-3b61-44a9-9f77-2d657f63dd99 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:26.233495 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:26.251964 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309ab426-064a-4566-9819-3a7eb7f2baef None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:26.295320 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c03e7a-58e7-4778-aea2-78362afae2de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:26.296172 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c03e7a-58e7-4778-aea2-78362afae2de None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:26.296459 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c03e7a-58e7-4778-aea2-78362afae2de None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:26.296739 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c03e7a-58e7-4778-aea2-78362afae2de None admin] PATH_INFO: `/v3/projects/81c599c329414b5996c1a83c3743148c` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:26.297969 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c03e7a-58e7-4778-aea2-78362afae2de None admin] RBAC: Authorizing `identity:get_project(project_id=81c599c329414b5996c1a83c3743148c)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:26.298432 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bc949a-3b61-44a9-9f77-2d657f63dd99 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:26.299495 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c03e7a-58e7-4778-aea2-78362afae2de None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:26.301203 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 100/196] 10.222.0.43 () {56 vars in 1186 bytes} [Wed Jun 22 10:02:26 2022] GET /identity/v3/projects/81c599c329414b5996c1a83c3743148c => generated 312 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:02:26.302803 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ada8c2-274c-4dc1-a7d7-8708cf3b260e None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:26.303089 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ada8c2-274c-4dc1-a7d7-8708cf3b260e None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:26.303370 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ada8c2-274c-4dc1-a7d7-8708cf3b260e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:26.323710 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-27ada8c2-274c-4dc1-a7d7-8708cf3b260e None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:02:26.324934 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-27ada8c2-274c-4dc1-a7d7-8708cf3b260e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:02:26.341735 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c41e47-8706-42bb-87d0-7a2418dc26e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:26.342589 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c41e47-8706-42bb-87d0-7a2418dc26e7 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:26.342874 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c41e47-8706-42bb-87d0-7a2418dc26e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:26.343150 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c41e47-8706-42bb-87d0-7a2418dc26e7 None admin] PATH_INFO: `/v3/projects/d828ff8720114b1b9da6709b7e51dcee` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:26.344358 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c41e47-8706-42bb-87d0-7a2418dc26e7 None admin] RBAC: Authorizing `identity:get_project(project_id=d828ff8720114b1b9da6709b7e51dcee)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:26.345850 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c41e47-8706-42bb-87d0-7a2418dc26e7 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:26.353609 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 97/197] 10.222.0.43 () {56 vars in 1186 bytes} [Wed Jun 22 10:02:26 2022] GET /identity/v3/projects/d828ff8720114b1b9da6709b7e51dcee => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:02:26.354516 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c41e47-8706-42bb-87d0-7a2418dc26e7 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:26.408328 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 101/198] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:02:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 10:02:26.409772 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ada8c2-274c-4dc1-a7d7-8708cf3b260e None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:26.442615 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:26.493677 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c41e47-8706-42bb-87d0-7a2418dc26e7 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:26.508628 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:26.530495 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ada8c2-274c-4dc1-a7d7-8708cf3b260e None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:26.535154 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ef6d8a-2ae0-4260-b5f1-32eef792772b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:26.536376 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ef6d8a-2ae0-4260-b5f1-32eef792772b None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:26.536860 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ef6d8a-2ae0-4260-b5f1-32eef792772b None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:26.537327 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ef6d8a-2ae0-4260-b5f1-32eef792772b None admin] PATH_INFO: `/v3/projects/d828ff8720114b1b9da6709b7e51dcee` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:26.538806 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ef6d8a-2ae0-4260-b5f1-32eef792772b None admin] RBAC: Authorizing `identity:get_project(project_id=d828ff8720114b1b9da6709b7e51dcee)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:26.540473 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ef6d8a-2ae0-4260-b5f1-32eef792772b None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:26.542470 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 98/199] 10.222.0.43 () {56 vars in 1186 bytes} [Wed Jun 22 10:02:26 2022] GET /identity/v3/projects/d828ff8720114b1b9da6709b7e51dcee => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:02:26.543573 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ef6d8a-2ae0-4260-b5f1-32eef792772b None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:26.571297 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166dd1aa-fc74-4578-b8f5-e5eb429bf87b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:26.571920 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166dd1aa-fc74-4578-b8f5-e5eb429bf87b None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:26.572205 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166dd1aa-fc74-4578-b8f5-e5eb429bf87b None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:26.572484 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166dd1aa-fc74-4578-b8f5-e5eb429bf87b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:26.573337 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166dd1aa-fc74-4578-b8f5-e5eb429bf87b None admin] RBAC: Adding query filter params (role.id=9f88c83743f745a9a785a2f454753f06, scope.project.id=81c599c329414b5996c1a83c3743148c, user.id=0f1078f8c5e549218cce1ee68f96ea91) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:02:26.573677 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166dd1aa-fc74-4578-b8f5-e5eb429bf87b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:26.575354 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166dd1aa-fc74-4578-b8f5-e5eb429bf87b None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:26.583310 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 102/200] 10.222.0.43 () {56 vars in 1374 bytes} [Wed Jun 22 10:02:26 2022] GET /identity/v3/role_assignments?user.id=0f1078f8c5e549218cce1ee68f96ea91&scope.project.id=81c599c329414b5996c1a83c3743148c&role.id=9f88c83743f745a9a785a2f454753f06 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:02:26.584536 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166dd1aa-fc74-4578-b8f5-e5eb429bf87b None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:26.655957 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ef6d8a-2ae0-4260-b5f1-32eef792772b None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:26.732588 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d4b171-e950-4e88-adef-f7ad246d1377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:26.733649 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d4b171-e950-4e88-adef-f7ad246d1377 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:26.734151 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d4b171-e950-4e88-adef-f7ad246d1377 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:26.734632 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d4b171-e950-4e88-adef-f7ad246d1377 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:26.735700 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d4b171-e950-4e88-adef-f7ad246d1377 None admin] RBAC: Adding query filter params (role.id=26d9c2ab5dfc4e6d9ca80c6014123906, scope.project.id=d828ff8720114b1b9da6709b7e51dcee, user.id=feadd6c7a81147e4b44da3c54c894735) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:02:26.737356 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d4b171-e950-4e88-adef-f7ad246d1377 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:26.739127 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d4b171-e950-4e88-adef-f7ad246d1377 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:26.753143 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 99/201] 10.222.0.43 () {56 vars in 1374 bytes} [Wed Jun 22 10:02:26 2022] GET /identity/v3/role_assignments?user.id=feadd6c7a81147e4b44da3c54c894735&scope.project.id=d828ff8720114b1b9da6709b7e51dcee&role.id=26d9c2ab5dfc4e6d9ca80c6014123906 => generated 259 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:02:26.754540 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d4b171-e950-4e88-adef-f7ad246d1377 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:26.798126 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:26.811761 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166dd1aa-fc74-4578-b8f5-e5eb429bf87b None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:26.853749 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:26.867985 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2494b398-3bfe-4b03-a7ec-b565460f2167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:26.869862 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2494b398-3bfe-4b03-a7ec-b565460f2167 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:26.870351 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2494b398-3bfe-4b03-a7ec-b565460f2167 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:26.871063 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2494b398-3bfe-4b03-a7ec-b565460f2167 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:26.895743 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2494b398-3bfe-4b03-a7ec-b565460f2167 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:02:26.913253 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-2494b398-3bfe-4b03-a7ec-b565460f2167 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 10:02:26.913253 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:02:26.913253 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:02:26.913253 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:02:26.913253 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:02:26.913253 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:02:26.913253 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:02:26.913253 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:02:26.913253 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:02:26.913253 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:02:26.913253 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:02:26.913253 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:02:26.913253 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:02:26.913253 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:02:26.913253 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:02:26.913253 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:02:26.914410 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:02:26.914410 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:02:26.914410 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:02:26.914410 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:02:26.914410 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:02:26.914410 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:02:26.914410 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:02:26.914410 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:02:26.914410 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:02:26.914410 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:02:26.914410 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:02:26.914410 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( Jun 22 10:02:26.914410 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:02:26.914410 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:02:26.914410 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:02:26.914410 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:02:26.915264 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:02:26.915264 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:02:26.915264 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:02:26.915264 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:02:26.915264 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:02:26.915264 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:02:26.915264 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:02:26.915264 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:02:26.915264 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:02:26.915264 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:02:26.915264 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 10:02:26.915264 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:02:26.921631 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 103/202] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Jun 22 10:02:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:02:26.928239 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2494b398-3bfe-4b03-a7ec-b565460f2167 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:26.963668 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d4b171-e950-4e88-adef-f7ad246d1377 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:27.001974 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbd1dba-6c34-4111-80dc-da0b74ffef71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:27.003002 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbd1dba-6c34-4111-80dc-da0b74ffef71 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:27.003535 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbd1dba-6c34-4111-80dc-da0b74ffef71 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:27.004007 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbd1dba-6c34-4111-80dc-da0b74ffef71 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:27.005599 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbd1dba-6c34-4111-80dc-da0b74ffef71 None admin] RBAC: Adding query filter params (role.id=23a6a1fcd69d4210a8f2b45559b65aea, scope.project.id=d828ff8720114b1b9da6709b7e51dcee, user.id=feadd6c7a81147e4b44da3c54c894735) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:02:27.006141 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbd1dba-6c34-4111-80dc-da0b74ffef71 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:27.007779 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbd1dba-6c34-4111-80dc-da0b74ffef71 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:27.015908 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 100/203] 10.222.0.43 () {56 vars in 1374 bytes} [Wed Jun 22 10:02:26 2022] GET /identity/v3/role_assignments?user.id=feadd6c7a81147e4b44da3c54c894735&scope.project.id=d828ff8720114b1b9da6709b7e51dcee&role.id=23a6a1fcd69d4210a8f2b45559b65aea => generated 259 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:02:27.107611 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2494b398-3bfe-4b03-a7ec-b565460f2167 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:27.167979 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85208c76-8975-4b3e-82cd-5e64e2683f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:27.169104 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85208c76-8975-4b3e-82cd-5e64e2683f7f None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:27.169649 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85208c76-8975-4b3e-82cd-5e64e2683f7f None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:27.170161 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85208c76-8975-4b3e-82cd-5e64e2683f7f None admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:27.171153 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85208c76-8975-4b3e-82cd-5e64e2683f7f None admin] RBAC: Adding query filter params (name=reader) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:02:27.171654 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85208c76-8975-4b3e-82cd-5e64e2683f7f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:27.173291 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85208c76-8975-4b3e-82cd-5e64e2683f7f None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:27.188158 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 104/204] 10.222.0.43 () {56 vars in 1101 bytes} [Wed Jun 22 10:02:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:02:27.194710 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbd1dba-6c34-4111-80dc-da0b74ffef71 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:27.310251 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbd1dba-6c34-4111-80dc-da0b74ffef71 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:27.324098 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:27.360176 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93db4ecc-4cac-4b75-bcea-f2761488323e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:27.361064 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93db4ecc-4cac-4b75-bcea-f2761488323e None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:27.361350 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93db4ecc-4cac-4b75-bcea-f2761488323e None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:27.361634 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93db4ecc-4cac-4b75-bcea-f2761488323e None admin] PATH_INFO: `/v3/users/746db3b3fef048fa861458dc0af700de` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:27.362874 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93db4ecc-4cac-4b75-bcea-f2761488323e None admin] RBAC: Authorizing `identity:get_user(user_id=746db3b3fef048fa861458dc0af700de)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:27.364890 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93db4ecc-4cac-4b75-bcea-f2761488323e None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:27.366959 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 101/205] 10.222.0.43 () {56 vars in 1177 bytes} [Wed Jun 22 10:02:27 2022] GET /identity/v3/users/746db3b3fef048fa861458dc0af700de => generated 289 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:02:27.372022 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85208c76-8975-4b3e-82cd-5e64e2683f7f None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:27.405714 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:27.522172 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85208c76-8975-4b3e-82cd-5e64e2683f7f None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:27.568030 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ce8dcc-3d6b-4830-baa1-a02c87eba5a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:27.568666 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ce8dcc-3d6b-4830-baa1-a02c87eba5a6 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:27.568952 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ce8dcc-3d6b-4830-baa1-a02c87eba5a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:27.569231 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ce8dcc-3d6b-4830-baa1-a02c87eba5a6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:27.648365 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ce8dcc-3d6b-4830-baa1-a02c87eba5a6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:27.649884 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ce8dcc-3d6b-4830-baa1-a02c87eba5a6 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:27.672409 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:27.782227 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 105/206] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Jun 22 10:02:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 10:02:27.788570 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93db4ecc-4cac-4b75-bcea-f2761488323e None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:27.954764 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93db4ecc-4cac-4b75-bcea-f2761488323e None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:27.999966 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084eb9d0-0c68-432c-a8b6-09ba6a311df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:28.000831 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084eb9d0-0c68-432c-a8b6-09ba6a311df1 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:28.001111 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084eb9d0-0c68-432c-a8b6-09ba6a311df1 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:28.001387 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084eb9d0-0c68-432c-a8b6-09ba6a311df1 None admin] PATH_INFO: `/v3/projects/6008ad7344a543cdae5546c3d2f389b1` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:28.002612 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084eb9d0-0c68-432c-a8b6-09ba6a311df1 None admin] RBAC: Authorizing `identity:get_project(project_id=6008ad7344a543cdae5546c3d2f389b1)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:28.004164 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084eb9d0-0c68-432c-a8b6-09ba6a311df1 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:28.006555 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 102/207] 10.222.0.43 () {56 vars in 1186 bytes} [Wed Jun 22 10:02:27 2022] GET /identity/v3/projects/6008ad7344a543cdae5546c3d2f389b1 => generated 298 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:02:28.012414 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ce8dcc-3d6b-4830-baa1-a02c87eba5a6 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:28.141423 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ce8dcc-3d6b-4830-baa1-a02c87eba5a6 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:28.168329 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:28.190420 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9426d9fb-1d07-466a-98cd-d3d46f967c2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:28.191081 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9426d9fb-1d07-466a-98cd-d3d46f967c2c None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:28.191367 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9426d9fb-1d07-466a-98cd-d3d46f967c2c None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:28.191653 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9426d9fb-1d07-466a-98cd-d3d46f967c2c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:28.193416 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9426d9fb-1d07-466a-98cd-d3d46f967c2c None admin] RBAC: Adding query filter params (role.id=4a03c0e749d84649a230831b1e6644a4, scope.project.id=6008ad7344a543cdae5546c3d2f389b1, user.id=746db3b3fef048fa861458dc0af700de) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:02:28.193751 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9426d9fb-1d07-466a-98cd-d3d46f967c2c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:28.198053 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9426d9fb-1d07-466a-98cd-d3d46f967c2c None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:28.216220 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 106/208] 10.222.0.43 () {56 vars in 1374 bytes} [Wed Jun 22 10:02:28 2022] GET /identity/v3/role_assignments?user.id=746db3b3fef048fa861458dc0af700de&scope.project.id=6008ad7344a543cdae5546c3d2f389b1&role.id=4a03c0e749d84649a230831b1e6644a4 => generated 608 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:02:28.755027 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7c4f23-0e17-4743-9ad0-a21b673faead None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:28.755839 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7c4f23-0e17-4743-9ad0-a21b673faead None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:28.756405 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7c4f23-0e17-4743-9ad0-a21b673faead None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:28.758353 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 103/209] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:02:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:02:28.763505 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc54ae6-b3b2-47f4-8497-3b2bc4d2c597 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:28.764053 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc54ae6-b3b2-47f4-8497-3b2bc4d2c597 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:28.764574 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc54ae6-b3b2-47f4-8497-3b2bc4d2c597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:28.785109 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-fbc54ae6-b3b2-47f4-8497-3b2bc4d2c597 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:02:28.787286 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-fbc54ae6-b3b2-47f4-8497-3b2bc4d2c597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:02:28.874480 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 107/210] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:02:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 10:02:28.882849 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091a6f8f-d182-47aa-8d24-667e3f31dbd6 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:28.883214 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091a6f8f-d182-47aa-8d24-667e3f31dbd6 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:28.883566 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091a6f8f-d182-47aa-8d24-667e3f31dbd6 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:28.885145 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 104/211] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:02:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:02:28.890747 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0f5000-fbbc-4f2f-a5d0-1eaec8464464 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:28.891131 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0f5000-fbbc-4f2f-a5d0-1eaec8464464 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:28.891488 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0f5000-fbbc-4f2f-a5d0-1eaec8464464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:28.899964 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091a6f8f-d182-47aa-8d24-667e3f31dbd6 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:28.914718 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-cb0f5000-fbbc-4f2f-a5d0-1eaec8464464 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:02:28.915992 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-cb0f5000-fbbc-4f2f-a5d0-1eaec8464464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:02:28.959053 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:28.987137 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 108/212] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:02:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 10:02:29.011700 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0f5000-fbbc-4f2f-a5d0-1eaec8464464 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:29.023292 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091a6f8f-d182-47aa-8d24-667e3f31dbd6 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:29.055635 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:29.064505 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00acd34c-0b88-45a9-b68c-b3692b55a701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:29.065852 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00acd34c-0b88-45a9-b68c-b3692b55a701 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:29.066313 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00acd34c-0b88-45a9-b68c-b3692b55a701 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:29.066736 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00acd34c-0b88-45a9-b68c-b3692b55a701 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:29.068238 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00acd34c-0b88-45a9-b68c-b3692b55a701 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:29.070026 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00acd34c-0b88-45a9-b68c-b3692b55a701 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:29.072414 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 105/213] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jun 22 10:02:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:02:29.077873 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00acd34c-0b88-45a9-b68c-b3692b55a701 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:29.118605 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0f5000-fbbc-4f2f-a5d0-1eaec8464464 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:29.154657 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802974c7-c1eb-4fa7-b587-eb85efb0b92b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:29.155554 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802974c7-c1eb-4fa7-b587-eb85efb0b92b None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:29.155738 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802974c7-c1eb-4fa7-b587-eb85efb0b92b None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:29.156015 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802974c7-c1eb-4fa7-b587-eb85efb0b92b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:29.170886 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802974c7-c1eb-4fa7-b587-eb85efb0b92b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:02:29.178996 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-802974c7-c1eb-4fa7-b587-eb85efb0b92b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 10:02:29.178996 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:02:29.178996 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:02:29.178996 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:02:29.178996 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:02:29.178996 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:02:29.178996 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:02:29.178996 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:02:29.178996 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:02:29.178996 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:02:29.178996 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:02:29.178996 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:02:29.178996 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:02:29.178996 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:02:29.178996 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:02:29.178996 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:02:29.180119 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:02:29.180119 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:02:29.180119 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:02:29.180119 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:02:29.180119 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:02:29.180119 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:02:29.180119 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:02:29.180119 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:02:29.180119 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:02:29.180119 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:02:29.180119 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:02:29.180119 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( Jun 22 10:02:29.180119 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:02:29.180119 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:02:29.180119 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:02:29.180119 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:02:29.181101 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:02:29.181101 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:02:29.181101 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:02:29.181101 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:02:29.181101 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:02:29.181101 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:02:29.181101 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:02:29.181101 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:02:29.181101 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:02:29.181101 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:02:29.181101 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 10:02:29.181101 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:02:29.185012 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 109/214] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Jun 22 10:02:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:02:29.186241 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802974c7-c1eb-4fa7-b587-eb85efb0b92b None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:29.198278 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00acd34c-0b88-45a9-b68c-b3692b55a701 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:29.213938 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:29.241644 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5918f213-8295-4ffd-87e2-a25e011ea3cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:29.242725 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5918f213-8295-4ffd-87e2-a25e011ea3cb None admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:29.243235 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5918f213-8295-4ffd-87e2-a25e011ea3cb None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:29.243768 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5918f213-8295-4ffd-87e2-a25e011ea3cb None admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:29.244634 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5918f213-8295-4ffd-87e2-a25e011ea3cb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:29.246368 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5918f213-8295-4ffd-87e2-a25e011ea3cb None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:29.277727 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 106/215] 10.222.0.43 () {60 vars in 1132 bytes} [Wed Jun 22 10:02:29 2022] POST /identity/v3/users => generated 297 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 10:02:29.295895 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:29.298913 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802974c7-c1eb-4fa7-b587-eb85efb0b92b None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:29.340656 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d056994a-262c-44f2-9f0a-31883566b549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:29.341352 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d056994a-262c-44f2-9f0a-31883566b549 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:29.341638 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d056994a-262c-44f2-9f0a-31883566b549 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:29.341940 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d056994a-262c-44f2-9f0a-31883566b549 None admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:29.342716 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d056994a-262c-44f2-9f0a-31883566b549 None admin] RBAC: Adding query filter params (name=member) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:02:29.343020 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d056994a-262c-44f2-9f0a-31883566b549 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:29.344447 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d056994a-262c-44f2-9f0a-31883566b549 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:29.355110 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 110/216] 10.222.0.43 () {56 vars in 1101 bytes} [Wed Jun 22 10:02:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:02:29.360983 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5918f213-8295-4ffd-87e2-a25e011ea3cb None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:29.363979 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88600e5a-7f4e-4143-b304-ca50a823460a None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:29.364323 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88600e5a-7f4e-4143-b304-ca50a823460a None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:29.364592 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88600e5a-7f4e-4143-b304-ca50a823460a None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:29.366479 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 111/217] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:02:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 10:02:29.375601 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7656f8bd-6d07-4409-b61f-7834490c53e2 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:29.375920 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7656f8bd-6d07-4409-b61f-7834490c53e2 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:29.376166 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7656f8bd-6d07-4409-b61f-7834490c53e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:29.395919 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-7656f8bd-6d07-4409-b61f-7834490c53e2 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:02:29.397417 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-7656f8bd-6d07-4409-b61f-7834490c53e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:02:29.482595 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5918f213-8295-4ffd-87e2-a25e011ea3cb None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:29.497935 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 112/218] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:02:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 10:02:29.510532 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7732838-211f-4652-b64e-31a793c95804 None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:29.510828 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7732838-211f-4652-b64e-31a793c95804 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:29.511091 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7732838-211f-4652-b64e-31a793c95804 None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:29.512732 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 113/219] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:02:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 10:02:29.519331 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd1c7dd-6f20-4dad-b91a-989e831d37e6 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:29.519331 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd1c7dd-6f20-4dad-b91a-989e831d37e6 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:29.519331 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd1c7dd-6f20-4dad-b91a-989e831d37e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:29.532406 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69e050e-7a15-4ccc-b8b2-7ef77d2c7418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:29.533233 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69e050e-7a15-4ccc-b8b2-7ef77d2c7418 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:29.533518 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69e050e-7a15-4ccc-b8b2-7ef77d2c7418 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:29.533842 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69e050e-7a15-4ccc-b8b2-7ef77d2c7418 None admin] PATH_INFO: `/v3/users/1db2f00cb1684d7f982b81a1db9ebb03` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:29.536550 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-ccd1c7dd-6f20-4dad-b91a-989e831d37e6 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:02:29.538339 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-ccd1c7dd-6f20-4dad-b91a-989e831d37e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:02:29.549532 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69e050e-7a15-4ccc-b8b2-7ef77d2c7418 None admin] RBAC: Authorizing `identity:get_user(user_id=1db2f00cb1684d7f982b81a1db9ebb03)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:29.551722 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69e050e-7a15-4ccc-b8b2-7ef77d2c7418 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:29.554238 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 107/220] 10.222.0.43 () {56 vars in 1177 bytes} [Wed Jun 22 10:02:29 2022] GET /identity/v3/users/1db2f00cb1684d7f982b81a1db9ebb03 => generated 297 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:02:29.556141 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69e050e-7a15-4ccc-b8b2-7ef77d2c7418 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:29.598092 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:29.621190 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 114/221] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:02:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 10:02:29.622494 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd1c7dd-6f20-4dad-b91a-989e831d37e6 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:29.657797 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:29.685175 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69e050e-7a15-4ccc-b8b2-7ef77d2c7418 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:29.731685 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c396766e-8ea7-4666-a031-82cc223158e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:29.732996 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c396766e-8ea7-4666-a031-82cc223158e2 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:29.733894 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c396766e-8ea7-4666-a031-82cc223158e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:29.734571 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c396766e-8ea7-4666-a031-82cc223158e2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:29.751112 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c396766e-8ea7-4666-a031-82cc223158e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:02:29.752781 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd1c7dd-6f20-4dad-b91a-989e831d37e6 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:29.762162 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-c396766e-8ea7-4666-a031-82cc223158e2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 10:02:29.762162 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:02:29.762162 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:02:29.762162 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:02:29.762162 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:02:29.762162 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:02:29.762162 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:02:29.762162 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:02:29.762162 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:02:29.762162 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:02:29.762162 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:02:29.762162 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:02:29.762162 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:02:29.762162 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:02:29.762162 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:02:29.762162 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:02:29.763249 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:02:29.763249 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:02:29.763249 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:02:29.763249 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:02:29.763249 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:02:29.763249 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:02:29.763249 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:02:29.763249 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:02:29.763249 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:02:29.763249 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:02:29.763249 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:02:29.763249 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jun 22 10:02:29.763249 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:02:29.763249 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:02:29.763249 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:02:29.763249 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:02:29.764219 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:02:29.764219 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:02:29.764219 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:02:29.764219 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:02:29.764219 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:02:29.764219 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:02:29.764219 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:02:29.764219 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:02:29.764219 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:02:29.764219 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:02:29.764219 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 10:02:29.764219 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:02:29.772232 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 108/222] 10.222.0.43 () {56 vars in 1096 bytes} [Wed Jun 22 10:02:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:02:29.772232 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c396766e-8ea7-4666-a031-82cc223158e2 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:29.798655 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5e6e2c-ed5b-4614-9dff-7cd495a0fb6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:29.799298 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5e6e2c-ed5b-4614-9dff-7cd495a0fb6e None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:29.799587 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5e6e2c-ed5b-4614-9dff-7cd495a0fb6e None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:29.799870 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5e6e2c-ed5b-4614-9dff-7cd495a0fb6e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:29.879019 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5e6e2c-ed5b-4614-9dff-7cd495a0fb6e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:29.881348 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5e6e2c-ed5b-4614-9dff-7cd495a0fb6e None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:29.899258 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:29.907431 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:29.923014 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c396766e-8ea7-4666-a031-82cc223158e2 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:29.965144 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d204f4a5-c032-4b00-8b2f-19d8b9063a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:29.966015 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d204f4a5-c032-4b00-8b2f-19d8b9063a2d None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:29.966301 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d204f4a5-c032-4b00-8b2f-19d8b9063a2d None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:29.966580 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d204f4a5-c032-4b00-8b2f-19d8b9063a2d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:29.982148 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d204f4a5-c032-4b00-8b2f-19d8b9063a2d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:02:29.994699 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-d204f4a5-c032-4b00-8b2f-19d8b9063a2d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 10:02:29.994699 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:02:29.994699 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:02:29.994699 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:02:29.994699 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:02:29.994699 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:02:29.994699 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:02:29.994699 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:02:29.994699 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:02:29.994699 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:02:29.994699 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:02:29.994699 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:02:29.994699 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:02:29.994699 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:02:29.994699 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:02:29.994699 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:02:29.995817 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:02:29.995817 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:02:29.995817 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:02:29.995817 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:02:29.995817 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:02:29.995817 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:02:29.995817 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:02:29.995817 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:02:29.995817 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:02:29.995817 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:02:29.995817 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:02:29.995817 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jun 22 10:02:29.995817 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:02:29.995817 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:02:29.995817 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:02:29.995817 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:02:29.996802 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:02:29.996802 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:02:29.996802 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:02:29.996802 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:02:29.996802 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:02:29.996802 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:02:29.996802 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:02:29.996802 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:02:29.996802 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:02:29.996802 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:02:29.996802 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 10:02:29.996802 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:02:29.996802 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 109/223] 10.222.0.43 () {56 vars in 1114 bytes} [Wed Jun 22 10:02:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:02:29.996802 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d204f4a5-c032-4b00-8b2f-19d8b9063a2d None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:29.999379 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 115/224] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Jun 22 10:02:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 10:02:30.002865 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5e6e2c-ed5b-4614-9dff-7cd495a0fb6e None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:30.128523 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d204f4a5-c032-4b00-8b2f-19d8b9063a2d None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:30.132484 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5e6e2c-ed5b-4614-9dff-7cd495a0fb6e None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:30.164899 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:30.166960 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8cf081-edd7-4b54-a91c-b2f29f2d8aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:30.167740 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8cf081-edd7-4b54-a91c-b2f29f2d8aa6 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:30.168082 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8cf081-edd7-4b54-a91c-b2f29f2d8aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:30.168909 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8cf081-edd7-4b54-a91c-b2f29f2d8aa6 None admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:30.169100 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8cf081-edd7-4b54-a91c-b2f29f2d8aa6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:02:30.169502 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8cf081-edd7-4b54-a91c-b2f29f2d8aa6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:30.170920 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8cf081-edd7-4b54-a91c-b2f29f2d8aa6 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:30.182992 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a022b0be-b83d-49b3-b6a6-2728adc7bcbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:30.183258 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 110/225] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Jun 22 10:02:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:02:30.183900 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8cf081-edd7-4b54-a91c-b2f29f2d8aa6 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:30.184331 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a022b0be-b83d-49b3-b6a6-2728adc7bcbb None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:30.184851 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a022b0be-b83d-49b3-b6a6-2728adc7bcbb None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:30.185265 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a022b0be-b83d-49b3-b6a6-2728adc7bcbb None admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:30.188924 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a022b0be-b83d-49b3-b6a6-2728adc7bcbb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:02:30.189433 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a022b0be-b83d-49b3-b6a6-2728adc7bcbb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:30.191030 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a022b0be-b83d-49b3-b6a6-2728adc7bcbb None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:30.198417 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:30.208792 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 116/226] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Jun 22 10:02:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:02:30.210050 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a022b0be-b83d-49b3-b6a6-2728adc7bcbb None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:30.307272 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8cf081-edd7-4b54-a91c-b2f29f2d8aa6 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:30.315799 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a022b0be-b83d-49b3-b6a6-2728adc7bcbb None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:30.344459 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92c8716-7cfa-4032-a11d-07a74124688f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:30.345332 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92c8716-7cfa-4032-a11d-07a74124688f None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:30.345624 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92c8716-7cfa-4032-a11d-07a74124688f None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:30.346076 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92c8716-7cfa-4032-a11d-07a74124688f None admin] PATH_INFO: `/v3/projects/d828ff8720114b1b9da6709b7e51dcee` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:30.347360 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92c8716-7cfa-4032-a11d-07a74124688f None admin] RBAC: Authorizing `identity:get_project(project_id=d828ff8720114b1b9da6709b7e51dcee)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:30.349725 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92c8716-7cfa-4032-a11d-07a74124688f None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:30.352894 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341c7afb-bf50-4678-8828-00a488a94fc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:30.353958 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341c7afb-bf50-4678-8828-00a488a94fc7 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:30.354398 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341c7afb-bf50-4678-8828-00a488a94fc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:30.354828 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341c7afb-bf50-4678-8828-00a488a94fc7 None admin] PATH_INFO: `/v3/users/feadd6c7a81147e4b44da3c54c894735` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:30.356365 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 111/227] 10.222.0.43 () {56 vars in 1186 bytes} [Wed Jun 22 10:02:30 2022] GET /identity/v3/projects/d828ff8720114b1b9da6709b7e51dcee => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:02:30.356723 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341c7afb-bf50-4678-8828-00a488a94fc7 None admin] RBAC: Authorizing `identity:get_user(user_id=feadd6c7a81147e4b44da3c54c894735)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:30.357185 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92c8716-7cfa-4032-a11d-07a74124688f None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:30.358604 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341c7afb-bf50-4678-8828-00a488a94fc7 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:30.360390 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 117/228] 10.222.0.43 () {56 vars in 1177 bytes} [Wed Jun 22 10:02:30 2022] GET /identity/v3/users/feadd6c7a81147e4b44da3c54c894735 => generated 283 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:02:30.361362 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341c7afb-bf50-4678-8828-00a488a94fc7 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:30.415268 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:30.443167 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:30.468982 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341c7afb-bf50-4678-8828-00a488a94fc7 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:30.472097 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92c8716-7cfa-4032-a11d-07a74124688f None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:30.504092 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3ef9e2-9b63-42c4-bf83-02eeb9740d6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:30.504937 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3ef9e2-9b63-42c4-bf83-02eeb9740d6d None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:30.505243 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3ef9e2-9b63-42c4-bf83-02eeb9740d6d None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:30.505522 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3ef9e2-9b63-42c4-bf83-02eeb9740d6d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:30.506402 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3ef9e2-9b63-42c4-bf83-02eeb9740d6d None admin] RBAC: Adding query filter params (role.id=9f88c83743f745a9a785a2f454753f06, scope.project.id=d828ff8720114b1b9da6709b7e51dcee, user.id=1db2f00cb1684d7f982b81a1db9ebb03) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:02:30.506716 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3ef9e2-9b63-42c4-bf83-02eeb9740d6d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:30.508404 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3ef9e2-9b63-42c4-bf83-02eeb9740d6d None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:30.511446 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad6b68d-ef95-41ab-8a79-a8a6214c5228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:30.512668 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad6b68d-ef95-41ab-8a79-a8a6214c5228 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:30.513118 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad6b68d-ef95-41ab-8a79-a8a6214c5228 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:30.513571 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad6b68d-ef95-41ab-8a79-a8a6214c5228 None admin] PATH_INFO: `/v3/users/feadd6c7a81147e4b44da3c54c894735` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:30.521718 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad6b68d-ef95-41ab-8a79-a8a6214c5228 None admin] RBAC: Authorizing `identity:get_user(user_id=feadd6c7a81147e4b44da3c54c894735)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:30.521915 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 118/229] 10.222.0.43 () {56 vars in 1374 bytes} [Wed Jun 22 10:02:30 2022] GET /identity/v3/role_assignments?user.id=1db2f00cb1684d7f982b81a1db9ebb03&scope.project.id=d828ff8720114b1b9da6709b7e51dcee&role.id=9f88c83743f745a9a785a2f454753f06 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:02:30.521915 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3ef9e2-9b63-42c4-bf83-02eeb9740d6d None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:30.523856 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad6b68d-ef95-41ab-8a79-a8a6214c5228 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:30.525816 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 112/230] 10.222.0.43 () {56 vars in 1177 bytes} [Wed Jun 22 10:02:30 2022] GET /identity/v3/users/feadd6c7a81147e4b44da3c54c894735 => generated 283 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:02:30.531520 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad6b68d-ef95-41ab-8a79-a8a6214c5228 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:30.663159 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad6b68d-ef95-41ab-8a79-a8a6214c5228 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:30.687730 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3ef9e2-9b63-42c4-bf83-02eeb9740d6d None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:30.702519 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7d2b1f-129b-453f-b19c-5b14c7a5b638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:30.703741 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7d2b1f-129b-453f-b19c-5b14c7a5b638 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:30.704190 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7d2b1f-129b-453f-b19c-5b14c7a5b638 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:30.704613 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7d2b1f-129b-453f-b19c-5b14c7a5b638 None admin] PATH_INFO: `/v3/projects/d828ff8720114b1b9da6709b7e51dcee` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:30.713121 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7d2b1f-129b-453f-b19c-5b14c7a5b638 None admin] RBAC: Authorizing `identity:get_project(project_id=d828ff8720114b1b9da6709b7e51dcee)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:30.715970 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7d2b1f-129b-453f-b19c-5b14c7a5b638 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:30.722460 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:30.724584 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 113/231] 10.222.0.43 () {56 vars in 1186 bytes} [Wed Jun 22 10:02:30 2022] GET /identity/v3/projects/d828ff8720114b1b9da6709b7e51dcee => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:02:30.734729 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7d2b1f-129b-453f-b19c-5b14c7a5b638 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:30.759149 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d58166-511e-4463-9c66-8aa5dc2ac94a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:30.760052 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d58166-511e-4463-9c66-8aa5dc2ac94a None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:30.760343 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d58166-511e-4463-9c66-8aa5dc2ac94a None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:30.760629 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d58166-511e-4463-9c66-8aa5dc2ac94a None admin] PATH_INFO: `/v3/projects/d828ff8720114b1b9da6709b7e51dcee` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:30.761801 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:30.761921 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d58166-511e-4463-9c66-8aa5dc2ac94a None admin] RBAC: Authorizing `identity:get_project(project_id=d828ff8720114b1b9da6709b7e51dcee)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:30.763430 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d58166-511e-4463-9c66-8aa5dc2ac94a None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:30.765236 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 119/232] 10.222.0.43 () {56 vars in 1186 bytes} [Wed Jun 22 10:02:30 2022] GET /identity/v3/projects/d828ff8720114b1b9da6709b7e51dcee => generated 302 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:02:30.774974 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d58166-511e-4463-9c66-8aa5dc2ac94a None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:30.862257 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7d2b1f-129b-453f-b19c-5b14c7a5b638 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:30.899485 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9e89f6-20d2-47cc-9e1e-3b735776ceb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:30.900388 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9e89f6-20d2-47cc-9e1e-3b735776ceb5 None admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:30.900667 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9e89f6-20d2-47cc-9e1e-3b735776ceb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:30.900943 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9e89f6-20d2-47cc-9e1e-3b735776ceb5 None admin] PATH_INFO: `/v3/projects/d828ff8720114b1b9da6709b7e51dcee/users/feadd6c7a81147e4b44da3c54c894735/roles/23a6a1fcd69d4210a8f2b45559b65aea` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:30.905945 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9e89f6-20d2-47cc-9e1e-3b735776ceb5 None admin] RBAC: Authorizing `identity:create_grant(project_id=d828ff8720114b1b9da6709b7e51dcee, user_id=feadd6c7a81147e4b44da3c54c894735, role_id=23a6a1fcd69d4210a8f2b45559b65aea)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:30.907417 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9e89f6-20d2-47cc-9e1e-3b735776ceb5 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:30.934702 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 114/233] 10.222.0.43 () {58 vars in 1439 bytes} [Wed Jun 22 10:02:30 2022] PUT /identity/v3/projects/d828ff8720114b1b9da6709b7e51dcee/users/feadd6c7a81147e4b44da3c54c894735/roles/23a6a1fcd69d4210a8f2b45559b65aea => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:02:30.935232 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d58166-511e-4463-9c66-8aa5dc2ac94a None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:30.993662 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a8be68-2b57-4719-ba97-4a26bc926ec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:30.994586 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a8be68-2b57-4719-ba97-4a26bc926ec1 None admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:30.994930 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a8be68-2b57-4719-ba97-4a26bc926ec1 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:30.995214 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a8be68-2b57-4719-ba97-4a26bc926ec1 None admin] PATH_INFO: `/v3/projects/d828ff8720114b1b9da6709b7e51dcee/users/feadd6c7a81147e4b44da3c54c894735/roles/26d9c2ab5dfc4e6d9ca80c6014123906` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:30.997177 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a8be68-2b57-4719-ba97-4a26bc926ec1 None admin] RBAC: Authorizing `identity:create_grant(project_id=d828ff8720114b1b9da6709b7e51dcee, user_id=feadd6c7a81147e4b44da3c54c894735, role_id=26d9c2ab5dfc4e6d9ca80c6014123906)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:30.998667 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a8be68-2b57-4719-ba97-4a26bc926ec1 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:31.028588 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 120/234] 10.222.0.43 () {58 vars in 1439 bytes} [Wed Jun 22 10:02:30 2022] PUT /identity/v3/projects/d828ff8720114b1b9da6709b7e51dcee/users/feadd6c7a81147e4b44da3c54c894735/roles/26d9c2ab5dfc4e6d9ca80c6014123906 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:02:31.641080 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09611ab6-b78a-4497-b7b8-99026206ade2 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:31.641598 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09611ab6-b78a-4497-b7b8-99026206ade2 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:31.641674 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09611ab6-b78a-4497-b7b8-99026206ade2 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:31.643317 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 115/235] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:02:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:02:31.648974 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff187ff-4095-4013-918e-3896187ab0c7 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:31.649461 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff187ff-4095-4013-918e-3896187ab0c7 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:31.649538 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff187ff-4095-4013-918e-3896187ab0c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:31.664297 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54df5f0c-8d9d-4c97-9f5c-33653e1e62e6 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:31.664586 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54df5f0c-8d9d-4c97-9f5c-33653e1e62e6 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:31.664852 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54df5f0c-8d9d-4c97-9f5c-33653e1e62e6 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:31.666535 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 116/236] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:02:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:02:31.671846 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-4ff187ff-4095-4013-918e-3896187ab0c7 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:02:31.673164 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-4ff187ff-4095-4013-918e-3896187ab0c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:02:31.678076 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b47ea7d-5fd6-48b7-a897-64723ae02803 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:31.678363 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b47ea7d-5fd6-48b7-a897-64723ae02803 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:31.678640 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b47ea7d-5fd6-48b7-a897-64723ae02803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:31.701899 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-0b47ea7d-5fd6-48b7-a897-64723ae02803 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:02:31.703211 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-0b47ea7d-5fd6-48b7-a897-64723ae02803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:02:31.763713 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:31.779970 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 117/237] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:02:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 10:02:31.819803 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b47ea7d-5fd6-48b7-a897-64723ae02803 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:31.822441 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:31.834297 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 121/238] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:02:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 10:02:31.887779 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff187ff-4095-4013-918e-3896187ab0c7 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:31.957571 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b47ea7d-5fd6-48b7-a897-64723ae02803 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:32.005074 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a71bf6-ce8b-4c3f-86a7-d13b6e12d55d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:32.006064 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a71bf6-ce8b-4c3f-86a7-d13b6e12d55d None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:32.006354 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a71bf6-ce8b-4c3f-86a7-d13b6e12d55d None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:32.006643 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a71bf6-ce8b-4c3f-86a7-d13b6e12d55d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:32.032455 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a71bf6-ce8b-4c3f-86a7-d13b6e12d55d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:02:32.044879 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-85a71bf6-ce8b-4c3f-86a7-d13b6e12d55d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 10:02:32.044879 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:02:32.044879 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:02:32.044879 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:02:32.044879 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:02:32.044879 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:02:32.044879 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:02:32.044879 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:02:32.044879 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:02:32.044879 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:02:32.044879 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:02:32.044879 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:02:32.044879 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:02:32.044879 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:02:32.044879 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:02:32.044879 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:02:32.045848 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:02:32.045848 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:02:32.045848 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:02:32.045848 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:02:32.045848 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:02:32.045848 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:02:32.045848 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:02:32.045848 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:02:32.045848 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:02:32.045848 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:02:32.045848 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:02:32.045848 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jun 22 10:02:32.045848 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:02:32.045848 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:02:32.045848 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:02:32.045848 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:02:32.046630 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:02:32.046630 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:02:32.046630 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:02:32.046630 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:02:32.046630 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:02:32.046630 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:02:32.046630 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:02:32.046630 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:02:32.046630 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:02:32.046630 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:02:32.046630 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 10:02:32.046630 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:02:32.052870 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 118/239] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Jun 22 10:02:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:02:32.054270 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a71bf6-ce8b-4c3f-86a7-d13b6e12d55d None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:32.073372 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff187ff-4095-4013-918e-3896187ab0c7 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:32.116299 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7413ac1f-1c2a-4bee-a882-ed639742d371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:32.117441 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7413ac1f-1c2a-4bee-a882-ed639742d371 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:32.117949 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7413ac1f-1c2a-4bee-a882-ed639742d371 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:32.118423 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7413ac1f-1c2a-4bee-a882-ed639742d371 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:32.119944 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7413ac1f-1c2a-4bee-a882-ed639742d371 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:32.122822 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7413ac1f-1c2a-4bee-a882-ed639742d371 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:32.126325 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 122/240] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jun 22 10:02:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:02:32.132257 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7413ac1f-1c2a-4bee-a882-ed639742d371 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:32.206029 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:32.215020 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:32.295021 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7413ac1f-1c2a-4bee-a882-ed639742d371 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:32.299772 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a71bf6-ce8b-4c3f-86a7-d13b6e12d55d None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:32.361923 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1113f9-a689-4859-9169-0b3f22f8ab5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:32.362600 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1113f9-a689-4859-9169-0b3f22f8ab5c None admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:32.362883 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1113f9-a689-4859-9169-0b3f22f8ab5c None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:32.363161 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1113f9-a689-4859-9169-0b3f22f8ab5c None admin] PATH_INFO: `/v3/users` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:32.363895 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1113f9-a689-4859-9169-0b3f22f8ab5c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:32.365530 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1113f9-a689-4859-9169-0b3f22f8ab5c None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:32.382472 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396efeba-e1b6-4adc-805d-399c656bdf94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:32.383174 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396efeba-e1b6-4adc-805d-399c656bdf94 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:32.383466 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396efeba-e1b6-4adc-805d-399c656bdf94 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:32.383768 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396efeba-e1b6-4adc-805d-399c656bdf94 None admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:32.384550 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396efeba-e1b6-4adc-805d-399c656bdf94 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:02:32.384868 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396efeba-e1b6-4adc-805d-399c656bdf94 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:32.386378 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396efeba-e1b6-4adc-805d-399c656bdf94 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:32.388660 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 123/241] 10.222.0.43 () {60 vars in 1132 bytes} [Wed Jun 22 10:02:32 2022] POST /identity/v3/users => generated 293 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:02:32.403056 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 119/242] 10.222.0.43 () {56 vars in 1101 bytes} [Wed Jun 22 10:02:32 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:02:32.414904 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1113f9-a689-4859-9169-0b3f22f8ab5c None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:32.561274 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:32.565758 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1113f9-a689-4859-9169-0b3f22f8ab5c None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:32.608517 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aa3fd5-245e-47c8-8bf3-2448d78f1f00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:32.609416 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aa3fd5-245e-47c8-8bf3-2448d78f1f00 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:32.609730 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aa3fd5-245e-47c8-8bf3-2448d78f1f00 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:32.610017 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aa3fd5-245e-47c8-8bf3-2448d78f1f00 None admin] PATH_INFO: `/v3/users/8dbbebe41cc543c3885e78af45c14f90` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:32.626447 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38aa3fd5-245e-47c8-8bf3-2448d78f1f00 None admin] RBAC: Authorizing `identity:get_user(user_id=8dbbebe41cc543c3885e78af45c14f90)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:32.627960 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38aa3fd5-245e-47c8-8bf3-2448d78f1f00 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:32.630215 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 124/243] 10.222.0.43 () {56 vars in 1177 bytes} [Wed Jun 22 10:02:32 2022] GET /identity/v3/users/8dbbebe41cc543c3885e78af45c14f90 => generated 297 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:02:32.635649 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396efeba-e1b6-4adc-805d-399c656bdf94 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:32.752696 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396efeba-e1b6-4adc-805d-399c656bdf94 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:32.780060 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:32.797052 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba80a85-408d-428b-80d5-014e79118a0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:32.797656 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba80a85-408d-428b-80d5-014e79118a0c None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:32.798345 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba80a85-408d-428b-80d5-014e79118a0c None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:32.798345 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba80a85-408d-428b-80d5-014e79118a0c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:32.875401 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba80a85-408d-428b-80d5-014e79118a0c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:32.876947 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba80a85-408d-428b-80d5-014e79118a0c None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:32.953116 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91937ee4-2c8a-4552-bd55-63fe371dd170 None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:32.953645 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91937ee4-2c8a-4552-bd55-63fe371dd170 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:32.953645 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91937ee4-2c8a-4552-bd55-63fe371dd170 None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:32.957028 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 125/244] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:02:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 10:02:32.962500 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41e2dbd-ebde-425b-bb2e-dc3e51995180 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:32.962787 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41e2dbd-ebde-425b-bb2e-dc3e51995180 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:32.963067 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41e2dbd-ebde-425b-bb2e-dc3e51995180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:32.992736 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-d41e2dbd-ebde-425b-bb2e-dc3e51995180 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:02:32.994398 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-d41e2dbd-ebde-425b-bb2e-dc3e51995180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:02:32.998227 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 120/245] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Jun 22 10:02:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 10:02:33.008354 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba80a85-408d-428b-80d5-014e79118a0c None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:33.039889 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:33.093348 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 126/246] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:02:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 10:02:33.121380 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41e2dbd-ebde-425b-bb2e-dc3e51995180 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:33.139775 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba80a85-408d-428b-80d5-014e79118a0c None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:33.179335 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85592c1e-52cc-4994-86bf-40bbb5ba4a98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:33.180207 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85592c1e-52cc-4994-86bf-40bbb5ba4a98 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:33.180488 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85592c1e-52cc-4994-86bf-40bbb5ba4a98 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:33.180766 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85592c1e-52cc-4994-86bf-40bbb5ba4a98 None admin] PATH_INFO: `/v3/projects/d828ff8720114b1b9da6709b7e51dcee` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:33.182428 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85592c1e-52cc-4994-86bf-40bbb5ba4a98 None admin] RBAC: Authorizing `identity:get_project(project_id=d828ff8720114b1b9da6709b7e51dcee)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:33.183453 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85592c1e-52cc-4994-86bf-40bbb5ba4a98 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:33.185516 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 121/247] 10.222.0.43 () {56 vars in 1186 bytes} [Wed Jun 22 10:02:33 2022] GET /identity/v3/projects/d828ff8720114b1b9da6709b7e51dcee => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:02:33.197783 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85592c1e-52cc-4994-86bf-40bbb5ba4a98 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:33.234560 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:33.254809 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41e2dbd-ebde-425b-bb2e-dc3e51995180 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:33.293034 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2819bcc9-1533-44b9-8f24-5d8cfd0dc1e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:33.294325 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2819bcc9-1533-44b9-8f24-5d8cfd0dc1e7 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:33.294794 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2819bcc9-1533-44b9-8f24-5d8cfd0dc1e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:33.295245 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2819bcc9-1533-44b9-8f24-5d8cfd0dc1e7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:33.307599 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2819bcc9-1533-44b9-8f24-5d8cfd0dc1e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:02:33.315954 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-2819bcc9-1533-44b9-8f24-5d8cfd0dc1e7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 10:02:33.315954 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:02:33.315954 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:02:33.315954 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:02:33.315954 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:02:33.315954 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:02:33.315954 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:02:33.315954 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:02:33.315954 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:02:33.315954 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:02:33.315954 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:02:33.315954 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:02:33.315954 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:02:33.315954 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:02:33.315954 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:02:33.315954 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:02:33.316839 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:02:33.316839 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:02:33.316839 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:02:33.316839 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:02:33.316839 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:02:33.316839 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:02:33.316839 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:02:33.316839 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:02:33.316839 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:02:33.316839 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:02:33.316839 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:02:33.316839 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( Jun 22 10:02:33.316839 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:02:33.316839 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:02:33.316839 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:02:33.316839 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:02:33.318094 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:02:33.318094 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:02:33.318094 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:02:33.318094 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:02:33.318094 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:02:33.318094 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:02:33.318094 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:02:33.318094 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:02:33.318094 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:02:33.318094 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:02:33.318094 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 10:02:33.318094 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:02:33.319234 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:33.320907 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 127/248] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Jun 22 10:02:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:02:33.326831 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2819bcc9-1533-44b9-8f24-5d8cfd0dc1e7 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:33.347868 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85592c1e-52cc-4994-86bf-40bbb5ba4a98 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:33.437954 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2819bcc9-1533-44b9-8f24-5d8cfd0dc1e7 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:33.439528 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a5d1f4-5e3b-481d-937c-15056e86e266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:33.440203 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a5d1f4-5e3b-481d-937c-15056e86e266 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:33.440487 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a5d1f4-5e3b-481d-937c-15056e86e266 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:33.440761 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a5d1f4-5e3b-481d-937c-15056e86e266 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:33.441606 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a5d1f4-5e3b-481d-937c-15056e86e266 None admin] RBAC: Adding query filter params (role.id=4a03c0e749d84649a230831b1e6644a4, scope.project.id=d828ff8720114b1b9da6709b7e51dcee, user.id=8dbbebe41cc543c3885e78af45c14f90) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:02:33.441969 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a5d1f4-5e3b-481d-937c-15056e86e266 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:33.443513 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a5d1f4-5e3b-481d-937c-15056e86e266 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:33.460767 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 122/249] 10.222.0.43 () {56 vars in 1374 bytes} [Wed Jun 22 10:02:33 2022] GET /identity/v3/role_assignments?user.id=8dbbebe41cc543c3885e78af45c14f90&scope.project.id=d828ff8720114b1b9da6709b7e51dcee&role.id=4a03c0e749d84649a230831b1e6644a4 => generated 259 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:02:33.486608 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97112605-8877-41a5-873d-81e6fbfe931f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:33.487297 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97112605-8877-41a5-873d-81e6fbfe931f None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:33.487588 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97112605-8877-41a5-873d-81e6fbfe931f None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:33.487865 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97112605-8877-41a5-873d-81e6fbfe931f None admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:33.488634 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97112605-8877-41a5-873d-81e6fbfe931f None admin] RBAC: Adding query filter params (name=member) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:02:33.488943 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97112605-8877-41a5-873d-81e6fbfe931f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:33.491095 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97112605-8877-41a5-873d-81e6fbfe931f None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:33.500510 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 128/250] 10.222.0.43 () {56 vars in 1101 bytes} [Wed Jun 22 10:02:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:02:33.506269 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a5d1f4-5e3b-481d-937c-15056e86e266 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:33.670810 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a5d1f4-5e3b-481d-937c-15056e86e266 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:33.715956 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cd8b8e-374e-4c35-9e87-6187fc3d6076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:33.716775 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cd8b8e-374e-4c35-9e87-6187fc3d6076 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:33.717056 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cd8b8e-374e-4c35-9e87-6187fc3d6076 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:33.717333 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cd8b8e-374e-4c35-9e87-6187fc3d6076 None admin] PATH_INFO: `/v3/users/1db2f00cb1684d7f982b81a1db9ebb03` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:33.722415 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cd8b8e-374e-4c35-9e87-6187fc3d6076 None admin] RBAC: Authorizing `identity:get_user(user_id=1db2f00cb1684d7f982b81a1db9ebb03)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:33.724766 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cd8b8e-374e-4c35-9e87-6187fc3d6076 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:33.726518 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 123/251] 10.222.0.43 () {56 vars in 1177 bytes} [Wed Jun 22 10:02:33 2022] GET /identity/v3/users/1db2f00cb1684d7f982b81a1db9ebb03 => generated 297 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:02:33.732095 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97112605-8877-41a5-873d-81e6fbfe931f None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:33.749668 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:33.857228 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5833876-aaab-4c96-ada2-3b202ecbed72 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:33.857793 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5833876-aaab-4c96-ada2-3b202ecbed72 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:33.857793 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5833876-aaab-4c96-ada2-3b202ecbed72 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:33.859389 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 124/252] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:02:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:02:33.863023 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97112605-8877-41a5-873d-81e6fbfe931f None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:33.864664 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158e3f2c-b1fe-4f4c-b076-103330c31b97 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:33.865034 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158e3f2c-b1fe-4f4c-b076-103330c31b97 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:33.865226 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158e3f2c-b1fe-4f4c-b076-103330c31b97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:33.887676 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-158e3f2c-b1fe-4f4c-b076-103330c31b97 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:02:33.889911 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-158e3f2c-b1fe-4f4c-b076-103330c31b97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:02:33.923236 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:33.925919 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4f9b00-6e73-4779-87a5-a26629490d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:33.927316 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4f9b00-6e73-4779-87a5-a26629490d18 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:33.927791 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4f9b00-6e73-4779-87a5-a26629490d18 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:33.928228 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4f9b00-6e73-4779-87a5-a26629490d18 None admin] PATH_INFO: `/v3/projects/d828ff8720114b1b9da6709b7e51dcee` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:33.930057 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4f9b00-6e73-4779-87a5-a26629490d18 None admin] RBAC: Authorizing `identity:get_project(project_id=d828ff8720114b1b9da6709b7e51dcee)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:33.931704 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4f9b00-6e73-4779-87a5-a26629490d18 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:33.933659 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 129/253] 10.222.0.43 () {56 vars in 1186 bytes} [Wed Jun 22 10:02:33 2022] GET /identity/v3/projects/d828ff8720114b1b9da6709b7e51dcee => generated 302 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:02:33.935071 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cd2d48-d66a-4a1f-91bc-872691cc7418 None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:33.935527 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cd2d48-d66a-4a1f-91bc-872691cc7418 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:33.935954 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cd2d48-d66a-4a1f-91bc-872691cc7418 None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:33.937352 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 130/254] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:02:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:02:33.943510 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cd2d48-d66a-4a1f-91bc-872691cc7418 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:33.991529 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 125/255] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:02:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 10:02:33.992753 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94f07b4-2a60-41be-bda1-fbdf70ace87f None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:33.993044 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94f07b4-2a60-41be-bda1-fbdf70ace87f None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:33.993327 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94f07b4-2a60-41be-bda1-fbdf70ace87f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:34.010242 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-b94f07b4-2a60-41be-bda1-fbdf70ace87f None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:02:34.011430 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-b94f07b4-2a60-41be-bda1-fbdf70ace87f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:02:34.057100 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:34.101390 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 126/256] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:02:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 10:02:34.103637 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94f07b4-2a60-41be-bda1-fbdf70ace87f None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:34.148199 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cd2d48-d66a-4a1f-91bc-872691cc7418 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:34.211595 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:34.232892 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94f07b4-2a60-41be-bda1-fbdf70ace87f None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:34.247318 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9205645e-5c08-41ad-ae91-47c10c15577b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:34.248168 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9205645e-5c08-41ad-ae91-47c10c15577b None admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:34.248506 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9205645e-5c08-41ad-ae91-47c10c15577b None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:34.248713 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9205645e-5c08-41ad-ae91-47c10c15577b None admin] PATH_INFO: `/v3/projects/d828ff8720114b1b9da6709b7e51dcee/users/1db2f00cb1684d7f982b81a1db9ebb03/roles/9f88c83743f745a9a785a2f454753f06` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:34.256528 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9205645e-5c08-41ad-ae91-47c10c15577b None admin] RBAC: Authorizing `identity:create_grant(project_id=d828ff8720114b1b9da6709b7e51dcee, user_id=1db2f00cb1684d7f982b81a1db9ebb03, role_id=9f88c83743f745a9a785a2f454753f06)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:34.258060 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9205645e-5c08-41ad-ae91-47c10c15577b None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:34.279372 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e95c926-4371-4ced-98ce-dc6e3fe7f697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:34.280656 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e95c926-4371-4ced-98ce-dc6e3fe7f697 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:34.281389 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e95c926-4371-4ced-98ce-dc6e3fe7f697 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:34.282299 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e95c926-4371-4ced-98ce-dc6e3fe7f697 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:34.296520 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e95c926-4371-4ced-98ce-dc6e3fe7f697 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:02:34.306372 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-0e95c926-4371-4ced-98ce-dc6e3fe7f697 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 10:02:34.306372 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:02:34.306372 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:02:34.306372 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:02:34.306372 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:02:34.306372 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:02:34.306372 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:02:34.306372 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:02:34.306372 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:02:34.306372 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:02:34.306372 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:02:34.306372 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:02:34.306372 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:02:34.306372 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:02:34.306372 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:02:34.306372 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:02:34.307256 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:02:34.307256 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:02:34.307256 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:02:34.307256 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:02:34.307256 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:02:34.307256 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:02:34.307256 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:02:34.307256 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:02:34.307256 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:02:34.307256 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:02:34.307256 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:02:34.307256 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jun 22 10:02:34.307256 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:02:34.307256 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:02:34.307256 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:02:34.307256 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:02:34.308024 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:02:34.308024 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:02:34.308024 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:02:34.308024 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:02:34.308024 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:02:34.308024 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:02:34.308024 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:02:34.308024 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:02:34.308024 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:02:34.308024 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:02:34.308024 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 10:02:34.308024 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:02:34.309273 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 131/257] 10.222.0.43 () {58 vars in 1439 bytes} [Wed Jun 22 10:02:33 2022] PUT /identity/v3/projects/d828ff8720114b1b9da6709b7e51dcee/users/1db2f00cb1684d7f982b81a1db9ebb03/roles/9f88c83743f745a9a785a2f454753f06 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:02:34.309273 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9205645e-5c08-41ad-ae91-47c10c15577b None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:34.311353 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 127/258] 10.222.0.43 () {56 vars in 1114 bytes} [Wed Jun 22 10:02:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:02:34.322032 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e95c926-4371-4ced-98ce-dc6e3fe7f697 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:34.446342 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9205645e-5c08-41ad-ae91-47c10c15577b None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:34.512856 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02db2b5d-a8c7-4d45-ac91-d9794aa064b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:34.514072 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02db2b5d-a8c7-4d45-ac91-d9794aa064b8 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:34.514560 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02db2b5d-a8c7-4d45-ac91-d9794aa064b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:34.515178 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02db2b5d-a8c7-4d45-ac91-d9794aa064b8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:34.518740 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:34.535527 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e95c926-4371-4ced-98ce-dc6e3fe7f697 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:34.540753 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02db2b5d-a8c7-4d45-ac91-d9794aa064b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:02:34.557961 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-02db2b5d-a8c7-4d45-ac91-d9794aa064b8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 10:02:34.557961 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:02:34.557961 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:02:34.557961 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:02:34.557961 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:02:34.557961 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:02:34.557961 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:02:34.557961 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:02:34.557961 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:02:34.557961 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:02:34.557961 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:02:34.557961 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:02:34.557961 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:02:34.557961 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:02:34.557961 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:02:34.557961 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:02:34.558979 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:02:34.558979 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:02:34.558979 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:02:34.558979 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:02:34.558979 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:02:34.558979 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:02:34.558979 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:02:34.558979 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:02:34.558979 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:02:34.558979 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:02:34.558979 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:02:34.558979 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( Jun 22 10:02:34.558979 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:02:34.558979 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:02:34.558979 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:02:34.558979 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:02:34.559791 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:02:34.559791 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:02:34.559791 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:02:34.559791 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:02:34.559791 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:02:34.559791 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:02:34.559791 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:02:34.559791 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:02:34.559791 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:02:34.559791 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:02:34.559791 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 10:02:34.559791 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:02:34.560828 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 132/259] 10.222.0.43 () {56 vars in 1096 bytes} [Wed Jun 22 10:02:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:02:34.565546 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02db2b5d-a8c7-4d45-ac91-d9794aa064b8 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:34.630981 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63af9671-b069-4e3d-98a0-7ad92acc8a0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:34.632205 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63af9671-b069-4e3d-98a0-7ad92acc8a0c None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:34.632699 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63af9671-b069-4e3d-98a0-7ad92acc8a0c None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:34.633182 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63af9671-b069-4e3d-98a0-7ad92acc8a0c None admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:34.634290 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63af9671-b069-4e3d-98a0-7ad92acc8a0c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:02:34.634934 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63af9671-b069-4e3d-98a0-7ad92acc8a0c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:34.636566 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63af9671-b069-4e3d-98a0-7ad92acc8a0c None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:34.669559 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 128/260] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Jun 22 10:02:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:02:34.687058 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63af9671-b069-4e3d-98a0-7ad92acc8a0c None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:34.697410 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:34.740400 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02db2b5d-a8c7-4d45-ac91-d9794aa064b8 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:34.808950 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63af9671-b069-4e3d-98a0-7ad92acc8a0c None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:34.845622 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35ae976-fa3c-4459-81b9-2f6b34e9b6bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:34.846399 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a436a30-0619-4aed-8f76-0517a53d2976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:34.846523 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35ae976-fa3c-4459-81b9-2f6b34e9b6bb None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:34.846802 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35ae976-fa3c-4459-81b9-2f6b34e9b6bb None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:34.847081 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35ae976-fa3c-4459-81b9-2f6b34e9b6bb None admin] PATH_INFO: `/v3/users/feadd6c7a81147e4b44da3c54c894735` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:34.847181 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a436a30-0619-4aed-8f76-0517a53d2976 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:34.847368 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a436a30-0619-4aed-8f76-0517a53d2976 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:34.847649 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a436a30-0619-4aed-8f76-0517a53d2976 None admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:34.848314 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35ae976-fa3c-4459-81b9-2f6b34e9b6bb None admin] RBAC: Authorizing `identity:get_user(user_id=feadd6c7a81147e4b44da3c54c894735)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:34.849005 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a436a30-0619-4aed-8f76-0517a53d2976 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:02:34.849565 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a436a30-0619-4aed-8f76-0517a53d2976 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:34.850597 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35ae976-fa3c-4459-81b9-2f6b34e9b6bb None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:34.851007 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a436a30-0619-4aed-8f76-0517a53d2976 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:34.852269 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 129/261] 10.222.0.43 () {56 vars in 1177 bytes} [Wed Jun 22 10:02:34 2022] GET /identity/v3/users/feadd6c7a81147e4b44da3c54c894735 => generated 283 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:02:34.858356 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35ae976-fa3c-4459-81b9-2f6b34e9b6bb None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:34.865327 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 133/262] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Jun 22 10:02:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:02:34.870778 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a436a30-0619-4aed-8f76-0517a53d2976 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:34.942459 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:34.969304 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35ae976-fa3c-4459-81b9-2f6b34e9b6bb None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:34.978560 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:35.005639 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a7fd28-baa5-429a-8b7d-c6d593c1a977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:35.006428 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a7fd28-baa5-429a-8b7d-c6d593c1a977 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:35.006715 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a7fd28-baa5-429a-8b7d-c6d593c1a977 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:35.006994 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a7fd28-baa5-429a-8b7d-c6d593c1a977 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:35.043299 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a436a30-0619-4aed-8f76-0517a53d2976 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:35.080337 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a7fd28-baa5-429a-8b7d-c6d593c1a977 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:35.081760 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a7fd28-baa5-429a-8b7d-c6d593c1a977 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:35.123496 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2daa23-f548-49d4-83a6-0d11e2873f32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:35.125127 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2daa23-f548-49d4-83a6-0d11e2873f32 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:35.125616 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2daa23-f548-49d4-83a6-0d11e2873f32 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:35.126168 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2daa23-f548-49d4-83a6-0d11e2873f32 None admin] PATH_INFO: `/v3/users/feadd6c7a81147e4b44da3c54c894735` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:35.130598 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2daa23-f548-49d4-83a6-0d11e2873f32 None admin] RBAC: Authorizing `identity:get_user(user_id=feadd6c7a81147e4b44da3c54c894735)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:35.132419 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2daa23-f548-49d4-83a6-0d11e2873f32 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:35.134871 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 134/263] 10.222.0.43 () {56 vars in 1177 bytes} [Wed Jun 22 10:02:34 2022] GET /identity/v3/users/feadd6c7a81147e4b44da3c54c894735 => generated 283 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:02:35.139780 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2daa23-f548-49d4-83a6-0d11e2873f32 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:35.162101 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:35.193830 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 130/264] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Jun 22 10:02:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 10:02:35.198406 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a7fd28-baa5-429a-8b7d-c6d593c1a977 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:35.309129 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a7fd28-baa5-429a-8b7d-c6d593c1a977 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:35.344980 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690d22b4-6e70-477c-a148-e1bff8d14afc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:35.345796 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690d22b4-6e70-477c-a148-e1bff8d14afc None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:35.346083 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690d22b4-6e70-477c-a148-e1bff8d14afc None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:35.346363 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690d22b4-6e70-477c-a148-e1bff8d14afc None admin] PATH_INFO: `/v3/projects/d828ff8720114b1b9da6709b7e51dcee` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:35.346566 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2daa23-f548-49d4-83a6-0d11e2873f32 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:35.347539 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690d22b4-6e70-477c-a148-e1bff8d14afc None admin] RBAC: Authorizing `identity:get_project(project_id=d828ff8720114b1b9da6709b7e51dcee)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:35.353805 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690d22b4-6e70-477c-a148-e1bff8d14afc None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:35.356268 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 131/265] 10.222.0.43 () {56 vars in 1186 bytes} [Wed Jun 22 10:02:35 2022] GET /identity/v3/projects/d828ff8720114b1b9da6709b7e51dcee => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:02:35.358291 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690d22b4-6e70-477c-a148-e1bff8d14afc None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:35.386106 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:35.408000 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d95682-cead-4fd8-8705-e2a99c251188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:35.408670 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d95682-cead-4fd8-8705-e2a99c251188 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:35.408965 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d95682-cead-4fd8-8705-e2a99c251188 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:35.409248 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d95682-cead-4fd8-8705-e2a99c251188 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:35.450054 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:35.570321 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d95682-cead-4fd8-8705-e2a99c251188 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:35.571819 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d95682-cead-4fd8-8705-e2a99c251188 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:35.585945 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690d22b4-6e70-477c-a148-e1bff8d14afc None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:35.635557 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faa5110-2d10-47be-b493-87a9e9ce0ec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:35.636149 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faa5110-2d10-47be-b493-87a9e9ce0ec2 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:35.636443 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faa5110-2d10-47be-b493-87a9e9ce0ec2 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:35.636725 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faa5110-2d10-47be-b493-87a9e9ce0ec2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:35.637576 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faa5110-2d10-47be-b493-87a9e9ce0ec2 None admin] RBAC: Adding query filter params (role.id=23a6a1fcd69d4210a8f2b45559b65aea, scope.project.id=d828ff8720114b1b9da6709b7e51dcee, user.id=feadd6c7a81147e4b44da3c54c894735) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:02:35.637924 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faa5110-2d10-47be-b493-87a9e9ce0ec2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:35.639406 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faa5110-2d10-47be-b493-87a9e9ce0ec2 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:35.656184 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 132/266] 10.222.0.43 () {56 vars in 1374 bytes} [Wed Jun 22 10:02:35 2022] GET /identity/v3/role_assignments?user.id=feadd6c7a81147e4b44da3c54c894735&scope.project.id=d828ff8720114b1b9da6709b7e51dcee&role.id=23a6a1fcd69d4210a8f2b45559b65aea => generated 608 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:02:35.720819 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 135/267] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Jun 22 10:02:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 581 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 22 10:02:35.727563 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faa5110-2d10-47be-b493-87a9e9ce0ec2 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:35.839597 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faa5110-2d10-47be-b493-87a9e9ce0ec2 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:35.850003 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:35.889771 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681a63c7-61f2-4d6e-9bf4-0f8b32082cfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:35.890633 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681a63c7-61f2-4d6e-9bf4-0f8b32082cfa None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:35.890924 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681a63c7-61f2-4d6e-9bf4-0f8b32082cfa None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:35.891258 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681a63c7-61f2-4d6e-9bf4-0f8b32082cfa None admin] PATH_INFO: `/v3/projects/d828ff8720114b1b9da6709b7e51dcee` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:35.892462 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681a63c7-61f2-4d6e-9bf4-0f8b32082cfa None admin] RBAC: Authorizing `identity:get_project(project_id=d828ff8720114b1b9da6709b7e51dcee)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:35.893977 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681a63c7-61f2-4d6e-9bf4-0f8b32082cfa None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:35.899024 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 133/268] 10.222.0.43 () {56 vars in 1186 bytes} [Wed Jun 22 10:02:35 2022] GET /identity/v3/projects/d828ff8720114b1b9da6709b7e51dcee => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:02:35.904623 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d95682-cead-4fd8-8705-e2a99c251188 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:35.940918 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:36.029668 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d95682-cead-4fd8-8705-e2a99c251188 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:36.065306 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43824f52-95e1-4290-93b4-65e99374fe2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:36.065997 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43824f52-95e1-4290-93b4-65e99374fe2a None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:36.066283 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43824f52-95e1-4290-93b4-65e99374fe2a None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:36.066562 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43824f52-95e1-4290-93b4-65e99374fe2a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:36.068502 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43824f52-95e1-4290-93b4-65e99374fe2a None admin] RBAC: Adding query filter params (role.id=26d9c2ab5dfc4e6d9ca80c6014123906, scope.project.id=d828ff8720114b1b9da6709b7e51dcee, user.id=feadd6c7a81147e4b44da3c54c894735) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:02:36.068819 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43824f52-95e1-4290-93b4-65e99374fe2a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:36.070323 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43824f52-95e1-4290-93b4-65e99374fe2a None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:36.076687 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 136/269] 10.222.0.43 () {56 vars in 1374 bytes} [Wed Jun 22 10:02:35 2022] GET /identity/v3/role_assignments?user.id=feadd6c7a81147e4b44da3c54c894735&scope.project.id=d828ff8720114b1b9da6709b7e51dcee&role.id=26d9c2ab5dfc4e6d9ca80c6014123906 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:02:36.185852 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3881e3-926f-4ac3-adf8-ea76ad9776c4 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:36.186290 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3881e3-926f-4ac3-adf8-ea76ad9776c4 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:36.186714 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3881e3-926f-4ac3-adf8-ea76ad9776c4 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:36.189117 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 134/270] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:02:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:02:36.191405 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df574490-ccc5-4db8-a02f-4ae1fba54c81 None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:36.191881 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df574490-ccc5-4db8-a02f-4ae1fba54c81 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:36.192298 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df574490-ccc5-4db8-a02f-4ae1fba54c81 None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:36.196279 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0418cef9-534c-4cdb-8ce6-1458a7f27577 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:36.196708 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0418cef9-534c-4cdb-8ce6-1458a7f27577 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:36.197130 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0418cef9-534c-4cdb-8ce6-1458a7f27577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:36.203956 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 137/271] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:02:36 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:02:36.214204 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b52e5c-f602-48c8-8f7b-2c5e1279b2b0 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:36.214536 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b52e5c-f602-48c8-8f7b-2c5e1279b2b0 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:36.214763 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b52e5c-f602-48c8-8f7b-2c5e1279b2b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:36.241637 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-0418cef9-534c-4cdb-8ce6-1458a7f27577 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:02:36.242891 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-0418cef9-534c-4cdb-8ce6-1458a7f27577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:02:36.251774 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-77b52e5c-f602-48c8-8f7b-2c5e1279b2b0 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:02:36.253519 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-77b52e5c-f602-48c8-8f7b-2c5e1279b2b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:02:36.381847 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 135/272] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:02:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 10:02:36.385539 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 138/273] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:02:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 10:02:36.404091 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0418cef9-534c-4cdb-8ce6-1458a7f27577 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:36.413275 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b52e5c-f602-48c8-8f7b-2c5e1279b2b0 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:36.440684 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:36.545829 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0418cef9-534c-4cdb-8ce6-1458a7f27577 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:36.549013 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:36.549256 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b52e5c-f602-48c8-8f7b-2c5e1279b2b0 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:36.590714 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a01671-259c-4b59-8ddd-0cfff6bf124b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:36.591515 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a01671-259c-4b59-8ddd-0cfff6bf124b None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:36.591760 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f9b8ed-0c82-43db-b8fe-4f3991bd6af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:36.591871 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a01671-259c-4b59-8ddd-0cfff6bf124b None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:36.592087 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a01671-259c-4b59-8ddd-0cfff6bf124b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:36.592521 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f9b8ed-0c82-43db-b8fe-4f3991bd6af2 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:36.592809 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f9b8ed-0c82-43db-b8fe-4f3991bd6af2 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:36.593089 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f9b8ed-0c82-43db-b8fe-4f3991bd6af2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:36.594278 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f9b8ed-0c82-43db-b8fe-4f3991bd6af2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:36.595738 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f9b8ed-0c82-43db-b8fe-4f3991bd6af2 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:36.597549 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 139/274] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jun 22 10:02:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:02:36.599105 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a198a0c5-d019-41e7-8d5a-b0510609b96e None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:36.599646 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a198a0c5-d019-41e7-8d5a-b0510609b96e None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:36.599929 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a198a0c5-d019-41e7-8d5a-b0510609b96e None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:36.605740 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 140/275] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:02:36 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:02:36.606439 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a198a0c5-d019-41e7-8d5a-b0510609b96e None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:36.607019 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a01671-259c-4b59-8ddd-0cfff6bf124b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:02:36.615164 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-42a01671-259c-4b59-8ddd-0cfff6bf124b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 10:02:36.615164 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:02:36.615164 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:02:36.615164 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:02:36.615164 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:02:36.615164 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:02:36.615164 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:02:36.615164 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:02:36.615164 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:02:36.615164 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:02:36.615164 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:02:36.615164 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:02:36.615164 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:02:36.615164 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:02:36.615164 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:02:36.615164 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:02:36.616168 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:02:36.616168 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:02:36.616168 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:02:36.616168 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:02:36.616168 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:02:36.616168 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:02:36.616168 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:02:36.616168 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:02:36.616168 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:02:36.616168 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:02:36.616168 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:02:36.616168 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jun 22 10:02:36.616168 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:02:36.616168 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:02:36.616168 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:02:36.616168 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:02:36.617110 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:02:36.617110 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:02:36.617110 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:02:36.617110 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:02:36.617110 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:02:36.617110 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:02:36.617110 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:02:36.617110 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:02:36.617110 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:02:36.617110 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:02:36.617110 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 10:02:36.617110 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:02:36.617110 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 136/276] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Jun 22 10:02:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:02:36.619231 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05a2e79-b502-4cd6-b720-118c19fc199f None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:36.619626 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05a2e79-b502-4cd6-b720-118c19fc199f None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:36.620000 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05a2e79-b502-4cd6-b720-118c19fc199f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:36.641179 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-f05a2e79-b502-4cd6-b720-118c19fc199f None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:02:36.643052 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-f05a2e79-b502-4cd6-b720-118c19fc199f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:02:36.702251 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:36.716787 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a198a0c5-d019-41e7-8d5a-b0510609b96e None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:36.719622 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 137/277] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:02:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 10:02:36.722579 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05a2e79-b502-4cd6-b720-118c19fc199f None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:36.752466 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ed5eda-7e70-4b3a-bcf6-fa5131d74097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:36.753136 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ed5eda-7e70-4b3a-bcf6-fa5131d74097 None admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:36.753425 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ed5eda-7e70-4b3a-bcf6-fa5131d74097 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:36.753726 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ed5eda-7e70-4b3a-bcf6-fa5131d74097 None admin] PATH_INFO: `/v3/users` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:36.754467 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ed5eda-7e70-4b3a-bcf6-fa5131d74097 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:36.757239 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ed5eda-7e70-4b3a-bcf6-fa5131d74097 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:36.778326 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 141/278] 10.222.0.43 () {60 vars in 1132 bytes} [Wed Jun 22 10:02:36 2022] POST /identity/v3/users => generated 293 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:02:36.786234 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ed5eda-7e70-4b3a-bcf6-fa5131d74097 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:36.873180 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:36.882111 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05a2e79-b502-4cd6-b720-118c19fc199f None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:36.924207 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a887f1-c7a8-45a6-ae89-a3f2f75e6f2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:36.924894 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a887f1-c7a8-45a6-ae89-a3f2f75e6f2e None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:36.925310 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a887f1-c7a8-45a6-ae89-a3f2f75e6f2e None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:36.925663 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a887f1-c7a8-45a6-ae89-a3f2f75e6f2e None admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:36.927093 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a887f1-c7a8-45a6-ae89-a3f2f75e6f2e None admin] RBAC: Adding query filter params (name=member) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:02:36.927527 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a887f1-c7a8-45a6-ae89-a3f2f75e6f2e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:36.928940 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ed5eda-7e70-4b3a-bcf6-fa5131d74097 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:36.929053 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a887f1-c7a8-45a6-ae89-a3f2f75e6f2e None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:36.941730 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 138/279] 10.222.0.43 () {56 vars in 1101 bytes} [Wed Jun 22 10:02:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:02:36.946770 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a887f1-c7a8-45a6-ae89-a3f2f75e6f2e None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:36.987687 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6582780-c840-4b4f-8219-a9dd0a9f8cf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:36.987687 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6582780-c840-4b4f-8219-a9dd0a9f8cf0 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:36.987687 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6582780-c840-4b4f-8219-a9dd0a9f8cf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:36.987687 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6582780-c840-4b4f-8219-a9dd0a9f8cf0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:37.002604 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6582780-c840-4b4f-8219-a9dd0a9f8cf0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:02:37.013768 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-b6582780-c840-4b4f-8219-a9dd0a9f8cf0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 10:02:37.013768 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:02:37.013768 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:02:37.013768 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:02:37.013768 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:02:37.013768 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:02:37.013768 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:02:37.013768 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:02:37.013768 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:02:37.013768 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:02:37.013768 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:02:37.013768 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:02:37.013768 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:02:37.013768 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:02:37.013768 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:02:37.013768 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:02:37.018290 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:02:37.018290 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:02:37.018290 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:02:37.018290 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:02:37.018290 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:02:37.018290 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:02:37.018290 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:02:37.018290 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:02:37.018290 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:02:37.018290 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:02:37.018290 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:02:37.018290 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( Jun 22 10:02:37.018290 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:02:37.018290 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:02:37.018290 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:02:37.018290 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:02:37.019100 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:02:37.019100 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:02:37.019100 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:02:37.019100 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:02:37.019100 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:02:37.019100 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:02:37.019100 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:02:37.019100 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:02:37.019100 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:02:37.019100 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:02:37.019100 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 10:02:37.019100 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:02:37.019100 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 142/280] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Jun 22 10:02:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:02:37.023727 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6582780-c840-4b4f-8219-a9dd0a9f8cf0 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:37.029203 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:37.094155 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a887f1-c7a8-45a6-ae89-a3f2f75e6f2e None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:37.152108 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12db1eb-3375-480e-a284-ee59b2f5fc72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:37.153451 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12db1eb-3375-480e-a284-ee59b2f5fc72 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:37.153773 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12db1eb-3375-480e-a284-ee59b2f5fc72 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:37.154060 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12db1eb-3375-480e-a284-ee59b2f5fc72 None admin] PATH_INFO: `/v3/users/cb7e442a13f14a579e0f63bc6fecf27c` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:37.170379 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12db1eb-3375-480e-a284-ee59b2f5fc72 None admin] RBAC: Authorizing `identity:get_user(user_id=cb7e442a13f14a579e0f63bc6fecf27c)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:37.171865 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12db1eb-3375-480e-a284-ee59b2f5fc72 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:37.173777 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 139/281] 10.222.0.43 () {56 vars in 1177 bytes} [Wed Jun 22 10:02:36 2022] GET /identity/v3/users/cb7e442a13f14a579e0f63bc6fecf27c => generated 293 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:02:37.179869 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12db1eb-3375-480e-a284-ee59b2f5fc72 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:37.183778 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6582780-c840-4b4f-8219-a9dd0a9f8cf0 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:37.198747 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:37.233190 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12dc740-6401-4d8a-a205-4938763b5276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:37.234014 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12dc740-6401-4d8a-a205-4938763b5276 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:37.234308 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12dc740-6401-4d8a-a205-4938763b5276 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:37.234591 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12dc740-6401-4d8a-a205-4938763b5276 None admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:37.235477 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12dc740-6401-4d8a-a205-4938763b5276 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:02:37.235796 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12dc740-6401-4d8a-a205-4938763b5276 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:37.237328 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12dc740-6401-4d8a-a205-4938763b5276 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:37.249835 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 143/282] 10.222.0.43 () {56 vars in 1101 bytes} [Wed Jun 22 10:02:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:02:37.256616 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12dc740-6401-4d8a-a205-4938763b5276 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:37.338200 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:37.379432 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12dc740-6401-4d8a-a205-4938763b5276 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:37.403688 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12db1eb-3375-480e-a284-ee59b2f5fc72 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:37.418902 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea77aa2-8c6f-471e-864d-4f7ffffc1730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:37.419782 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea77aa2-8c6f-471e-864d-4f7ffffc1730 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:37.420063 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea77aa2-8c6f-471e-864d-4f7ffffc1730 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:37.420338 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea77aa2-8c6f-471e-864d-4f7ffffc1730 None admin] PATH_INFO: `/v3/users/8dbbebe41cc543c3885e78af45c14f90` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:37.430564 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea77aa2-8c6f-471e-864d-4f7ffffc1730 None admin] RBAC: Authorizing `identity:get_user(user_id=8dbbebe41cc543c3885e78af45c14f90)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:37.432066 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea77aa2-8c6f-471e-864d-4f7ffffc1730 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:37.433956 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 144/283] 10.222.0.43 () {56 vars in 1177 bytes} [Wed Jun 22 10:02:37 2022] GET /identity/v3/users/8dbbebe41cc543c3885e78af45c14f90 => generated 297 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:02:37.442792 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea77aa2-8c6f-471e-864d-4f7ffffc1730 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:37.476825 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bf0338-5ef4-45af-a99b-e61dd47c8319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:37.477873 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bf0338-5ef4-45af-a99b-e61dd47c8319 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:37.478168 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bf0338-5ef4-45af-a99b-e61dd47c8319 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:37.478453 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bf0338-5ef4-45af-a99b-e61dd47c8319 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:37.479582 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bf0338-5ef4-45af-a99b-e61dd47c8319 None admin] RBAC: Adding query filter params (role.id=9f88c83743f745a9a785a2f454753f06, user.id=cb7e442a13f14a579e0f63bc6fecf27c, scope.system=all) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:02:37.479903 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bf0338-5ef4-45af-a99b-e61dd47c8319 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:37.481862 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bf0338-5ef4-45af-a99b-e61dd47c8319 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:37.489309 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 140/284] 10.222.0.43 () {56 vars in 1308 bytes} [Wed Jun 22 10:02:37 2022] GET /identity/v3/role_assignments?user.id=cb7e442a13f14a579e0f63bc6fecf27c&scope.system=all&role.id=9f88c83743f745a9a785a2f454753f06 => generated 226 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:02:37.498783 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba781851-1994-46c0-bc17-e580f99a9168 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:37.499145 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba781851-1994-46c0-bc17-e580f99a9168 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:37.499429 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba781851-1994-46c0-bc17-e580f99a9168 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:37.501167 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 141/285] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:02:37 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:02:37.510695 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537c9ce0-81c5-4501-bff8-573438da508d None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:37.510695 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537c9ce0-81c5-4501-bff8-573438da508d None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:37.510695 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537c9ce0-81c5-4501-bff8-573438da508d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:37.530668 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-537c9ce0-81c5-4501-bff8-573438da508d None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:02:37.531893 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-537c9ce0-81c5-4501-bff8-573438da508d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:02:37.618329 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 142/286] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:02:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 10:02:37.641801 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537c9ce0-81c5-4501-bff8-573438da508d None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:37.643266 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea77aa2-8c6f-471e-864d-4f7ffffc1730 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:37.654203 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:37.713309 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf9e819-0750-4e9b-9278-3857912138b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:37.714210 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf9e819-0750-4e9b-9278-3857912138b4 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:37.714487 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf9e819-0750-4e9b-9278-3857912138b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:37.714769 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf9e819-0750-4e9b-9278-3857912138b4 None admin] PATH_INFO: `/v3/projects/d828ff8720114b1b9da6709b7e51dcee` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:37.715955 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf9e819-0750-4e9b-9278-3857912138b4 None admin] RBAC: Authorizing `identity:get_project(project_id=d828ff8720114b1b9da6709b7e51dcee)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:37.717430 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf9e819-0750-4e9b-9278-3857912138b4 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:37.720337 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 145/287] 10.222.0.43 () {56 vars in 1186 bytes} [Wed Jun 22 10:02:37 2022] GET /identity/v3/projects/d828ff8720114b1b9da6709b7e51dcee => generated 302 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:02:37.726485 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf9e819-0750-4e9b-9278-3857912138b4 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:37.731396 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:37.759419 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537c9ce0-81c5-4501-bff8-573438da508d None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:37.798429 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e3fe2d-0eaa-44d5-b5a8-6d0d78f1a1da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:37.799355 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e3fe2d-0eaa-44d5-b5a8-6d0d78f1a1da None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:37.799644 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e3fe2d-0eaa-44d5-b5a8-6d0d78f1a1da None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:37.799925 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e3fe2d-0eaa-44d5-b5a8-6d0d78f1a1da None admin] PATH_INFO: `/v3/roles/member` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:37.812413 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e3fe2d-0eaa-44d5-b5a8-6d0d78f1a1da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:02:37.821387 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-80e3fe2d-0eaa-44d5-b5a8-6d0d78f1a1da None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 10:02:37.821387 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:02:37.821387 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:02:37.821387 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:02:37.821387 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:02:37.821387 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:02:37.821387 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:02:37.821387 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:02:37.821387 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:02:37.821387 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:02:37.821387 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:02:37.821387 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:02:37.821387 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:02:37.821387 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:02:37.821387 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:02:37.821387 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:02:37.822306 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:02:37.822306 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:02:37.822306 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:02:37.822306 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:02:37.822306 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:02:37.822306 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:02:37.822306 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:02:37.822306 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:02:37.822306 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:02:37.822306 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:02:37.822306 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:02:37.822306 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jun 22 10:02:37.822306 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:02:37.822306 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:02:37.822306 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:02:37.822306 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:02:37.823085 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:02:37.823085 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:02:37.823085 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:02:37.823085 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:02:37.823085 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:02:37.823085 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:02:37.823085 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:02:37.823085 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:02:37.823085 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:02:37.823085 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:02:37.823085 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 10:02:37.823085 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:02:37.823085 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 143/288] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Jun 22 10:02:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:02:37.829215 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e3fe2d-0eaa-44d5-b5a8-6d0d78f1a1da None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:37.950612 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf9e819-0750-4e9b-9278-3857912138b4 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:37.970793 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:38.028747 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7ca186-0e29-4fee-b0f7-f99714c671a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:38.029568 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7ca186-0e29-4fee-b0f7-f99714c671a0 None admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:38.029880 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7ca186-0e29-4fee-b0f7-f99714c671a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:38.030162 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7ca186-0e29-4fee-b0f7-f99714c671a0 None admin] PATH_INFO: `/v3/projects/d828ff8720114b1b9da6709b7e51dcee/users/8dbbebe41cc543c3885e78af45c14f90/roles/4a03c0e749d84649a230831b1e6644a4` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:38.034418 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7ca186-0e29-4fee-b0f7-f99714c671a0 None admin] RBAC: Authorizing `identity:create_grant(project_id=d828ff8720114b1b9da6709b7e51dcee, user_id=8dbbebe41cc543c3885e78af45c14f90, role_id=4a03c0e749d84649a230831b1e6644a4)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:38.035957 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7ca186-0e29-4fee-b0f7-f99714c671a0 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:38.040951 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e3fe2d-0eaa-44d5-b5a8-6d0d78f1a1da None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:38.068679 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 146/289] 10.222.0.43 () {58 vars in 1439 bytes} [Wed Jun 22 10:02:37 2022] PUT /identity/v3/projects/d828ff8720114b1b9da6709b7e51dcee/users/8dbbebe41cc543c3885e78af45c14f90/roles/4a03c0e749d84649a230831b1e6644a4 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:02:38.093226 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd246b30-d572-4258-9e14-b45e1879d72f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:38.093967 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd246b30-d572-4258-9e14-b45e1879d72f None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:38.094256 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd246b30-d572-4258-9e14-b45e1879d72f None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:38.094536 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd246b30-d572-4258-9e14-b45e1879d72f None admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:38.095314 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd246b30-d572-4258-9e14-b45e1879d72f None admin] RBAC: Adding query filter params (name=member) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:02:38.095679 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd246b30-d572-4258-9e14-b45e1879d72f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:38.097135 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd246b30-d572-4258-9e14-b45e1879d72f None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:38.107539 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 144/290] 10.222.0.43 () {56 vars in 1101 bytes} [Wed Jun 22 10:02:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:02:38.113110 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7ca186-0e29-4fee-b0f7-f99714c671a0 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:38.232133 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:38.275761 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7ca186-0e29-4fee-b0f7-f99714c671a0 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:38.316905 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2da057-61e0-424b-a7b5-d1a13cd0828b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:38.318575 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2da057-61e0-424b-a7b5-d1a13cd0828b None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:38.318575 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2da057-61e0-424b-a7b5-d1a13cd0828b None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:38.318575 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2da057-61e0-424b-a7b5-d1a13cd0828b None admin] PATH_INFO: `/v3/users/1db2f00cb1684d7f982b81a1db9ebb03` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:38.319869 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2da057-61e0-424b-a7b5-d1a13cd0828b None admin] RBAC: Authorizing `identity:get_user(user_id=1db2f00cb1684d7f982b81a1db9ebb03)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:38.321407 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2da057-61e0-424b-a7b5-d1a13cd0828b None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:38.323501 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 147/291] 10.222.0.43 () {56 vars in 1177 bytes} [Wed Jun 22 10:02:38 2022] GET /identity/v3/users/1db2f00cb1684d7f982b81a1db9ebb03 => generated 297 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:02:38.328741 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd246b30-d572-4258-9e14-b45e1879d72f None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:38.437422 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd246b30-d572-4258-9e14-b45e1879d72f None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:38.466369 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:38.472717 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bb936d-c767-4a0e-929c-cc73ec46951a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:38.474737 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bb936d-c767-4a0e-929c-cc73ec46951a None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:38.474936 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bb936d-c767-4a0e-929c-cc73ec46951a None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:38.475186 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bb936d-c767-4a0e-929c-cc73ec46951a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:38.545477 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bb936d-c767-4a0e-929c-cc73ec46951a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:38.546993 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bb936d-c767-4a0e-929c-cc73ec46951a None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:38.661748 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 145/292] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Jun 22 10:02:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 10:02:38.666970 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2da057-61e0-424b-a7b5-d1a13cd0828b None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:38.772655 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2da057-61e0-424b-a7b5-d1a13cd0828b None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:38.809389 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:38.814103 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d81aac5-aac1-47ca-9a85-becbd2076b4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:38.815014 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d81aac5-aac1-47ca-9a85-becbd2076b4b None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:38.815313 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d81aac5-aac1-47ca-9a85-becbd2076b4b None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:38.815634 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d81aac5-aac1-47ca-9a85-becbd2076b4b None admin] PATH_INFO: `/v3/projects/d828ff8720114b1b9da6709b7e51dcee` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:38.816925 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d81aac5-aac1-47ca-9a85-becbd2076b4b None admin] RBAC: Authorizing `identity:get_project(project_id=d828ff8720114b1b9da6709b7e51dcee)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:38.818896 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d81aac5-aac1-47ca-9a85-becbd2076b4b None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:38.821923 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 148/293] 10.222.0.43 () {56 vars in 1186 bytes} [Wed Jun 22 10:02:38 2022] GET /identity/v3/projects/d828ff8720114b1b9da6709b7e51dcee => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:02:38.826385 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bb936d-c767-4a0e-929c-cc73ec46951a None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:38.862205 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:38.934407 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bb936d-c767-4a0e-929c-cc73ec46951a None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:38.976792 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b6d3ce-56af-4549-9840-6deffb18066e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:38.977984 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b6d3ce-56af-4549-9840-6deffb18066e None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:38.978446 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b6d3ce-56af-4549-9840-6deffb18066e None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:38.978825 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b6d3ce-56af-4549-9840-6deffb18066e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:38.979692 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b6d3ce-56af-4549-9840-6deffb18066e None admin] RBAC: Adding query filter params (role.id=9f88c83743f745a9a785a2f454753f06, scope.project.id=d828ff8720114b1b9da6709b7e51dcee, user.id=1db2f00cb1684d7f982b81a1db9ebb03) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:02:38.980008 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b6d3ce-56af-4549-9840-6deffb18066e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:38.981485 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b6d3ce-56af-4549-9840-6deffb18066e None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:38.988501 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 146/294] 10.222.0.43 () {56 vars in 1374 bytes} [Wed Jun 22 10:02:38 2022] GET /identity/v3/role_assignments?user.id=1db2f00cb1684d7f982b81a1db9ebb03&scope.project.id=d828ff8720114b1b9da6709b7e51dcee&role.id=9f88c83743f745a9a785a2f454753f06 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:02:39.450268 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdfe2e2-149e-464b-ac6d-19effb4b3a8f None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:39.451293 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdfe2e2-149e-464b-ac6d-19effb4b3a8f None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:39.451790 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdfe2e2-149e-464b-ac6d-19effb4b3a8f None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:39.453382 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 149/295] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:02:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:02:39.459809 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94181007-7cf7-4f34-83b1-4575ba3e764d None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:39.460398 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94181007-7cf7-4f34-83b1-4575ba3e764d None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:39.460878 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94181007-7cf7-4f34-83b1-4575ba3e764d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:39.484327 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-94181007-7cf7-4f34-83b1-4575ba3e764d None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:02:39.485905 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-94181007-7cf7-4f34-83b1-4575ba3e764d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:02:39.575574 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 147/296] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:02:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 10:02:39.598071 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdfe2e2-149e-464b-ac6d-19effb4b3a8f None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:39.607105 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b83a256-09e9-49b1-be4a-a8c20d1bda73 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:39.607690 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b83a256-09e9-49b1-be4a-a8c20d1bda73 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:39.608169 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b83a256-09e9-49b1-be4a-a8c20d1bda73 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:39.609788 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 148/297] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:02:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 10:02:39.616316 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7990bad-e6d5-43c4-9650-328718a81c92 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:39.616908 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7990bad-e6d5-43c4-9650-328718a81c92 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:39.617331 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7990bad-e6d5-43c4-9650-328718a81c92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:39.637530 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-b7990bad-e6d5-43c4-9650-328718a81c92 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:02:39.639437 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-b7990bad-e6d5-43c4-9650-328718a81c92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:02:39.662076 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:39.725546 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 149/298] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:02:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 10:02:39.737708 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdfe2e2-149e-464b-ac6d-19effb4b3a8f None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:39.747754 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7990bad-e6d5-43c4-9650-328718a81c92 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:39.772472 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788fd3c6-07c2-41a9-9c85-eb539f1b3c10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:39.773749 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788fd3c6-07c2-41a9-9c85-eb539f1b3c10 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:39.774096 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788fd3c6-07c2-41a9-9c85-eb539f1b3c10 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:39.775022 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788fd3c6-07c2-41a9-9c85-eb539f1b3c10 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:39.776323 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788fd3c6-07c2-41a9-9c85-eb539f1b3c10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:39.777813 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788fd3c6-07c2-41a9-9c85-eb539f1b3c10 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:39.783955 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 150/299] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jun 22 10:02:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:02:39.784772 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788fd3c6-07c2-41a9-9c85-eb539f1b3c10 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:39.856980 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:39.880171 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7990bad-e6d5-43c4-9650-328718a81c92 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:39.896678 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788fd3c6-07c2-41a9-9c85-eb539f1b3c10 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:39.923335 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdba126-1c76-4613-ad99-3628f7f27a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:39.924064 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdba126-1c76-4613-ad99-3628f7f27a62 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:39.924350 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdba126-1c76-4613-ad99-3628f7f27a62 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:39.924627 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdba126-1c76-4613-ad99-3628f7f27a62 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:39.936420 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdba126-1c76-4613-ad99-3628f7f27a62 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:02:39.937079 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cc4ae5-d0ac-4df5-8639-2b072764577e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:39.938036 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cc4ae5-d0ac-4df5-8639-2b072764577e None admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:39.938522 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cc4ae5-d0ac-4df5-8639-2b072764577e None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:39.938996 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cc4ae5-d0ac-4df5-8639-2b072764577e None admin] PATH_INFO: `/v3/groups` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:39.939907 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cc4ae5-d0ac-4df5-8639-2b072764577e None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:39.941571 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cc4ae5-d0ac-4df5-8639-2b072764577e None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:39.944801 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-5cdba126-1c76-4613-ad99-3628f7f27a62 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 10:02:39.944801 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:02:39.944801 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:02:39.944801 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:02:39.944801 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:02:39.944801 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:02:39.944801 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:02:39.944801 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:02:39.944801 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:02:39.944801 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:02:39.944801 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:02:39.944801 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:02:39.944801 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:02:39.944801 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:02:39.944801 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:02:39.944801 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:02:39.945716 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:02:39.945716 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:02:39.945716 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:02:39.945716 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:02:39.945716 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:02:39.945716 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:02:39.945716 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:02:39.945716 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:02:39.945716 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:02:39.945716 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:02:39.945716 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:02:39.945716 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jun 22 10:02:39.945716 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:02:39.945716 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:02:39.945716 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:02:39.945716 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:02:39.946538 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:02:39.946538 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:02:39.946538 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:02:39.946538 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:02:39.946538 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:02:39.946538 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:02:39.946538 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:02:39.946538 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:02:39.946538 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:02:39.946538 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:02:39.946538 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 10:02:39.946538 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:02:39.946538 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 150/300] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Jun 22 10:02:39 2022] GET /identity/v3/roles/reader => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 10:02:39.951697 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdba126-1c76-4613-ad99-3628f7f27a62 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:39.965313 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 151/301] 10.222.0.43 () {60 vars in 1134 bytes} [Wed Jun 22 10:02:39 2022] POST /identity/v3/groups => generated 229 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:02:39.976946 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:39.982930 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba475a25-9048-4e94-9c4e-3d94c5e59733 None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:39.983908 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba475a25-9048-4e94-9c4e-3d94c5e59733 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:39.984410 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba475a25-9048-4e94-9c4e-3d94c5e59733 None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:39.986175 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 152/302] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:02:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 10:02:39.993339 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58fad7d-e437-400a-8e48-db74caeceba2 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:39.993683 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58fad7d-e437-400a-8e48-db74caeceba2 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:39.994000 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58fad7d-e437-400a-8e48-db74caeceba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:40.018787 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-d58fad7d-e437-400a-8e48-db74caeceba2 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:02:40.020069 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-d58fad7d-e437-400a-8e48-db74caeceba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:02:40.097936 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdba126-1c76-4613-ad99-3628f7f27a62 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:40.118452 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 153/303] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:02:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 10:02:40.138745 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58fad7d-e437-400a-8e48-db74caeceba2 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:40.139028 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce807d4-a873-4254-8b70-27a2948e5cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:40.139629 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce807d4-a873-4254-8b70-27a2948e5cd4 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:40.139919 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce807d4-a873-4254-8b70-27a2948e5cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:40.140197 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce807d4-a873-4254-8b70-27a2948e5cd4 None admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:40.140958 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce807d4-a873-4254-8b70-27a2948e5cd4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:02:40.141267 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce807d4-a873-4254-8b70-27a2948e5cd4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:40.142699 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce807d4-a873-4254-8b70-27a2948e5cd4 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:40.152362 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 151/304] 10.222.0.43 () {56 vars in 1101 bytes} [Wed Jun 22 10:02:39 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:02:40.158502 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce807d4-a873-4254-8b70-27a2948e5cd4 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:40.209611 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:40.258296 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58fad7d-e437-400a-8e48-db74caeceba2 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:40.278443 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:40.299791 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce807d4-a873-4254-8b70-27a2948e5cd4 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:40.305635 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f188042-ef50-4ae3-8621-f2d5bfa63969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:40.306733 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f188042-ef50-4ae3-8621-f2d5bfa63969 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:40.307229 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f188042-ef50-4ae3-8621-f2d5bfa63969 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:40.307727 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f188042-ef50-4ae3-8621-f2d5bfa63969 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:40.326834 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f188042-ef50-4ae3-8621-f2d5bfa63969 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:02:40.337625 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684adf2f-7827-43d6-bf69-c06d3c99e664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:40.338007 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-9f188042-ef50-4ae3-8621-f2d5bfa63969 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 10:02:40.338007 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:02:40.338007 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:02:40.338007 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:02:40.338007 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:02:40.338007 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:02:40.338007 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:02:40.338007 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:02:40.338007 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:02:40.338007 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:02:40.338007 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:02:40.338007 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:02:40.338007 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:02:40.338007 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:02:40.338007 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:02:40.338007 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:02:40.338846 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:02:40.338846 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:02:40.338846 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:02:40.338846 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:02:40.338846 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:02:40.338846 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:02:40.338846 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:02:40.338846 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:02:40.338846 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:02:40.338846 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:02:40.338846 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:02:40.338846 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( Jun 22 10:02:40.338846 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:02:40.338846 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:02:40.338846 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:02:40.338846 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:02:40.339740 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:02:40.339740 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:02:40.339740 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:02:40.339740 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:02:40.339740 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:02:40.339740 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:02:40.339740 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:02:40.339740 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:02:40.339740 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:02:40.339740 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:02:40.339740 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 10:02:40.339740 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:02:40.340329 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684adf2f-7827-43d6-bf69-c06d3c99e664 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:40.340329 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684adf2f-7827-43d6-bf69-c06d3c99e664 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:40.340329 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684adf2f-7827-43d6-bf69-c06d3c99e664 None admin] PATH_INFO: `/v3/users/3505a52281364d26a3b0d6ad0fe86a3b` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:40.343670 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 154/305] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Jun 22 10:02:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:02:40.353797 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f188042-ef50-4ae3-8621-f2d5bfa63969 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:40.356546 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684adf2f-7827-43d6-bf69-c06d3c99e664 None admin] RBAC: Authorizing `identity:get_user(user_id=3505a52281364d26a3b0d6ad0fe86a3b)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:40.358119 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684adf2f-7827-43d6-bf69-c06d3c99e664 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:40.365532 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 152/306] 10.222.0.43 () {56 vars in 1177 bytes} [Wed Jun 22 10:02:40 2022] GET /identity/v3/users/3505a52281364d26a3b0d6ad0fe86a3b => generated 293 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:02:40.366568 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684adf2f-7827-43d6-bf69-c06d3c99e664 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:40.464864 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f188042-ef50-4ae3-8621-f2d5bfa63969 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:40.472223 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684adf2f-7827-43d6-bf69-c06d3c99e664 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:40.484036 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:40.503962 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e8e51d-41c5-4abf-a083-f90eba599834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:40.505551 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e8e51d-41c5-4abf-a083-f90eba599834 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:40.506086 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e8e51d-41c5-4abf-a083-f90eba599834 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:40.506567 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e8e51d-41c5-4abf-a083-f90eba599834 None admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:40.507527 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e8e51d-41c5-4abf-a083-f90eba599834 None admin] RBAC: Adding query filter params (name=member) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:02:40.508052 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e8e51d-41c5-4abf-a083-f90eba599834 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:40.509724 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e8e51d-41c5-4abf-a083-f90eba599834 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:40.512087 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1232d133-3dea-48f8-8648-4c7258eb5170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:40.512775 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1232d133-3dea-48f8-8648-4c7258eb5170 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:40.513081 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1232d133-3dea-48f8-8648-4c7258eb5170 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:40.513364 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1232d133-3dea-48f8-8648-4c7258eb5170 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:40.514280 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1232d133-3dea-48f8-8648-4c7258eb5170 None admin] RBAC: Adding query filter params (role.id=4a03c0e749d84649a230831b1e6644a4, user.id=3505a52281364d26a3b0d6ad0fe86a3b, scope.system=all) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:02:40.514593 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1232d133-3dea-48f8-8648-4c7258eb5170 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:40.516087 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1232d133-3dea-48f8-8648-4c7258eb5170 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:40.520601 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 155/307] 10.222.0.43 () {56 vars in 1101 bytes} [Wed Jun 22 10:02:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:02:40.525246 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:40.526473 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e8e51d-41c5-4abf-a083-f90eba599834 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:40.528060 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 153/308] 10.222.0.43 () {56 vars in 1308 bytes} [Wed Jun 22 10:02:40 2022] GET /identity/v3/role_assignments?user.id=3505a52281364d26a3b0d6ad0fe86a3b&scope.system=all&role.id=4a03c0e749d84649a230831b1e6644a4 => generated 226 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:02:40.621507 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32d6c17-213c-4649-867d-5ca2ac12dc36 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:40.621720 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32d6c17-213c-4649-867d-5ca2ac12dc36 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:40.621975 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32d6c17-213c-4649-867d-5ca2ac12dc36 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:40.623606 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 154/309] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:02:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 10:02:40.631926 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a105c84-9e63-44d1-8009-ff9c3fc2b34a None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:40.632210 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a105c84-9e63-44d1-8009-ff9c3fc2b34a None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:40.632495 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a105c84-9e63-44d1-8009-ff9c3fc2b34a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:40.652781 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-3a105c84-9e63-44d1-8009-ff9c3fc2b34a None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:02:40.654185 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-3a105c84-9e63-44d1-8009-ff9c3fc2b34a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:02:40.656184 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e8e51d-41c5-4abf-a083-f90eba599834 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:40.711191 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeb01ab-a854-4531-b9ae-72642a4419d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:40.712080 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeb01ab-a854-4531-b9ae-72642a4419d4 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:40.712370 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeb01ab-a854-4531-b9ae-72642a4419d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:40.712652 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeb01ab-a854-4531-b9ae-72642a4419d4 None admin] PATH_INFO: `/v3/users/cb7e442a13f14a579e0f63bc6fecf27c` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:40.714368 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eeb01ab-a854-4531-b9ae-72642a4419d4 None admin] RBAC: Authorizing `identity:get_user(user_id=cb7e442a13f14a579e0f63bc6fecf27c)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:40.715837 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eeb01ab-a854-4531-b9ae-72642a4419d4 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:40.717852 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 156/310] 10.222.0.43 () {56 vars in 1177 bytes} [Wed Jun 22 10:02:40 2022] GET /identity/v3/users/cb7e442a13f14a579e0f63bc6fecf27c => generated 293 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:02:40.731140 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeb01ab-a854-4531-b9ae-72642a4419d4 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:40.757398 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 155/311] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:02:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 10:02:40.781512 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a105c84-9e63-44d1-8009-ff9c3fc2b34a None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:40.793062 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:40.852466 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeb01ab-a854-4531-b9ae-72642a4419d4 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:40.887796 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a105c84-9e63-44d1-8009-ff9c3fc2b34a None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:40.888816 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b6ebd8-ece1-4fc0-9f56-9ec64842bdbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:40.889938 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b6ebd8-ece1-4fc0-9f56-9ec64842bdbb None admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:40.890372 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b6ebd8-ece1-4fc0-9f56-9ec64842bdbb None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:40.890842 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b6ebd8-ece1-4fc0-9f56-9ec64842bdbb None admin] PATH_INFO: `/v3/system/users/cb7e442a13f14a579e0f63bc6fecf27c/roles/9f88c83743f745a9a785a2f454753f06` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:40.892472 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b6ebd8-ece1-4fc0-9f56-9ec64842bdbb None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=cb7e442a13f14a579e0f63bc6fecf27c, role_id=9f88c83743f745a9a785a2f454753f06)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:40.894068 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b6ebd8-ece1-4fc0-9f56-9ec64842bdbb None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:40.907323 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 157/312] 10.222.0.43 () {58 vars in 1334 bytes} [Wed Jun 22 10:02:40 2022] PUT /identity/v3/system/users/cb7e442a13f14a579e0f63bc6fecf27c/roles/9f88c83743f745a9a785a2f454753f06 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:02:40.921939 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:40.932508 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e01892e-9911-4cac-a32a-55dfd63a94b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:40.933233 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e01892e-9911-4cac-a32a-55dfd63a94b8 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:40.933527 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e01892e-9911-4cac-a32a-55dfd63a94b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:40.933858 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e01892e-9911-4cac-a32a-55dfd63a94b8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:40.948233 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e01892e-9911-4cac-a32a-55dfd63a94b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:02:40.956834 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-6e01892e-9911-4cac-a32a-55dfd63a94b8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 10:02:40.956834 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:02:40.956834 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:02:40.956834 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:02:40.956834 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:02:40.956834 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:02:40.956834 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:02:40.956834 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:02:40.956834 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:02:40.956834 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:02:40.956834 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:02:40.956834 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:02:40.956834 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:02:40.956834 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:02:40.956834 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:02:40.956834 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:02:40.958002 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:02:40.958002 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:02:40.958002 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:02:40.958002 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:02:40.958002 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:02:40.958002 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:02:40.958002 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:02:40.958002 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:02:40.958002 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:02:40.958002 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:02:40.958002 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:02:40.958002 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jun 22 10:02:40.958002 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:02:40.958002 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:02:40.958002 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:02:40.958002 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:02:40.958804 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:02:40.958804 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:02:40.958804 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:02:40.958804 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:02:40.958804 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:02:40.958804 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:02:40.958804 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:02:40.958804 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:02:40.958804 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:02:40.958804 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:02:40.958804 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 10:02:40.958804 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:02:40.958804 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 156/313] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Jun 22 10:02:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 10:02:40.967131 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b6ebd8-ece1-4fc0-9f56-9ec64842bdbb None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:41.084848 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b6ebd8-ece1-4fc0-9f56-9ec64842bdbb None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:41.105678 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:41.136501 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be99ccf5-f77a-4c7a-9e8a-80085ef8db35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:41.137168 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be99ccf5-f77a-4c7a-9e8a-80085ef8db35 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:41.137451 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be99ccf5-f77a-4c7a-9e8a-80085ef8db35 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:41.137753 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be99ccf5-f77a-4c7a-9e8a-80085ef8db35 None admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:41.138508 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be99ccf5-f77a-4c7a-9e8a-80085ef8db35 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:02:41.138813 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be99ccf5-f77a-4c7a-9e8a-80085ef8db35 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:41.140206 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be99ccf5-f77a-4c7a-9e8a-80085ef8db35 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:41.150051 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 158/314] 10.222.0.43 () {56 vars in 1101 bytes} [Wed Jun 22 10:02:40 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:02:41.155567 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e01892e-9911-4cac-a32a-55dfd63a94b8 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:41.272388 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e01892e-9911-4cac-a32a-55dfd63a94b8 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:41.308482 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da5eaa5-30fc-4b4b-8382-2208cda93586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:41.309361 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da5eaa5-30fc-4b4b-8382-2208cda93586 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:41.309647 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da5eaa5-30fc-4b4b-8382-2208cda93586 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:41.309958 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da5eaa5-30fc-4b4b-8382-2208cda93586 None admin] PATH_INFO: `/v3/users/8dbbebe41cc543c3885e78af45c14f90` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:41.311166 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da5eaa5-30fc-4b4b-8382-2208cda93586 None admin] RBAC: Authorizing `identity:get_user(user_id=8dbbebe41cc543c3885e78af45c14f90)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:41.312685 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da5eaa5-30fc-4b4b-8382-2208cda93586 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:41.314705 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 157/315] 10.222.0.43 () {56 vars in 1177 bytes} [Wed Jun 22 10:02:41 2022] GET /identity/v3/users/8dbbebe41cc543c3885e78af45c14f90 => generated 297 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:02:41.320493 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be99ccf5-f77a-4c7a-9e8a-80085ef8db35 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:41.431668 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be99ccf5-f77a-4c7a-9e8a-80085ef8db35 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:41.467073 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98651ee6-10d1-46d5-b0be-711f8f8b919c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:41.468494 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98651ee6-10d1-46d5-b0be-711f8f8b919c None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:41.468999 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98651ee6-10d1-46d5-b0be-711f8f8b919c None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:41.469470 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98651ee6-10d1-46d5-b0be-711f8f8b919c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:41.512294 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:41.540795 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98651ee6-10d1-46d5-b0be-711f8f8b919c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:41.542643 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98651ee6-10d1-46d5-b0be-711f8f8b919c None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:41.645094 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 159/316] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Jun 22 10:02:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 10:02:41.650748 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da5eaa5-30fc-4b4b-8382-2208cda93586 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:41.718298 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:41.767797 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da5eaa5-30fc-4b4b-8382-2208cda93586 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:41.806702 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86e7261-2dca-4507-8867-8c76197ae74e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:41.807564 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86e7261-2dca-4507-8867-8c76197ae74e None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:41.807848 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86e7261-2dca-4507-8867-8c76197ae74e None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:41.808124 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86e7261-2dca-4507-8867-8c76197ae74e None admin] PATH_INFO: `/v3/projects/d828ff8720114b1b9da6709b7e51dcee` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:41.809302 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86e7261-2dca-4507-8867-8c76197ae74e None admin] RBAC: Authorizing `identity:get_project(project_id=d828ff8720114b1b9da6709b7e51dcee)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:41.810786 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86e7261-2dca-4507-8867-8c76197ae74e None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:41.812478 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 158/317] 10.222.0.43 () {56 vars in 1186 bytes} [Wed Jun 22 10:02:41 2022] GET /identity/v3/projects/d828ff8720114b1b9da6709b7e51dcee => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:02:41.818999 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98651ee6-10d1-46d5-b0be-711f8f8b919c None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:41.892732 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:41.927575 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98651ee6-10d1-46d5-b0be-711f8f8b919c None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:41.961775 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18f703c-7583-40da-9af3-611200e00530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:41.962761 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18f703c-7583-40da-9af3-611200e00530 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:41.963265 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18f703c-7583-40da-9af3-611200e00530 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:41.963731 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18f703c-7583-40da-9af3-611200e00530 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:41.964749 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18f703c-7583-40da-9af3-611200e00530 None admin] RBAC: Adding query filter params (role.id=4a03c0e749d84649a230831b1e6644a4, scope.project.id=d828ff8720114b1b9da6709b7e51dcee, user.id=8dbbebe41cc543c3885e78af45c14f90) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:02:41.965257 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18f703c-7583-40da-9af3-611200e00530 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:41.966990 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18f703c-7583-40da-9af3-611200e00530 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:41.974217 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 160/318] 10.222.0.43 () {56 vars in 1374 bytes} [Wed Jun 22 10:02:41 2022] GET /identity/v3/role_assignments?user.id=8dbbebe41cc543c3885e78af45c14f90&scope.project.id=d828ff8720114b1b9da6709b7e51dcee&role.id=4a03c0e749d84649a230831b1e6644a4 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:02:42.137020 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56dd8d8-cdeb-432f-b0be-ca4993dddee9 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:42.137663 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56dd8d8-cdeb-432f-b0be-ca4993dddee9 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:42.138226 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56dd8d8-cdeb-432f-b0be-ca4993dddee9 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:42.139982 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 159/319] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:02:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:02:42.146389 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f98fa7-2aed-460c-8705-d350ce8875c1 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:42.146997 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f98fa7-2aed-460c-8705-d350ce8875c1 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:42.147491 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f98fa7-2aed-460c-8705-d350ce8875c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:42.166124 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-c1f98fa7-2aed-460c-8705-d350ce8875c1 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:02:42.167306 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-c1f98fa7-2aed-460c-8705-d350ce8875c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:02:42.244784 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 161/320] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:02:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 10:02:42.267819 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56dd8d8-cdeb-432f-b0be-ca4993dddee9 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:42.381546 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56dd8d8-cdeb-432f-b0be-ca4993dddee9 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:42.405320 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:42.417867 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcf95fb-ac1c-4fd0-85ab-8bbaa8240712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:42.418677 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcf95fb-ac1c-4fd0-85ab-8bbaa8240712 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:42.418967 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcf95fb-ac1c-4fd0-85ab-8bbaa8240712 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:42.419251 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcf95fb-ac1c-4fd0-85ab-8bbaa8240712 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:42.420411 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcf95fb-ac1c-4fd0-85ab-8bbaa8240712 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:42.421891 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcf95fb-ac1c-4fd0-85ab-8bbaa8240712 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:42.423676 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 160/321] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jun 22 10:02:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:02:42.429351 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f98fa7-2aed-460c-8705-d350ce8875c1 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:42.495702 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:42.531665 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f98fa7-2aed-460c-8705-d350ce8875c1 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:42.566612 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d742169-6ead-4835-90f7-5efc3c7db470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:42.567833 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d742169-6ead-4835-90f7-5efc3c7db470 None admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:42.568112 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d742169-6ead-4835-90f7-5efc3c7db470 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:42.568482 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d742169-6ead-4835-90f7-5efc3c7db470 None admin] PATH_INFO: `/v3/groups` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:42.569175 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d742169-6ead-4835-90f7-5efc3c7db470 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:42.570653 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d742169-6ead-4835-90f7-5efc3c7db470 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:42.585707 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 162/322] 10.222.0.43 () {60 vars in 1134 bytes} [Wed Jun 22 10:02:42 2022] POST /identity/v3/groups => generated 226 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 10:02:42.686143 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41620a1-92fd-4472-9ca7-513ddcfc1329 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:42.686487 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41620a1-92fd-4472-9ca7-513ddcfc1329 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:42.686703 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41620a1-92fd-4472-9ca7-513ddcfc1329 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:42.688254 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 161/323] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:02:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:02:42.693976 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d9c70c-755f-40dd-9dd0-1b59361391ba None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:42.694297 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d9c70c-755f-40dd-9dd0-1b59361391ba None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:42.694549 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d9c70c-755f-40dd-9dd0-1b59361391ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:42.712226 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-35d9c70c-755f-40dd-9dd0-1b59361391ba None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:02:42.713419 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-35d9c70c-755f-40dd-9dd0-1b59361391ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:02:42.802226 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 163/324] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:02:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 10:02:42.823843 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41620a1-92fd-4472-9ca7-513ddcfc1329 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:42.938572 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41620a1-92fd-4472-9ca7-513ddcfc1329 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:42.975664 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e441f67-6bda-444b-b8ac-f3645f3072ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:42.976823 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e441f67-6bda-444b-b8ac-f3645f3072ec None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:42.977323 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e441f67-6bda-444b-b8ac-f3645f3072ec None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:42.977838 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e441f67-6bda-444b-b8ac-f3645f3072ec None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:42.988802 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e441f67-6bda-444b-b8ac-f3645f3072ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:02:42.998171 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-7e441f67-6bda-444b-b8ac-f3645f3072ec None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 10:02:42.998171 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:02:42.998171 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:02:42.998171 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:02:42.998171 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:02:42.998171 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:02:42.998171 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:02:42.998171 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:02:42.998171 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:02:42.998171 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:02:42.998171 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:02:42.998171 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:02:42.998171 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:02:42.998171 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:02:42.998171 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:02:42.998171 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:02:42.999132 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:02:42.999132 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:02:42.999132 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:02:42.999132 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:02:42.999132 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:02:42.999132 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:02:42.999132 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:02:42.999132 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:02:42.999132 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:02:42.999132 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:02:42.999132 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:02:42.999132 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jun 22 10:02:42.999132 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:02:42.999132 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:02:42.999132 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:02:42.999132 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:02:42.999910 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:02:42.999910 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:02:42.999910 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:02:42.999910 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:02:42.999910 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:02:42.999910 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:02:42.999910 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:02:42.999910 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:02:42.999910 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:02:42.999910 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:02:42.999910 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 10:02:42.999910 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:02:43.004822 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 162/325] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Jun 22 10:02:42 2022] GET /identity/v3/roles/reader => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:02:43.008254 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d9c70c-755f-40dd-9dd0-1b59361391ba None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:43.074857 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:43.110959 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9588fa6a-32f7-4f8d-b062-b9b99786bf1e None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:43.111256 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9588fa6a-32f7-4f8d-b062-b9b99786bf1e None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:43.111542 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9588fa6a-32f7-4f8d-b062-b9b99786bf1e None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:43.112934 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 163/326] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:02:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:02:43.118305 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a0b965-d634-449d-96ea-4d5b2688a32b None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:43.118596 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a0b965-d634-449d-96ea-4d5b2688a32b None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:43.119014 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a0b965-d634-449d-96ea-4d5b2688a32b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:43.138416 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-93a0b965-d634-449d-96ea-4d5b2688a32b None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:02:43.139801 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-93a0b965-d634-449d-96ea-4d5b2688a32b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:02:43.146441 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d9c70c-755f-40dd-9dd0-1b59361391ba None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:43.190126 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b970b4-91b0-4caa-804f-937fa8bffd36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:43.190819 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b970b4-91b0-4caa-804f-937fa8bffd36 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:43.191106 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b970b4-91b0-4caa-804f-937fa8bffd36 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:43.191387 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b970b4-91b0-4caa-804f-937fa8bffd36 None admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:43.192224 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b970b4-91b0-4caa-804f-937fa8bffd36 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:02:43.192908 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b970b4-91b0-4caa-804f-937fa8bffd36 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:43.194809 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b970b4-91b0-4caa-804f-937fa8bffd36 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:43.203951 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 164/327] 10.222.0.43 () {56 vars in 1101 bytes} [Wed Jun 22 10:02:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:02:43.211006 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:43.211175 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b970b4-91b0-4caa-804f-937fa8bffd36 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:43.242555 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 164/328] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:02:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 10:02:43.267484 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a0b965-d634-449d-96ea-4d5b2688a32b None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:43.325207 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b970b4-91b0-4caa-804f-937fa8bffd36 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:43.348033 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:43.371468 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162fd833-69af-4783-bbec-0f4d08351171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:43.372353 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162fd833-69af-4783-bbec-0f4d08351171 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:43.372641 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162fd833-69af-4783-bbec-0f4d08351171 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:43.372921 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162fd833-69af-4783-bbec-0f4d08351171 None admin] PATH_INFO: `/v3/users/3505a52281364d26a3b0d6ad0fe86a3b` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:43.374215 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162fd833-69af-4783-bbec-0f4d08351171 None admin] RBAC: Authorizing `identity:get_user(user_id=3505a52281364d26a3b0d6ad0fe86a3b)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:43.375685 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162fd833-69af-4783-bbec-0f4d08351171 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:43.377887 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 165/329] 10.222.0.43 () {56 vars in 1177 bytes} [Wed Jun 22 10:02:43 2022] GET /identity/v3/users/3505a52281364d26a3b0d6ad0fe86a3b => generated 293 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:02:43.387765 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162fd833-69af-4783-bbec-0f4d08351171 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:43.420578 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a0b965-d634-449d-96ea-4d5b2688a32b None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:43.478359 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93764b7-89c0-4071-83e6-bfde367a17a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:43.479231 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93764b7-89c0-4071-83e6-bfde367a17a6 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:43.480023 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93764b7-89c0-4071-83e6-bfde367a17a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:43.481683 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93764b7-89c0-4071-83e6-bfde367a17a6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:43.498936 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93764b7-89c0-4071-83e6-bfde367a17a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:02:43.507350 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-e93764b7-89c0-4071-83e6-bfde367a17a6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 10:02:43.507350 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:02:43.507350 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:02:43.507350 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:02:43.507350 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:02:43.507350 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:02:43.507350 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:02:43.507350 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:02:43.507350 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:02:43.507350 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:02:43.507350 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:02:43.507350 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:02:43.507350 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:02:43.507350 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:02:43.507350 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:02:43.507350 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:02:43.509453 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:02:43.509453 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:02:43.509453 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:02:43.509453 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:02:43.509453 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:02:43.509453 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:02:43.509453 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:02:43.509453 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:02:43.509453 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:02:43.509453 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:02:43.509453 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:02:43.509453 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jun 22 10:02:43.509453 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:02:43.509453 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:02:43.509453 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:02:43.509453 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:02:43.510516 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:02:43.510516 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:02:43.510516 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:02:43.510516 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:02:43.510516 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:02:43.510516 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:02:43.510516 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:02:43.510516 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:02:43.510516 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:02:43.510516 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:02:43.510516 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 10:02:43.510516 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:02:43.510516 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 165/330] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Jun 22 10:02:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:02:43.516016 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93764b7-89c0-4071-83e6-bfde367a17a6 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:43.545011 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162fd833-69af-4783-bbec-0f4d08351171 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:43.565072 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:43.611441 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c59c2c-19b2-4a73-adc8-0c52bd6a9d21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:43.612247 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c59c2c-19b2-4a73-adc8-0c52bd6a9d21 None admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:43.612537 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c59c2c-19b2-4a73-adc8-0c52bd6a9d21 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:43.612821 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c59c2c-19b2-4a73-adc8-0c52bd6a9d21 None admin] PATH_INFO: `/v3/system/users/3505a52281364d26a3b0d6ad0fe86a3b/roles/4a03c0e749d84649a230831b1e6644a4` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:43.618479 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c59c2c-19b2-4a73-adc8-0c52bd6a9d21 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=3505a52281364d26a3b0d6ad0fe86a3b, role_id=4a03c0e749d84649a230831b1e6644a4)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:43.619900 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c59c2c-19b2-4a73-adc8-0c52bd6a9d21 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:43.628558 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93764b7-89c0-4071-83e6-bfde367a17a6 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:43.651477 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 166/331] 10.222.0.43 () {58 vars in 1334 bytes} [Wed Jun 22 10:02:43 2022] PUT /identity/v3/system/users/3505a52281364d26a3b0d6ad0fe86a3b/roles/4a03c0e749d84649a230831b1e6644a4 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:02:43.677972 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e2927c-bb35-49c4-96d2-1fb2a554fab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:43.678336 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e2927c-bb35-49c4-96d2-1fb2a554fab7 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:43.678616 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e2927c-bb35-49c4-96d2-1fb2a554fab7 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:43.678897 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e2927c-bb35-49c4-96d2-1fb2a554fab7 None admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:43.679765 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e2927c-bb35-49c4-96d2-1fb2a554fab7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:02:43.680044 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e2927c-bb35-49c4-96d2-1fb2a554fab7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:43.681444 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e2927c-bb35-49c4-96d2-1fb2a554fab7 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:43.691098 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 166/332] 10.222.0.43 () {56 vars in 1101 bytes} [Wed Jun 22 10:02:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:02:43.696353 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c59c2c-19b2-4a73-adc8-0c52bd6a9d21 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:43.760090 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:43.825206 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c59c2c-19b2-4a73-adc8-0c52bd6a9d21 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:43.864982 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2391edcf-6be4-4222-af21-7be4bd35d22e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:43.865337 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2391edcf-6be4-4222-af21-7be4bd35d22e None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:43.865496 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2391edcf-6be4-4222-af21-7be4bd35d22e None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:43.865793 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2391edcf-6be4-4222-af21-7be4bd35d22e None admin] PATH_INFO: `/v3/users/cb7e442a13f14a579e0f63bc6fecf27c` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:43.867049 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2391edcf-6be4-4222-af21-7be4bd35d22e None admin] RBAC: Authorizing `identity:get_user(user_id=cb7e442a13f14a579e0f63bc6fecf27c)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:43.868598 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2391edcf-6be4-4222-af21-7be4bd35d22e None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:43.870598 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 167/333] 10.222.0.43 () {56 vars in 1177 bytes} [Wed Jun 22 10:02:43 2022] GET /identity/v3/users/cb7e442a13f14a579e0f63bc6fecf27c => generated 293 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:02:43.878864 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e2927c-bb35-49c4-96d2-1fb2a554fab7 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:43.992931 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e2927c-bb35-49c4-96d2-1fb2a554fab7 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:43.995347 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:44.029838 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87412065-2904-4f60-a2fc-cf9d93923359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:44.030504 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87412065-2904-4f60-a2fc-cf9d93923359 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:44.030790 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87412065-2904-4f60-a2fc-cf9d93923359 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:44.031071 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87412065-2904-4f60-a2fc-cf9d93923359 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:44.031918 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87412065-2904-4f60-a2fc-cf9d93923359 None admin] RBAC: Adding query filter params (role.id=9f88c83743f745a9a785a2f454753f06, user.id=cb7e442a13f14a579e0f63bc6fecf27c, scope.system=all) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:02:44.032264 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87412065-2904-4f60-a2fc-cf9d93923359 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:44.033753 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87412065-2904-4f60-a2fc-cf9d93923359 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:44.047633 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 167/334] 10.222.0.43 () {56 vars in 1308 bytes} [Wed Jun 22 10:02:43 2022] GET /identity/v3/role_assignments?user.id=cb7e442a13f14a579e0f63bc6fecf27c&scope.system=all&role.id=9f88c83743f745a9a785a2f454753f06 => generated 510 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:02:45.147411 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f96346-7229-4318-9154-2161f88dc5aa None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:45.147945 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f96346-7229-4318-9154-2161f88dc5aa None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:45.147945 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f96346-7229-4318-9154-2161f88dc5aa None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:45.149346 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 168/335] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:02:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:02:45.154996 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4523886-e409-46fd-839e-d9fdb545c697 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:45.155438 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4523886-e409-46fd-839e-d9fdb545c697 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:45.155617 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4523886-e409-46fd-839e-d9fdb545c697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:45.178931 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-a4523886-e409-46fd-839e-d9fdb545c697 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:02:45.180140 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-a4523886-e409-46fd-839e-d9fdb545c697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:02:45.267419 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 168/336] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:02:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 10:02:45.307620 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f96346-7229-4318-9154-2161f88dc5aa None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:45.434557 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f96346-7229-4318-9154-2161f88dc5aa None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:45.453018 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:45.477399 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3975a0c3-5210-4264-b28d-88df232c78ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:45.478251 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3975a0c3-5210-4264-b28d-88df232c78ec None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:45.478540 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3975a0c3-5210-4264-b28d-88df232c78ec None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:45.478820 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3975a0c3-5210-4264-b28d-88df232c78ec None admin] PATH_INFO: `/v3/roles/member` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:45.490195 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3975a0c3-5210-4264-b28d-88df232c78ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:02:45.502208 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-3975a0c3-5210-4264-b28d-88df232c78ec None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 10:02:45.502208 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:02:45.502208 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:02:45.502208 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:02:45.502208 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:02:45.502208 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:02:45.502208 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:02:45.502208 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:02:45.502208 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:02:45.502208 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:02:45.502208 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:02:45.502208 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:02:45.502208 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:02:45.502208 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:02:45.502208 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:02:45.502208 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:02:45.503106 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:02:45.503106 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:02:45.503106 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:02:45.503106 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:02:45.503106 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:02:45.503106 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:02:45.503106 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:02:45.503106 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:02:45.503106 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:02:45.503106 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:02:45.503106 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:02:45.503106 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( Jun 22 10:02:45.503106 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:02:45.503106 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:02:45.503106 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:02:45.503106 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:02:45.503876 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:02:45.503876 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:02:45.503876 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:02:45.503876 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:02:45.503876 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:02:45.503876 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:02:45.503876 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:02:45.503876 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:02:45.503876 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:02:45.503876 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:02:45.503876 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 10:02:45.503876 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:02:45.503876 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 169/337] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Jun 22 10:02:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:02:45.510142 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4523886-e409-46fd-839e-d9fdb545c697 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:45.659004 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:45.670816 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4523886-e409-46fd-839e-d9fdb545c697 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:45.713232 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04436ea9-a117-4b27-a21f-40145929c4a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:45.713870 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04436ea9-a117-4b27-a21f-40145929c4a2 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:45.714162 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04436ea9-a117-4b27-a21f-40145929c4a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:45.714453 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04436ea9-a117-4b27-a21f-40145929c4a2 None admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:45.715222 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04436ea9-a117-4b27-a21f-40145929c4a2 None admin] RBAC: Adding query filter params (name=member) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:02:45.715534 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04436ea9-a117-4b27-a21f-40145929c4a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:45.716929 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04436ea9-a117-4b27-a21f-40145929c4a2 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:45.731223 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 169/338] 10.222.0.43 () {56 vars in 1101 bytes} [Wed Jun 22 10:02:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:02:45.733005 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3975a0c3-5210-4264-b28d-88df232c78ec None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:45.860349 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3975a0c3-5210-4264-b28d-88df232c78ec None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:45.905218 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1779111-8576-4e40-853e-4ca40b17d850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:45.905910 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1779111-8576-4e40-853e-4ca40b17d850 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:45.906199 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1779111-8576-4e40-853e-4ca40b17d850 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:45.906473 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1779111-8576-4e40-853e-4ca40b17d850 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:45.932156 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b635844-2d85-41dc-b5ab-e7dd1f447dcf None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:45.932453 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b635844-2d85-41dc-b5ab-e7dd1f447dcf None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:45.932725 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b635844-2d85-41dc-b5ab-e7dd1f447dcf None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:45.937082 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 170/339] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:02:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:02:45.942813 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d8c646-9815-407e-867e-493ee86e1fef None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:45.943114 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d8c646-9815-407e-867e-493ee86e1fef None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:45.943432 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d8c646-9815-407e-867e-493ee86e1fef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:45.963547 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:45.984543 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-b3d8c646-9815-407e-867e-493ee86e1fef None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:02:45.985798 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-b3d8c646-9815-407e-867e-493ee86e1fef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:02:46.012035 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1779111-8576-4e40-853e-4ca40b17d850 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:46.013547 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1779111-8576-4e40-853e-4ca40b17d850 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:46.125863 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 171/340] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:02:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 10:02:46.158490 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d8c646-9815-407e-867e-493ee86e1fef None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:46.178387 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 170/341] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Jun 22 10:02:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 10:02:46.183981 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1779111-8576-4e40-853e-4ca40b17d850 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:46.301308 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:46.344492 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d8c646-9815-407e-867e-493ee86e1fef None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:46.354715 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:46.417130 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1779111-8576-4e40-853e-4ca40b17d850 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:46.431906 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c272747e-2348-4bbe-b777-706f04e6134b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:46.433088 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c272747e-2348-4bbe-b777-706f04e6134b None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:46.433573 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c272747e-2348-4bbe-b777-706f04e6134b None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:46.434078 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c272747e-2348-4bbe-b777-706f04e6134b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:46.460620 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c272747e-2348-4bbe-b777-706f04e6134b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:02:46.469938 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-c272747e-2348-4bbe-b777-706f04e6134b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 10:02:46.469938 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:02:46.469938 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:02:46.469938 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:02:46.469938 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:02:46.469938 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:02:46.469938 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:02:46.469938 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:02:46.469938 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:02:46.469938 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:02:46.469938 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:02:46.469938 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:02:46.469938 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:02:46.469938 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:02:46.469938 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:02:46.469938 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:02:46.470828 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:02:46.470828 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:02:46.470828 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:02:46.470828 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:02:46.470828 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:02:46.470828 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:02:46.470828 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:02:46.470828 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:02:46.470828 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:02:46.470828 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:02:46.470828 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:02:46.470828 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jun 22 10:02:46.470828 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:02:46.470828 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:02:46.470828 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:02:46.470828 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:02:46.471643 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:02:46.471643 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:02:46.471643 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:02:46.471643 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:02:46.471643 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:02:46.471643 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:02:46.471643 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:02:46.471643 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:02:46.471643 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:02:46.471643 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:02:46.471643 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 10:02:46.471643 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:02:46.480150 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 172/342] 10.222.0.43 () {56 vars in 1114 bytes} [Wed Jun 22 10:02:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:02:46.487727 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c272747e-2348-4bbe-b777-706f04e6134b None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:46.506104 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156be63c-e7da-4ff1-9e17-8ebc48c32e6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:46.507367 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156be63c-e7da-4ff1-9e17-8ebc48c32e6b None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:46.507920 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156be63c-e7da-4ff1-9e17-8ebc48c32e6b None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:46.508404 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156be63c-e7da-4ff1-9e17-8ebc48c32e6b None admin] PATH_INFO: `/v3/projects/6008ad7344a543cdae5546c3d2f389b1` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:46.509818 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156be63c-e7da-4ff1-9e17-8ebc48c32e6b None admin] RBAC: Authorizing `identity:get_project(project_id=6008ad7344a543cdae5546c3d2f389b1)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:46.513732 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156be63c-e7da-4ff1-9e17-8ebc48c32e6b None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:46.515700 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 171/343] 10.222.0.43 () {56 vars in 1186 bytes} [Wed Jun 22 10:02:46 2022] GET /identity/v3/projects/6008ad7344a543cdae5546c3d2f389b1 => generated 298 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:02:46.521068 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156be63c-e7da-4ff1-9e17-8ebc48c32e6b None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:46.694966 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156be63c-e7da-4ff1-9e17-8ebc48c32e6b None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:46.745577 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c272747e-2348-4bbe-b777-706f04e6134b None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:46.751297 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5419e5-a76e-442c-aced-e95e85d03f6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:46.752172 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5419e5-a76e-442c-aced-e95e85d03f6d None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:46.752458 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5419e5-a76e-442c-aced-e95e85d03f6d None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:46.752738 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5419e5-a76e-442c-aced-e95e85d03f6d None admin] PATH_INFO: `/v3/groups/363e63ca29024f308dbb8d31e1742695` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:46.759223 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5419e5-a76e-442c-aced-e95e85d03f6d None admin] RBAC: Authorizing `identity:get_group(group_id=363e63ca29024f308dbb8d31e1742695)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:46.760757 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5419e5-a76e-442c-aced-e95e85d03f6d None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:46.766903 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 172/344] 10.222.0.43 () {56 vars in 1180 bytes} [Wed Jun 22 10:02:46 2022] GET /identity/v3/groups/363e63ca29024f308dbb8d31e1742695 => generated 226 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:02:46.773708 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5419e5-a76e-442c-aced-e95e85d03f6d None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:46.796307 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:46.796624 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab434f33-6ec5-44e3-93ce-a48636c461b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:46.797263 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab434f33-6ec5-44e3-93ce-a48636c461b6 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:46.797556 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab434f33-6ec5-44e3-93ce-a48636c461b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:46.797874 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab434f33-6ec5-44e3-93ce-a48636c461b6 None admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:46.798649 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab434f33-6ec5-44e3-93ce-a48636c461b6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:02:46.798965 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab434f33-6ec5-44e3-93ce-a48636c461b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:46.800370 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab434f33-6ec5-44e3-93ce-a48636c461b6 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:46.812950 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 173/345] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Jun 22 10:02:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:02:46.814378 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e7ae75-2afa-4f37-adbb-5722d569c81e None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:46.814841 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e7ae75-2afa-4f37-adbb-5722d569c81e None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:46.815135 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e7ae75-2afa-4f37-adbb-5722d569c81e None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:46.816392 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 174/346] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:02:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:02:46.821275 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e7ae75-2afa-4f37-adbb-5722d569c81e None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:46.854070 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:46.939036 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e7ae75-2afa-4f37-adbb-5722d569c81e None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:46.952910 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5419e5-a76e-442c-aced-e95e85d03f6d None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:46.979640 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0223c3d4-b959-4b4a-a69e-864ec9c2e848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:46.980305 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0223c3d4-b959-4b4a-a69e-864ec9c2e848 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:46.980591 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0223c3d4-b959-4b4a-a69e-864ec9c2e848 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:46.980870 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0223c3d4-b959-4b4a-a69e-864ec9c2e848 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:47.050441 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3672ac30-c05a-49c6-aad1-e2512182aa58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:47.051116 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3672ac30-c05a-49c6-aad1-e2512182aa58 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:47.052241 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3672ac30-c05a-49c6-aad1-e2512182aa58 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:47.052543 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3672ac30-c05a-49c6-aad1-e2512182aa58 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:47.053399 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3672ac30-c05a-49c6-aad1-e2512182aa58 None admin] RBAC: Adding query filter params (group.id=363e63ca29024f308dbb8d31e1742695, role.id=9f88c83743f745a9a785a2f454753f06, scope.project.id=6008ad7344a543cdae5546c3d2f389b1) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:02:47.053735 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3672ac30-c05a-49c6-aad1-e2512182aa58 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:47.055186 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3672ac30-c05a-49c6-aad1-e2512182aa58 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:47.059584 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0223c3d4-b959-4b4a-a69e-864ec9c2e848 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:47.061381 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0223c3d4-b959-4b4a-a69e-864ec9c2e848 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:47.062210 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 173/347] 10.222.0.43 () {56 vars in 1376 bytes} [Wed Jun 22 10:02:46 2022] GET /identity/v3/role_assignments?group.id=363e63ca29024f308dbb8d31e1742695&scope.project.id=6008ad7344a543cdae5546c3d2f389b1&role.id=9f88c83743f745a9a785a2f454753f06 => generated 260 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:02:47.063476 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53727764-fb68-4e11-8124-47120adb0d08 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:47.063771 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53727764-fb68-4e11-8124-47120adb0d08 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:47.064055 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53727764-fb68-4e11-8124-47120adb0d08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:47.070059 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:47.100297 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-53727764-fb68-4e11-8124-47120adb0d08 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:02:47.101537 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-53727764-fb68-4e11-8124-47120adb0d08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:02:47.221203 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 175/348] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Jun 22 10:02:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 10:02:47.222620 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892973e2-6769-4ff2-a4cb-049bd389d52e None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:47.222920 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892973e2-6769-4ff2-a4cb-049bd389d52e None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:47.223204 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892973e2-6769-4ff2-a4cb-049bd389d52e None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:47.225651 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 176/349] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:02:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:02:47.231281 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76454297-06e8-4b56-8803-2b4be05959dc None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:47.231570 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76454297-06e8-4b56-8803-2b4be05959dc None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:47.231839 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76454297-06e8-4b56-8803-2b4be05959dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:47.263649 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-76454297-06e8-4b56-8803-2b4be05959dc None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:02:47.264959 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-76454297-06e8-4b56-8803-2b4be05959dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:02:47.274204 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 174/350] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:02:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 10:02:47.275091 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53727764-fb68-4e11-8124-47120adb0d08 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:47.290173 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:47.398560 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 177/351] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:02:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 10:02:47.400097 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76454297-06e8-4b56-8803-2b4be05959dc None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:47.460074 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53727764-fb68-4e11-8124-47120adb0d08 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:47.467584 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:47.510478 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab61b70-3487-4536-9f5d-89cf33c716b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:47.511263 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab61b70-3487-4536-9f5d-89cf33c716b3 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:47.512051 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab61b70-3487-4536-9f5d-89cf33c716b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:47.512051 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab61b70-3487-4536-9f5d-89cf33c716b3 None admin] PATH_INFO: `/v3/projects/6008ad7344a543cdae5546c3d2f389b1` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:47.513093 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab61b70-3487-4536-9f5d-89cf33c716b3 None admin] RBAC: Authorizing `identity:get_project(project_id=6008ad7344a543cdae5546c3d2f389b1)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:47.515211 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab61b70-3487-4536-9f5d-89cf33c716b3 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:47.518082 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 175/352] 10.222.0.43 () {56 vars in 1186 bytes} [Wed Jun 22 10:02:47 2022] GET /identity/v3/projects/6008ad7344a543cdae5546c3d2f389b1 => generated 298 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:02:47.519112 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab61b70-3487-4536-9f5d-89cf33c716b3 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:47.554224 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76454297-06e8-4b56-8803-2b4be05959dc None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:47.604274 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0c6f98-8dd0-4cdf-932a-2264dcbf7315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:47.605081 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0c6f98-8dd0-4cdf-932a-2264dcbf7315 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:47.605367 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0c6f98-8dd0-4cdf-932a-2264dcbf7315 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:47.605650 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0c6f98-8dd0-4cdf-932a-2264dcbf7315 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:47.612335 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:47.619653 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0c6f98-8dd0-4cdf-932a-2264dcbf7315 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:02:47.627260 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-1a0c6f98-8dd0-4cdf-932a-2264dcbf7315 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 10:02:47.627260 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:02:47.627260 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:02:47.627260 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:02:47.627260 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:02:47.627260 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:02:47.627260 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:02:47.627260 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:02:47.627260 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:02:47.627260 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:02:47.627260 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:02:47.627260 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:02:47.627260 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:02:47.627260 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:02:47.627260 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:02:47.627260 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:02:47.628156 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:02:47.628156 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:02:47.628156 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:02:47.628156 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:02:47.628156 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:02:47.628156 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:02:47.628156 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:02:47.628156 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:02:47.628156 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:02:47.628156 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:02:47.628156 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:02:47.628156 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jun 22 10:02:47.628156 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:02:47.628156 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:02:47.628156 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:02:47.628156 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:02:47.628966 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:02:47.628966 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:02:47.628966 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:02:47.628966 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:02:47.628966 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:02:47.628966 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:02:47.628966 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:02:47.628966 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:02:47.628966 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:02:47.628966 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:02:47.628966 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 10:02:47.628966 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:02:47.628966 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 178/353] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Jun 22 10:02:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:02:47.629684 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7bd499-ccb4-4091-bbde-349d7109fcb3 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:47.629684 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7bd499-ccb4-4091-bbde-349d7109fcb3 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:47.629684 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7bd499-ccb4-4091-bbde-349d7109fcb3 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:47.632915 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 179/354] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:02:47 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:02:47.632915 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc81498f-2301-43b2-9833-f269dd829462 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:47.632915 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc81498f-2301-43b2-9833-f269dd829462 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:47.633155 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc81498f-2301-43b2-9833-f269dd829462 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:47.637041 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 180/355] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:02:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:02:47.637041 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc81498f-2301-43b2-9833-f269dd829462 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:47.661607 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab61b70-3487-4536-9f5d-89cf33c716b3 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:47.705993 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5b6f09-3f52-42fa-b872-5683314ca0a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:47.706800 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5b6f09-3f52-42fa-b872-5683314ca0a7 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:47.707083 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5b6f09-3f52-42fa-b872-5683314ca0a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:47.707360 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5b6f09-3f52-42fa-b872-5683314ca0a7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:47.723561 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5b6f09-3f52-42fa-b872-5683314ca0a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:02:47.732609 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-8d5b6f09-3f52-42fa-b872-5683314ca0a7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 10:02:47.732609 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:02:47.732609 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:02:47.732609 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:02:47.732609 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:02:47.732609 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:02:47.732609 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:02:47.732609 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:02:47.732609 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:02:47.732609 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:02:47.732609 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:02:47.732609 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:02:47.732609 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:02:47.732609 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:02:47.732609 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:02:47.732609 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:02:47.733524 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:02:47.733524 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:02:47.733524 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:02:47.733524 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:02:47.733524 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:02:47.733524 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:02:47.733524 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:02:47.733524 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:02:47.733524 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:02:47.733524 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:02:47.733524 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:02:47.733524 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( Jun 22 10:02:47.733524 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:02:47.733524 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:02:47.733524 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:02:47.733524 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:02:47.734422 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:02:47.734422 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:02:47.734422 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:02:47.734422 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:02:47.734422 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:02:47.734422 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:02:47.734422 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:02:47.734422 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:02:47.734422 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:02:47.734422 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:02:47.734422 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 10:02:47.734422 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:02:47.734422 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 176/356] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Jun 22 10:02:47 2022] GET /identity/v3/roles/reader => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:02:47.735083 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5b6f09-3f52-42fa-b872-5683314ca0a7 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:47.766285 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:47.772917 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc81498f-2301-43b2-9833-f269dd829462 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:47.813350 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ed7f60-10fa-4f94-a0ef-7688167556cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:47.814595 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ed7f60-10fa-4f94-a0ef-7688167556cf None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:47.815090 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ed7f60-10fa-4f94-a0ef-7688167556cf None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:47.815589 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ed7f60-10fa-4f94-a0ef-7688167556cf None admin] PATH_INFO: `/v3/groups/363e63ca29024f308dbb8d31e1742695` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:47.816974 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ed7f60-10fa-4f94-a0ef-7688167556cf None admin] RBAC: Authorizing `identity:get_group(group_id=363e63ca29024f308dbb8d31e1742695)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:47.819386 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ed7f60-10fa-4f94-a0ef-7688167556cf None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:47.821387 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 181/357] 10.222.0.43 () {56 vars in 1180 bytes} [Wed Jun 22 10:02:47 2022] GET /identity/v3/groups/363e63ca29024f308dbb8d31e1742695 => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:02:47.827249 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878b8aaf-32a3-41db-88a4-bdb36e544d2f None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:47.827249 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878b8aaf-32a3-41db-88a4-bdb36e544d2f None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:47.827249 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878b8aaf-32a3-41db-88a4-bdb36e544d2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:47.842921 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-878b8aaf-32a3-41db-88a4-bdb36e544d2f None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:02:47.844106 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-878b8aaf-32a3-41db-88a4-bdb36e544d2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:02:47.850145 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5b6f09-3f52-42fa-b872-5683314ca0a7 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:47.887141 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:47.890348 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74be5fee-688f-4336-a7f1-1511ef44a4ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:47.890612 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74be5fee-688f-4336-a7f1-1511ef44a4ad None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:47.890899 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74be5fee-688f-4336-a7f1-1511ef44a4ad None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:47.891230 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74be5fee-688f-4336-a7f1-1511ef44a4ad None admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:47.891940 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74be5fee-688f-4336-a7f1-1511ef44a4ad None admin] RBAC: Adding query filter params (name=member) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:02:47.893785 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74be5fee-688f-4336-a7f1-1511ef44a4ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:47.893785 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74be5fee-688f-4336-a7f1-1511ef44a4ad None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:47.903297 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 177/358] 10.222.0.43 () {56 vars in 1101 bytes} [Wed Jun 22 10:02:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:02:47.904369 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab21cfa6-e8c1-42f1-b9f2-776b31d8f13c None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:47.904657 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab21cfa6-e8c1-42f1-b9f2-776b31d8f13c None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:47.904933 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab21cfa6-e8c1-42f1-b9f2-776b31d8f13c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:47.924889 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-ab21cfa6-e8c1-42f1-b9f2-776b31d8f13c None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:02:47.926101 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-ab21cfa6-e8c1-42f1-b9f2-776b31d8f13c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:02:47.928048 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 182/359] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:02:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 10:02:47.928932 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878b8aaf-32a3-41db-88a4-bdb36e544d2f None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:48.015021 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 178/360] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:02:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 10:02:48.015880 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab21cfa6-e8c1-42f1-b9f2-776b31d8f13c None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:48.060046 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:48.070484 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878b8aaf-32a3-41db-88a4-bdb36e544d2f None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:48.120835 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0811500-7c5e-40e9-9a9b-ae4cf026565e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:48.121515 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0811500-7c5e-40e9-9a9b-ae4cf026565e None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:48.121836 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0811500-7c5e-40e9-9a9b-ae4cf026565e None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:48.122117 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0811500-7c5e-40e9-9a9b-ae4cf026565e None admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:48.122874 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0811500-7c5e-40e9-9a9b-ae4cf026565e None admin] RBAC: Adding query filter params (name=reader) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:02:48.123183 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0811500-7c5e-40e9-9a9b-ae4cf026565e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:48.124558 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0811500-7c5e-40e9-9a9b-ae4cf026565e None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:48.134614 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 183/361] 10.222.0.43 () {56 vars in 1101 bytes} [Wed Jun 22 10:02:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:02:48.135537 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0811500-7c5e-40e9-9a9b-ae4cf026565e None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:48.166494 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab21cfa6-e8c1-42f1-b9f2-776b31d8f13c None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:48.199484 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:48.213418 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5979b3a-3dbe-4337-af3c-dfaf3677c146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:48.214433 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5979b3a-3dbe-4337-af3c-dfaf3677c146 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:48.214954 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5979b3a-3dbe-4337-af3c-dfaf3677c146 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:48.215436 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5979b3a-3dbe-4337-af3c-dfaf3677c146 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:48.216576 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5979b3a-3dbe-4337-af3c-dfaf3677c146 None admin] RBAC: Adding query filter params (group.id=363e63ca29024f308dbb8d31e1742695, role.id=23a6a1fcd69d4210a8f2b45559b65aea, scope.project.id=6008ad7344a543cdae5546c3d2f389b1) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:02:48.216963 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5979b3a-3dbe-4337-af3c-dfaf3677c146 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:48.218566 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5979b3a-3dbe-4337-af3c-dfaf3677c146 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:48.228912 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 179/362] 10.222.0.43 () {56 vars in 1376 bytes} [Wed Jun 22 10:02:48 2022] GET /identity/v3/role_assignments?group.id=363e63ca29024f308dbb8d31e1742695&scope.project.id=6008ad7344a543cdae5546c3d2f389b1&role.id=23a6a1fcd69d4210a8f2b45559b65aea => generated 260 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:02:48.229763 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5979b3a-3dbe-4337-af3c-dfaf3677c146 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:48.265766 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0811500-7c5e-40e9-9a9b-ae4cf026565e None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:48.317335 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41bd1a8-dbe2-4d82-b1fc-7e34232f6223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:48.317801 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41bd1a8-dbe2-4d82-b1fc-7e34232f6223 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:48.318398 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41bd1a8-dbe2-4d82-b1fc-7e34232f6223 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:48.318758 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41bd1a8-dbe2-4d82-b1fc-7e34232f6223 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:48.355294 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:48.381922 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5979b3a-3dbe-4337-af3c-dfaf3677c146 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:48.423199 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41bd1a8-dbe2-4d82-b1fc-7e34232f6223 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:48.428826 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41bd1a8-dbe2-4d82-b1fc-7e34232f6223 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:48.437814 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b55f54-ab36-4538-9893-223784507e1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:48.439381 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b55f54-ab36-4538-9893-223784507e1c None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:48.439846 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b55f54-ab36-4538-9893-223784507e1c None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:48.440296 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b55f54-ab36-4538-9893-223784507e1c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:48.455311 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b55f54-ab36-4538-9893-223784507e1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:02:48.466546 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-c4b55f54-ab36-4538-9893-223784507e1c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 10:02:48.466546 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:02:48.466546 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:02:48.466546 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:02:48.466546 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:02:48.466546 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:02:48.466546 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:02:48.466546 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:02:48.466546 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:02:48.466546 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:02:48.466546 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:02:48.466546 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:02:48.466546 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:02:48.466546 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:02:48.466546 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:02:48.466546 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:02:48.467447 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:02:48.467447 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:02:48.467447 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:02:48.467447 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:02:48.467447 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:02:48.467447 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:02:48.467447 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:02:48.467447 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:02:48.467447 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:02:48.467447 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:02:48.467447 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:02:48.467447 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( Jun 22 10:02:48.467447 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:02:48.467447 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:02:48.467447 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:02:48.467447 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:02:48.468224 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:02:48.468224 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:02:48.468224 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:02:48.468224 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:02:48.468224 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:02:48.468224 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:02:48.468224 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:02:48.468224 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:02:48.468224 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:02:48.468224 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:02:48.468224 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 10:02:48.468224 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:02:48.471812 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 180/363] 10.222.0.43 () {56 vars in 1114 bytes} [Wed Jun 22 10:02:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:02:48.472877 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b55f54-ab36-4538-9893-223784507e1c None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:48.543296 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:48.565682 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 184/364] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Jun 22 10:02:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 10:02:48.566732 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41bd1a8-dbe2-4d82-b1fc-7e34232f6223 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:48.628620 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b55f54-ab36-4538-9893-223784507e1c None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:48.637124 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:48.674285 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190435dc-8bb7-4bfc-b9b1-db5a88e941b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:48.675202 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190435dc-8bb7-4bfc-b9b1-db5a88e941b0 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:48.675532 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190435dc-8bb7-4bfc-b9b1-db5a88e941b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:48.675893 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190435dc-8bb7-4bfc-b9b1-db5a88e941b0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:48.684763 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41bd1a8-dbe2-4d82-b1fc-7e34232f6223 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:48.688005 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190435dc-8bb7-4bfc-b9b1-db5a88e941b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:02:48.697465 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-190435dc-8bb7-4bfc-b9b1-db5a88e941b0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 10:02:48.697465 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:02:48.697465 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:02:48.697465 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:02:48.697465 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:02:48.697465 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:02:48.697465 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:02:48.697465 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:02:48.697465 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:02:48.697465 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:02:48.697465 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:02:48.697465 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:02:48.697465 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:02:48.697465 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:02:48.697465 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:02:48.697465 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:02:48.698384 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:02:48.698384 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:02:48.698384 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:02:48.698384 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:02:48.698384 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:02:48.698384 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:02:48.698384 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:02:48.698384 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:02:48.698384 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:02:48.698384 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:02:48.698384 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:02:48.698384 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( Jun 22 10:02:48.698384 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:02:48.698384 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:02:48.698384 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:02:48.698384 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:02:48.699166 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:02:48.699166 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:02:48.699166 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:02:48.699166 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:02:48.699166 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:02:48.699166 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:02:48.699166 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:02:48.699166 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:02:48.699166 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:02:48.699166 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:02:48.699166 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 10:02:48.699166 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:02:48.699166 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 181/365] 10.222.0.43 () {56 vars in 1096 bytes} [Wed Jun 22 10:02:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:02:48.700291 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190435dc-8bb7-4bfc-b9b1-db5a88e941b0 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:48.722775 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473d99a5-567c-4453-8c25-39601d61230d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:48.724509 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473d99a5-567c-4453-8c25-39601d61230d None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:48.725052 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473d99a5-567c-4453-8c25-39601d61230d None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:48.725338 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473d99a5-567c-4453-8c25-39601d61230d None admin] PATH_INFO: `/v3/users/3505a52281364d26a3b0d6ad0fe86a3b` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:48.727010 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473d99a5-567c-4453-8c25-39601d61230d None admin] RBAC: Authorizing `identity:get_user(user_id=3505a52281364d26a3b0d6ad0fe86a3b)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:48.728544 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473d99a5-567c-4453-8c25-39601d61230d None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:48.730236 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 185/366] 10.222.0.43 () {56 vars in 1177 bytes} [Wed Jun 22 10:02:48 2022] GET /identity/v3/users/3505a52281364d26a3b0d6ad0fe86a3b => generated 293 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:02:48.731075 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473d99a5-567c-4453-8c25-39601d61230d None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:48.824486 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190435dc-8bb7-4bfc-b9b1-db5a88e941b0 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:48.835908 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:48.839420 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473d99a5-567c-4453-8c25-39601d61230d None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:48.868023 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:48.870028 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925ed5b1-96c9-4d05-8f58-31e340d46a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:48.870746 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925ed5b1-96c9-4d05-8f58-31e340d46a6f None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:48.871190 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925ed5b1-96c9-4d05-8f58-31e340d46a6f None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:48.871553 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925ed5b1-96c9-4d05-8f58-31e340d46a6f None admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:48.872392 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925ed5b1-96c9-4d05-8f58-31e340d46a6f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:02:48.872778 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925ed5b1-96c9-4d05-8f58-31e340d46a6f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:48.874338 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925ed5b1-96c9-4d05-8f58-31e340d46a6f None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:48.882372 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f750253-f14e-4e71-bc5d-ea2cd5edbb74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:48.883184 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f750253-f14e-4e71-bc5d-ea2cd5edbb74 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:48.883476 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f750253-f14e-4e71-bc5d-ea2cd5edbb74 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:48.883762 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f750253-f14e-4e71-bc5d-ea2cd5edbb74 None admin] PATH_INFO: `/v3/projects/d828ff8720114b1b9da6709b7e51dcee` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:48.885047 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f750253-f14e-4e71-bc5d-ea2cd5edbb74 None admin] RBAC: Authorizing `identity:get_project(project_id=d828ff8720114b1b9da6709b7e51dcee)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:48.885978 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 182/367] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Jun 22 10:02:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:02:48.886585 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f750253-f14e-4e71-bc5d-ea2cd5edbb74 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:48.886822 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925ed5b1-96c9-4d05-8f58-31e340d46a6f None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:48.888699 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 186/368] 10.222.0.43 () {56 vars in 1186 bytes} [Wed Jun 22 10:02:48 2022] GET /identity/v3/projects/d828ff8720114b1b9da6709b7e51dcee => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:02:48.889464 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f750253-f14e-4e71-bc5d-ea2cd5edbb74 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:49.005998 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925ed5b1-96c9-4d05-8f58-31e340d46a6f None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:49.007278 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f750253-f14e-4e71-bc5d-ea2cd5edbb74 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:49.049593 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93564b5-e696-4f22-b951-c9e703726b67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:49.050296 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93564b5-e696-4f22-b951-c9e703726b67 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:49.050586 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93564b5-e696-4f22-b951-c9e703726b67 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:49.050873 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93564b5-e696-4f22-b951-c9e703726b67 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:49.052252 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93564b5-e696-4f22-b951-c9e703726b67 None admin] RBAC: Adding query filter params (role.id=4a03c0e749d84649a230831b1e6644a4, user.id=3505a52281364d26a3b0d6ad0fe86a3b, scope.system=all) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:02:49.052548 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93564b5-e696-4f22-b951-c9e703726b67 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:49.054292 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93564b5-e696-4f22-b951-c9e703726b67 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:49.057530 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f954ec16-8064-48cd-88d6-2488977ffdbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:49.058267 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f954ec16-8064-48cd-88d6-2488977ffdbf None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:49.058555 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f954ec16-8064-48cd-88d6-2488977ffdbf None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:49.058837 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f954ec16-8064-48cd-88d6-2488977ffdbf None admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:49.059693 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f954ec16-8064-48cd-88d6-2488977ffdbf None admin] RBAC: Adding query filter params (name=admin) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:02:49.060019 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f954ec16-8064-48cd-88d6-2488977ffdbf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:49.061533 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f954ec16-8064-48cd-88d6-2488977ffdbf None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:49.068180 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 187/369] 10.222.0.43 () {56 vars in 1308 bytes} [Wed Jun 22 10:02:48 2022] GET /identity/v3/role_assignments?user.id=3505a52281364d26a3b0d6ad0fe86a3b&scope.system=all&role.id=4a03c0e749d84649a230831b1e6644a4 => generated 510 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:02:49.068789 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93564b5-e696-4f22-b951-c9e703726b67 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:49.075947 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 183/370] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Jun 22 10:02:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:02:49.076985 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f954ec16-8064-48cd-88d6-2488977ffdbf None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:49.117219 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:49.131757 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:49.193178 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93564b5-e696-4f22-b951-c9e703726b67 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:49.209988 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f954ec16-8064-48cd-88d6-2488977ffdbf None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:49.239977 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69551e1e-1f93-43cf-b5d5-9dd258bd5242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:49.240856 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69551e1e-1f93-43cf-b5d5-9dd258bd5242 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:49.241144 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69551e1e-1f93-43cf-b5d5-9dd258bd5242 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:49.241544 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69551e1e-1f93-43cf-b5d5-9dd258bd5242 None admin] PATH_INFO: `/v3/groups/363e63ca29024f308dbb8d31e1742695` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:49.242883 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69551e1e-1f93-43cf-b5d5-9dd258bd5242 None admin] RBAC: Authorizing `identity:get_group(group_id=363e63ca29024f308dbb8d31e1742695)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:49.244486 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69551e1e-1f93-43cf-b5d5-9dd258bd5242 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:49.246360 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 188/371] 10.222.0.43 () {56 vars in 1180 bytes} [Wed Jun 22 10:02:49 2022] GET /identity/v3/groups/363e63ca29024f308dbb8d31e1742695 => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:02:49.247153 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69551e1e-1f93-43cf-b5d5-9dd258bd5242 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:49.291745 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d30572-240c-49f6-b2fc-0874ade4dab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:49.292421 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d30572-240c-49f6-b2fc-0874ade4dab4 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:49.292707 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d30572-240c-49f6-b2fc-0874ade4dab4 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:49.292986 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d30572-240c-49f6-b2fc-0874ade4dab4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:49.362985 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69551e1e-1f93-43cf-b5d5-9dd258bd5242 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:49.383171 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:49.406398 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a258b1f8-6d92-4102-b742-861ab41fc5ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:49.407064 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a258b1f8-6d92-4102-b742-861ab41fc5ad None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:49.407352 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a258b1f8-6d92-4102-b742-861ab41fc5ad None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:49.407637 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a258b1f8-6d92-4102-b742-861ab41fc5ad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:49.438621 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d30572-240c-49f6-b2fc-0874ade4dab4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:49.440197 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d30572-240c-49f6-b2fc-0874ade4dab4 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:49.481783 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:49.504000 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a258b1f8-6d92-4102-b742-861ab41fc5ad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:49.506263 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a258b1f8-6d92-4102-b742-861ab41fc5ad None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:49.563138 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 184/372] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Jun 22 10:02:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 10:02:49.564054 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d30572-240c-49f6-b2fc-0874ade4dab4 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:49.628022 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 189/373] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Jun 22 10:02:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 10:02:49.629425 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d2dac1-3a32-4315-8dc5-87836929ad94 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:49.630387 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d2dac1-3a32-4315-8dc5-87836929ad94 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:49.631305 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d2dac1-3a32-4315-8dc5-87836929ad94 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:49.633112 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 190/374] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:02:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:02:49.634033 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d2dac1-3a32-4315-8dc5-87836929ad94 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:49.666207 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:49.695899 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d30572-240c-49f6-b2fc-0874ade4dab4 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:49.742173 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:49.754019 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ebbe76-0f1a-49a4-80c7-32cd06939494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:49.754913 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ebbe76-0f1a-49a4-80c7-32cd06939494 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:49.755738 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ebbe76-0f1a-49a4-80c7-32cd06939494 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:49.756780 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ebbe76-0f1a-49a4-80c7-32cd06939494 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:49.757644 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ebbe76-0f1a-49a4-80c7-32cd06939494 None admin] RBAC: Adding query filter params (group.id=363e63ca29024f308dbb8d31e1742695, role.id=9f88c83743f745a9a785a2f454753f06, scope.project.id=d828ff8720114b1b9da6709b7e51dcee) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:02:49.757985 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ebbe76-0f1a-49a4-80c7-32cd06939494 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:49.759947 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ebbe76-0f1a-49a4-80c7-32cd06939494 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:49.770708 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 185/375] 10.222.0.43 () {56 vars in 1376 bytes} [Wed Jun 22 10:02:49 2022] GET /identity/v3/role_assignments?group.id=363e63ca29024f308dbb8d31e1742695&scope.project.id=d828ff8720114b1b9da6709b7e51dcee&role.id=9f88c83743f745a9a785a2f454753f06 => generated 260 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:02:49.772940 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ebbe76-0f1a-49a4-80c7-32cd06939494 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:49.794145 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d2dac1-3a32-4315-8dc5-87836929ad94 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:49.851249 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ff66c0-ad0f-4c23-8bed-a50a3d330064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:49.851963 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ff66c0-ad0f-4c23-8bed-a50a3d330064 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:49.852249 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ff66c0-ad0f-4c23-8bed-a50a3d330064 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:49.852528 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ff66c0-ad0f-4c23-8bed-a50a3d330064 None admin] PATH_INFO: `/v3/projects/d828ff8720114b1b9da6709b7e51dcee` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:49.853810 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ff66c0-ad0f-4c23-8bed-a50a3d330064 None admin] RBAC: Authorizing `identity:get_project(project_id=d828ff8720114b1b9da6709b7e51dcee)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:49.855293 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ff66c0-ad0f-4c23-8bed-a50a3d330064 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:49.857078 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 191/376] 10.222.0.43 () {56 vars in 1186 bytes} [Wed Jun 22 10:02:49 2022] GET /identity/v3/projects/d828ff8720114b1b9da6709b7e51dcee => generated 302 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:02:49.863064 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccec3f1-b90a-4891-814e-ca18e2037540 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:49.863356 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccec3f1-b90a-4891-814e-ca18e2037540 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:49.863642 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccec3f1-b90a-4891-814e-ca18e2037540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:49.887912 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-eccec3f1-b90a-4891-814e-ca18e2037540 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:02:49.889132 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-eccec3f1-b90a-4891-814e-ca18e2037540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:02:49.922678 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ebbe76-0f1a-49a4-80c7-32cd06939494 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:49.969068 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e809334f-a4fe-4ab9-a89e-f257d9781332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:49.970266 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e809334f-a4fe-4ab9-a89e-f257d9781332 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:49.970394 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e809334f-a4fe-4ab9-a89e-f257d9781332 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:49.970574 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e809334f-a4fe-4ab9-a89e-f257d9781332 None admin] PATH_INFO: `/v3/projects/24726cc2fba44a5087e961da4a7cd653` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:49.971777 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e809334f-a4fe-4ab9-a89e-f257d9781332 None admin] RBAC: Authorizing `identity:get_project(project_id=24726cc2fba44a5087e961da4a7cd653)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:49.973407 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e809334f-a4fe-4ab9-a89e-f257d9781332 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:49.977340 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 186/377] 10.222.0.43 () {56 vars in 1186 bytes} [Wed Jun 22 10:02:49 2022] GET /identity/v3/projects/24726cc2fba44a5087e961da4a7cd653 => generated 344 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:02:49.978253 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e809334f-a4fe-4ab9-a89e-f257d9781332 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:49.979635 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 192/378] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:02:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 10:02:49.983142 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccec3f1-b90a-4891-814e-ca18e2037540 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:50.003963 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:50.102067 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:50.135097 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e809334f-a4fe-4ab9-a89e-f257d9781332 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:50.146563 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccec3f1-b90a-4891-814e-ca18e2037540 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:50.196644 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4316176-06b5-4bf6-bafb-15f6badcf319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:50.196644 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4316176-06b5-4bf6-bafb-15f6badcf319 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:50.196644 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4316176-06b5-4bf6-bafb-15f6badcf319 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:50.196644 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4316176-06b5-4bf6-bafb-15f6badcf319 None admin] PATH_INFO: `/v3/groups/363e63ca29024f308dbb8d31e1742695` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:50.200592 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4316176-06b5-4bf6-bafb-15f6badcf319 None admin] RBAC: Authorizing `identity:get_group(group_id=363e63ca29024f308dbb8d31e1742695)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:50.200592 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4316176-06b5-4bf6-bafb-15f6badcf319 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:50.201250 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 187/379] 10.222.0.43 () {56 vars in 1180 bytes} [Wed Jun 22 10:02:49 2022] GET /identity/v3/groups/363e63ca29024f308dbb8d31e1742695 => generated 226 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:02:50.202250 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4316176-06b5-4bf6-bafb-15f6badcf319 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:50.207167 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85814339-b80c-4248-bfa8-aca860537c71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:50.208300 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85814339-b80c-4248-bfa8-aca860537c71 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:50.208664 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85814339-b80c-4248-bfa8-aca860537c71 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:50.209878 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85814339-b80c-4248-bfa8-aca860537c71 None admin] PATH_INFO: `/v3/groups/2b845b5bde804251ac3b4e081860c876` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:50.222656 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85814339-b80c-4248-bfa8-aca860537c71 None admin] RBAC: Authorizing `identity:get_group(group_id=2b845b5bde804251ac3b4e081860c876)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:50.225635 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85814339-b80c-4248-bfa8-aca860537c71 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:50.228217 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 193/380] 10.222.0.43 () {56 vars in 1180 bytes} [Wed Jun 22 10:02:49 2022] GET /identity/v3/groups/2b845b5bde804251ac3b4e081860c876 => generated 229 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:02:50.229875 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85814339-b80c-4248-bfa8-aca860537c71 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:50.324609 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4316176-06b5-4bf6-bafb-15f6badcf319 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:50.338641 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:50.356718 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:50.361933 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eda7a66-5c10-4667-8048-413454016502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:50.362882 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eda7a66-5c10-4667-8048-413454016502 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:50.363230 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eda7a66-5c10-4667-8048-413454016502 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:50.364192 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eda7a66-5c10-4667-8048-413454016502 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:50.364791 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85814339-b80c-4248-bfa8-aca860537c71 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:50.376335 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eda7a66-5c10-4667-8048-413454016502 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:02:50.385152 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-6eda7a66-5c10-4667-8048-413454016502 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 10:02:50.385152 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:02:50.385152 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:02:50.385152 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:02:50.385152 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:02:50.385152 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:02:50.385152 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:02:50.385152 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:02:50.385152 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:02:50.385152 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:02:50.385152 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:02:50.385152 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:02:50.385152 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:02:50.385152 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:02:50.385152 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:02:50.385152 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:02:50.386101 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:02:50.386101 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:02:50.386101 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:02:50.386101 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:02:50.386101 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:02:50.386101 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:02:50.386101 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:02:50.386101 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:02:50.386101 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:02:50.386101 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:02:50.386101 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:02:50.386101 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( Jun 22 10:02:50.386101 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:02:50.386101 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:02:50.386101 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:02:50.386101 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:02:50.386905 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:02:50.386905 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:02:50.386905 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:02:50.386905 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:02:50.386905 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:02:50.386905 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:02:50.386905 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:02:50.386905 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:02:50.386905 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:02:50.386905 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:02:50.386905 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 10:02:50.386905 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:02:50.389301 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 188/381] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Jun 22 10:02:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:02:50.390278 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eda7a66-5c10-4667-8048-413454016502 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:50.404830 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a0a3c3-fc7d-4070-ac2a-1780184c2bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:50.405713 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a0a3c3-fc7d-4070-ac2a-1780184c2bba None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:50.406109 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a0a3c3-fc7d-4070-ac2a-1780184c2bba None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:50.406463 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a0a3c3-fc7d-4070-ac2a-1780184c2bba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:50.407380 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a0a3c3-fc7d-4070-ac2a-1780184c2bba None admin] RBAC: Adding query filter params (group.id=363e63ca29024f308dbb8d31e1742695, role.id=23a6a1fcd69d4210a8f2b45559b65aea, scope.project.id=d828ff8720114b1b9da6709b7e51dcee) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:02:50.407815 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a0a3c3-fc7d-4070-ac2a-1780184c2bba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:50.409491 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a0a3c3-fc7d-4070-ac2a-1780184c2bba None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:50.416998 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 194/382] 10.222.0.43 () {56 vars in 1376 bytes} [Wed Jun 22 10:02:50 2022] GET /identity/v3/role_assignments?group.id=363e63ca29024f308dbb8d31e1742695&scope.project.id=d828ff8720114b1b9da6709b7e51dcee&role.id=23a6a1fcd69d4210a8f2b45559b65aea => generated 260 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:02:50.418025 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a0a3c3-fc7d-4070-ac2a-1780184c2bba None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:50.507414 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eda7a66-5c10-4667-8048-413454016502 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:50.545199 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4c5268-14eb-4bd2-8edd-38a6029c8073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:50.546268 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4c5268-14eb-4bd2-8edd-38a6029c8073 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:50.546748 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4c5268-14eb-4bd2-8edd-38a6029c8073 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:50.547217 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4c5268-14eb-4bd2-8edd-38a6029c8073 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:50.547338 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a0a3c3-fc7d-4070-ac2a-1780184c2bba None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:50.548372 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4c5268-14eb-4bd2-8edd-38a6029c8073 None admin] RBAC: Adding query filter params (group.id=2b845b5bde804251ac3b4e081860c876, role.id=26d9c2ab5dfc4e6d9ca80c6014123906, scope.project.id=24726cc2fba44a5087e961da4a7cd653) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:02:50.548887 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4c5268-14eb-4bd2-8edd-38a6029c8073 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:50.550666 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4c5268-14eb-4bd2-8edd-38a6029c8073 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:50.557863 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 189/383] 10.222.0.43 () {56 vars in 1376 bytes} [Wed Jun 22 10:02:50 2022] GET /identity/v3/role_assignments?group.id=2b845b5bde804251ac3b4e081860c876&scope.project.id=24726cc2fba44a5087e961da4a7cd653&role.id=26d9c2ab5dfc4e6d9ca80c6014123906 => generated 260 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:02:50.603182 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbd053e-13e7-47b1-ab52-6cc6208bb55f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:50.604224 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbd053e-13e7-47b1-ab52-6cc6208bb55f None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:50.604705 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbd053e-13e7-47b1-ab52-6cc6208bb55f None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:50.605187 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbd053e-13e7-47b1-ab52-6cc6208bb55f None admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:50.606243 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbd053e-13e7-47b1-ab52-6cc6208bb55f None admin] RBAC: Adding query filter params (name=member) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:02:50.606820 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbd053e-13e7-47b1-ab52-6cc6208bb55f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:50.608479 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbd053e-13e7-47b1-ab52-6cc6208bb55f None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:50.620737 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 195/384] 10.222.0.43 () {56 vars in 1101 bytes} [Wed Jun 22 10:02:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:02:50.626814 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4c5268-14eb-4bd2-8edd-38a6029c8073 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:50.705983 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbf32e2-dce0-4180-9753-b128cda38a02 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:50.706645 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbf32e2-dce0-4180-9753-b128cda38a02 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:50.707143 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbf32e2-dce0-4180-9753-b128cda38a02 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:50.709841 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 196/385] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:02:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 10:02:50.715707 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2a9be4-f924-4c99-a77e-b8fa4dc5dd9b None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:50.716319 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2a9be4-f924-4c99-a77e-b8fa4dc5dd9b None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:50.716808 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2a9be4-f924-4c99-a77e-b8fa4dc5dd9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:50.721458 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:50.737370 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:50.749265 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-2e2a9be4-f924-4c99-a77e-b8fa4dc5dd9b None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:02:50.751194 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-2e2a9be4-f924-4c99-a77e-b8fa4dc5dd9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:02:50.790541 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4c5268-14eb-4bd2-8edd-38a6029c8073 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:50.838283 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21789833-f767-4e09-bf46-4ec0e0bc6fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:50.839167 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21789833-f767-4e09-bf46-4ec0e0bc6fd3 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:50.839453 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21789833-f767-4e09-bf46-4ec0e0bc6fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:50.839744 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21789833-f767-4e09-bf46-4ec0e0bc6fd3 None admin] PATH_INFO: `/v3/groups/363e63ca29024f308dbb8d31e1742695` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:50.843142 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21789833-f767-4e09-bf46-4ec0e0bc6fd3 None admin] RBAC: Authorizing `identity:get_group(group_id=363e63ca29024f308dbb8d31e1742695)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:50.844623 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21789833-f767-4e09-bf46-4ec0e0bc6fd3 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:50.846294 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 190/386] 10.222.0.43 () {56 vars in 1180 bytes} [Wed Jun 22 10:02:50 2022] GET /identity/v3/groups/363e63ca29024f308dbb8d31e1742695 => generated 226 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:02:50.852139 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 197/387] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:02:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 10:02:50.853081 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21789833-f767-4e09-bf46-4ec0e0bc6fd3 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:50.876571 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2a9be4-f924-4c99-a77e-b8fa4dc5dd9b None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:50.994096 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2a9be4-f924-4c99-a77e-b8fa4dc5dd9b None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:51.032213 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c388ceef-8e98-4896-be0b-ef288e408563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:51.033049 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c388ceef-8e98-4896-be0b-ef288e408563 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:51.033339 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c388ceef-8e98-4896-be0b-ef288e408563 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:51.033617 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c388ceef-8e98-4896-be0b-ef288e408563 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:51.045433 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c388ceef-8e98-4896-be0b-ef288e408563 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:02:51.058133 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:51.063440 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-c388ceef-8e98-4896-be0b-ef288e408563 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 10:02:51.063440 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:02:51.063440 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:02:51.063440 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:02:51.063440 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:02:51.063440 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:02:51.063440 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:02:51.063440 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:02:51.063440 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:02:51.063440 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:02:51.063440 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:02:51.063440 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:02:51.063440 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:02:51.063440 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:02:51.063440 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:02:51.063440 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:02:51.064365 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:02:51.064365 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:02:51.064365 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:02:51.064365 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:02:51.064365 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:02:51.064365 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:02:51.064365 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:02:51.064365 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:02:51.064365 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:02:51.064365 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:02:51.064365 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:02:51.064365 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jun 22 10:02:51.064365 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:02:51.064365 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:02:51.064365 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:02:51.064365 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:02:51.065150 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:02:51.065150 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:02:51.065150 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:02:51.065150 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:02:51.065150 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:02:51.065150 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:02:51.065150 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:02:51.065150 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:02:51.065150 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:02:51.065150 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:02:51.065150 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 10:02:51.065150 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:02:51.065150 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 198/388] 10.222.0.43 () {56 vars in 1114 bytes} [Wed Jun 22 10:02:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:02:51.077532 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c388ceef-8e98-4896-be0b-ef288e408563 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:51.109891 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21789833-f767-4e09-bf46-4ec0e0bc6fd3 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:51.154250 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:51.178216 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c94495-8f53-4d18-bfb8-31da544f7dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:51.179145 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c94495-8f53-4d18-bfb8-31da544f7dfe None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:51.179482 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c94495-8f53-4d18-bfb8-31da544f7dfe None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:51.179762 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c94495-8f53-4d18-bfb8-31da544f7dfe None admin] PATH_INFO: `/v3/projects/6008ad7344a543cdae5546c3d2f389b1` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:51.182257 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c94495-8f53-4d18-bfb8-31da544f7dfe None admin] RBAC: Authorizing `identity:get_project(project_id=6008ad7344a543cdae5546c3d2f389b1)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:51.183732 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c94495-8f53-4d18-bfb8-31da544f7dfe None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:51.185604 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 191/389] 10.222.0.43 () {56 vars in 1186 bytes} [Wed Jun 22 10:02:50 2022] GET /identity/v3/projects/6008ad7344a543cdae5546c3d2f389b1 => generated 298 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:02:51.193891 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c94495-8f53-4d18-bfb8-31da544f7dfe None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:51.285449 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c388ceef-8e98-4896-be0b-ef288e408563 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:51.353426 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4874ae2c-4827-49f5-a588-d99ca977860b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:51.354136 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4874ae2c-4827-49f5-a588-d99ca977860b None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:51.354422 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4874ae2c-4827-49f5-a588-d99ca977860b None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:51.354698 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4874ae2c-4827-49f5-a588-d99ca977860b None admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:51.355453 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4874ae2c-4827-49f5-a588-d99ca977860b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:02:51.355759 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4874ae2c-4827-49f5-a588-d99ca977860b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:51.357172 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4874ae2c-4827-49f5-a588-d99ca977860b None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:51.377454 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 199/390] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Jun 22 10:02:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:02:51.383566 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4874ae2c-4827-49f5-a588-d99ca977860b None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:51.407812 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c94495-8f53-4d18-bfb8-31da544f7dfe None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:51.447689 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1940f9c1-3c43-4c2a-b499-91bbe9e3cdeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:51.448590 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1940f9c1-3c43-4c2a-b499-91bbe9e3cdeb None admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:51.448869 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1940f9c1-3c43-4c2a-b499-91bbe9e3cdeb None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:51.449142 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1940f9c1-3c43-4c2a-b499-91bbe9e3cdeb None admin] PATH_INFO: `/v3/projects/6008ad7344a543cdae5546c3d2f389b1/groups/363e63ca29024f308dbb8d31e1742695/roles/9f88c83743f745a9a785a2f454753f06` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:51.452203 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1940f9c1-3c43-4c2a-b499-91bbe9e3cdeb None admin] RBAC: Authorizing `identity:create_grant(project_id=6008ad7344a543cdae5546c3d2f389b1, group_id=363e63ca29024f308dbb8d31e1742695, role_id=9f88c83743f745a9a785a2f454753f06)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:51.453674 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1940f9c1-3c43-4c2a-b499-91bbe9e3cdeb None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:51.480390 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 192/391] 10.222.0.43 () {58 vars in 1442 bytes} [Wed Jun 22 10:02:51 2022] PUT /identity/v3/projects/6008ad7344a543cdae5546c3d2f389b1/groups/363e63ca29024f308dbb8d31e1742695/roles/9f88c83743f745a9a785a2f454753f06 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:02:51.487949 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:51.554424 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4874ae2c-4827-49f5-a588-d99ca977860b None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:51.602380 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ca6f1b-afdf-484b-bd1d-d9ffa6830ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:51.603279 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ca6f1b-afdf-484b-bd1d-d9ffa6830ec8 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:51.603568 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ca6f1b-afdf-484b-bd1d-d9ffa6830ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:51.603851 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ca6f1b-afdf-484b-bd1d-d9ffa6830ec8 None admin] PATH_INFO: `/v3/groups/363e63ca29024f308dbb8d31e1742695` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:51.605085 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ca6f1b-afdf-484b-bd1d-d9ffa6830ec8 None admin] RBAC: Authorizing `identity:get_group(group_id=363e63ca29024f308dbb8d31e1742695)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:51.606618 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ca6f1b-afdf-484b-bd1d-d9ffa6830ec8 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:51.608632 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 200/392] 10.222.0.43 () {56 vars in 1180 bytes} [Wed Jun 22 10:02:51 2022] GET /identity/v3/groups/363e63ca29024f308dbb8d31e1742695 => generated 226 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:02:51.615146 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1940f9c1-3c43-4c2a-b499-91bbe9e3cdeb None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:51.704834 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:51.769799 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1940f9c1-3c43-4c2a-b499-91bbe9e3cdeb None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:51.808692 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b95c89-3486-4b1a-b157-c87db5cb2f03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:51.809786 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b95c89-3486-4b1a-b157-c87db5cb2f03 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:51.810071 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b95c89-3486-4b1a-b157-c87db5cb2f03 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:51.810347 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b95c89-3486-4b1a-b157-c87db5cb2f03 None admin] PATH_INFO: `/v3/projects/6008ad7344a543cdae5546c3d2f389b1` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:51.811560 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b95c89-3486-4b1a-b157-c87db5cb2f03 None admin] RBAC: Authorizing `identity:get_project(project_id=6008ad7344a543cdae5546c3d2f389b1)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:51.813217 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b95c89-3486-4b1a-b157-c87db5cb2f03 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:51.815461 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 193/393] 10.222.0.43 () {56 vars in 1186 bytes} [Wed Jun 22 10:02:51 2022] GET /identity/v3/projects/6008ad7344a543cdae5546c3d2f389b1 => generated 298 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:02:51.821484 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ca6f1b-afdf-484b-bd1d-d9ffa6830ec8 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:51.949583 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ca6f1b-afdf-484b-bd1d-d9ffa6830ec8 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:51.979864 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:51.990104 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a751de5-66c1-43c7-afdf-f23ae695a125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:51.991700 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a751de5-66c1-43c7-afdf-f23ae695a125 None admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:51.992392 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a751de5-66c1-43c7-afdf-f23ae695a125 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:51.993073 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a751de5-66c1-43c7-afdf-f23ae695a125 None admin] PATH_INFO: `/v3/projects/6008ad7344a543cdae5546c3d2f389b1/groups/363e63ca29024f308dbb8d31e1742695/roles/23a6a1fcd69d4210a8f2b45559b65aea` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:51.995377 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a751de5-66c1-43c7-afdf-f23ae695a125 None admin] RBAC: Authorizing `identity:create_grant(project_id=6008ad7344a543cdae5546c3d2f389b1, group_id=363e63ca29024f308dbb8d31e1742695, role_id=23a6a1fcd69d4210a8f2b45559b65aea)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:51.996828 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a751de5-66c1-43c7-afdf-f23ae695a125 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:52.015415 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 201/394] 10.222.0.43 () {58 vars in 1442 bytes} [Wed Jun 22 10:02:51 2022] PUT /identity/v3/projects/6008ad7344a543cdae5546c3d2f389b1/groups/363e63ca29024f308dbb8d31e1742695/roles/23a6a1fcd69d4210a8f2b45559b65aea => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:02:52.625534 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d866ae8c-dbe6-4cbe-98b8-bc129b1faa44 None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:52.626465 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d866ae8c-dbe6-4cbe-98b8-bc129b1faa44 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:52.626885 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d866ae8c-dbe6-4cbe-98b8-bc129b1faa44 None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:52.628393 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 194/395] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:02:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:02:52.634654 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f446ecd-9ca2-406e-a8d6-0ad1af062e63 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:52.635480 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f446ecd-9ca2-406e-a8d6-0ad1af062e63 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:52.635914 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f446ecd-9ca2-406e-a8d6-0ad1af062e63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:52.657951 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-2f446ecd-9ca2-406e-a8d6-0ad1af062e63 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:02:52.659386 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-2f446ecd-9ca2-406e-a8d6-0ad1af062e63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:02:52.772177 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 202/396] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:02:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 10:02:52.803462 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d866ae8c-dbe6-4cbe-98b8-bc129b1faa44 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:52.981288 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d866ae8c-dbe6-4cbe-98b8-bc129b1faa44 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:53.011329 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:53.028727 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5cc392-3d24-4d83-b7cb-0dd44c64778c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:53.029531 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5cc392-3d24-4d83-b7cb-0dd44c64778c None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:53.029840 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5cc392-3d24-4d83-b7cb-0dd44c64778c None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:53.030118 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5cc392-3d24-4d83-b7cb-0dd44c64778c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:53.036676 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dfb176-c528-42fe-bf46-425122d769a5 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:53.037202 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dfb176-c528-42fe-bf46-425122d769a5 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:53.037642 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dfb176-c528-42fe-bf46-425122d769a5 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:53.039562 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 203/397] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:02:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:02:53.045457 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5cc392-3d24-4d83-b7cb-0dd44c64778c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:02:53.057521 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-2a5cc392-3d24-4d83-b7cb-0dd44c64778c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 10:02:53.057521 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:02:53.057521 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:02:53.057521 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:02:53.057521 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:02:53.057521 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:02:53.057521 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:02:53.057521 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:02:53.057521 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:02:53.057521 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:02:53.057521 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:02:53.057521 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:02:53.057521 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:02:53.057521 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:02:53.057521 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:02:53.057521 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:02:53.058436 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:02:53.058436 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:02:53.058436 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:02:53.058436 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:02:53.058436 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:02:53.058436 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:02:53.058436 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:02:53.058436 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:02:53.058436 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:02:53.058436 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:02:53.058436 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:02:53.058436 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( Jun 22 10:02:53.058436 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:02:53.058436 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:02:53.058436 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:02:53.058436 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:02:53.059318 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:02:53.059318 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:02:53.059318 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:02:53.059318 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:02:53.059318 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:02:53.059318 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:02:53.059318 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:02:53.059318 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:02:53.059318 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:02:53.059318 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:02:53.059318 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 10:02:53.059318 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:02:53.059318 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 195/398] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Jun 22 10:02:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:02:53.065959 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5cc392-3d24-4d83-b7cb-0dd44c64778c None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:53.066789 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a738b2f-2e8a-4d73-93b2-11446b4f3473 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:53.067391 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a738b2f-2e8a-4d73-93b2-11446b4f3473 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:53.067878 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a738b2f-2e8a-4d73-93b2-11446b4f3473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:53.113619 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-9a738b2f-2e8a-4d73-93b2-11446b4f3473 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:02:53.117162 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-9a738b2f-2e8a-4d73-93b2-11446b4f3473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:02:53.186203 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5cc392-3d24-4d83-b7cb-0dd44c64778c None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:53.236121 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871e8e23-3cf0-459a-96d7-392c0a71e2da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:53.236951 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871e8e23-3cf0-459a-96d7-392c0a71e2da None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:53.237674 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871e8e23-3cf0-459a-96d7-392c0a71e2da None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:53.237980 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871e8e23-3cf0-459a-96d7-392c0a71e2da None admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:53.238746 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871e8e23-3cf0-459a-96d7-392c0a71e2da None admin] RBAC: Adding query filter params (name=member) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:02:53.239204 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871e8e23-3cf0-459a-96d7-392c0a71e2da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:53.242142 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871e8e23-3cf0-459a-96d7-392c0a71e2da None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:53.259711 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 196/399] 10.222.0.43 () {56 vars in 1101 bytes} [Wed Jun 22 10:02:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:02:53.259711 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b10f23-6145-4544-ae6d-3e0986a2da3c None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:53.259711 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b10f23-6145-4544-ae6d-3e0986a2da3c None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:53.259711 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b10f23-6145-4544-ae6d-3e0986a2da3c None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:53.259711 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 197/400] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:02:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:02:53.261721 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b10f23-6145-4544-ae6d-3e0986a2da3c None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:53.272381 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 204/401] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:02:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 10:02:53.274196 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b10120e-3e93-4764-b677-2312dcda107b None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:53.274773 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b10120e-3e93-4764-b677-2312dcda107b None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:53.275288 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b10120e-3e93-4764-b677-2312dcda107b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:53.307229 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-2b10120e-3e93-4764-b677-2312dcda107b None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:02:53.308497 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-2b10120e-3e93-4764-b677-2312dcda107b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:02:53.343856 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:53.360871 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:53.392700 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 205/402] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:02:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 10:02:53.398419 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b10120e-3e93-4764-b677-2312dcda107b None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:53.424131 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b10f23-6145-4544-ae6d-3e0986a2da3c None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:53.476065 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78afa2a5-b8cd-445c-acdc-e708e586ecc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:53.477582 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78afa2a5-b8cd-445c-acdc-e708e586ecc5 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:53.477887 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78afa2a5-b8cd-445c-acdc-e708e586ecc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:53.478225 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78afa2a5-b8cd-445c-acdc-e708e586ecc5 None admin] PATH_INFO: `/v3/groups/363e63ca29024f308dbb8d31e1742695` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:53.479753 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78afa2a5-b8cd-445c-acdc-e708e586ecc5 None admin] RBAC: Authorizing `identity:get_group(group_id=363e63ca29024f308dbb8d31e1742695)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:53.481776 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78afa2a5-b8cd-445c-acdc-e708e586ecc5 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:53.484141 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 198/403] 10.222.0.43 () {56 vars in 1180 bytes} [Wed Jun 22 10:02:53 2022] GET /identity/v3/groups/363e63ca29024f308dbb8d31e1742695 => generated 226 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:02:53.488655 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78afa2a5-b8cd-445c-acdc-e708e586ecc5 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:53.555645 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b10120e-3e93-4764-b677-2312dcda107b None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:53.599644 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a827441-4379-42f3-8838-d68a0dc8681a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:53.601080 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a827441-4379-42f3-8838-d68a0dc8681a None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:53.601572 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a827441-4379-42f3-8838-d68a0dc8681a None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:53.602079 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a827441-4379-42f3-8838-d68a0dc8681a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:53.609051 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78afa2a5-b8cd-445c-acdc-e708e586ecc5 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:53.613038 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a827441-4379-42f3-8838-d68a0dc8681a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:02:53.621869 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:53.622990 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-9a827441-4379-42f3-8838-d68a0dc8681a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 10:02:53.622990 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:02:53.622990 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:02:53.622990 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:02:53.622990 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:02:53.622990 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:02:53.622990 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:02:53.622990 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:02:53.622990 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:02:53.622990 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:02:53.622990 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:02:53.622990 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:02:53.622990 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:02:53.622990 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:02:53.622990 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:02:53.622990 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:02:53.623856 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:02:53.623856 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:02:53.623856 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:02:53.623856 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:02:53.623856 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:02:53.623856 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:02:53.623856 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:02:53.623856 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:02:53.623856 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:02:53.623856 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:02:53.623856 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:02:53.623856 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jun 22 10:02:53.623856 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:02:53.623856 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:02:53.623856 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:02:53.623856 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:02:53.624648 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:02:53.624648 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:02:53.624648 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:02:53.624648 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:02:53.624648 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:02:53.624648 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:02:53.624648 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:02:53.624648 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:02:53.624648 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:02:53.624648 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:02:53.624648 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 10:02:53.624648 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:02:53.627170 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 206/404] 10.222.0.43 () {56 vars in 1114 bytes} [Wed Jun 22 10:02:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:02:53.628203 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a827441-4379-42f3-8838-d68a0dc8681a None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:53.664798 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f2ef40-1489-44a2-af03-e5889eb8fbcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:53.665617 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f2ef40-1489-44a2-af03-e5889eb8fbcb None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:53.665954 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f2ef40-1489-44a2-af03-e5889eb8fbcb None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:53.666238 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f2ef40-1489-44a2-af03-e5889eb8fbcb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:53.670729 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:53.682925 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f2ef40-1489-44a2-af03-e5889eb8fbcb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:02:53.691287 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-f8f2ef40-1489-44a2-af03-e5889eb8fbcb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 10:02:53.691287 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:02:53.691287 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:02:53.691287 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:02:53.691287 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:02:53.691287 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:02:53.691287 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:02:53.691287 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:02:53.691287 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:02:53.691287 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:02:53.691287 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:02:53.691287 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:02:53.691287 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:02:53.691287 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:02:53.691287 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:02:53.691287 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:02:53.692225 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:02:53.692225 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:02:53.692225 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:02:53.692225 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:02:53.692225 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:02:53.692225 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:02:53.692225 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:02:53.692225 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:02:53.692225 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:02:53.692225 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:02:53.692225 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:02:53.692225 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( Jun 22 10:02:53.692225 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:02:53.692225 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:02:53.692225 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:02:53.692225 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:02:53.693043 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:02:53.693043 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:02:53.693043 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:02:53.693043 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:02:53.693043 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:02:53.693043 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:02:53.693043 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:02:53.693043 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:02:53.693043 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:02:53.693043 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:02:53.693043 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 10:02:53.693043 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:02:53.695580 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 199/405] 10.222.0.43 () {56 vars in 1096 bytes} [Wed Jun 22 10:02:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:02:53.696571 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f2ef40-1489-44a2-af03-e5889eb8fbcb None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:53.761933 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a827441-4379-42f3-8838-d68a0dc8681a None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:53.808935 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f2ef40-1489-44a2-af03-e5889eb8fbcb None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:53.812747 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3763a76d-e609-4808-84d8-af0860c27fd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:53.813625 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3763a76d-e609-4808-84d8-af0860c27fd2 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:53.813954 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3763a76d-e609-4808-84d8-af0860c27fd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:53.814232 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3763a76d-e609-4808-84d8-af0860c27fd2 None admin] PATH_INFO: `/v3/projects/d828ff8720114b1b9da6709b7e51dcee` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:53.815456 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3763a76d-e609-4808-84d8-af0860c27fd2 None admin] RBAC: Authorizing `identity:get_project(project_id=d828ff8720114b1b9da6709b7e51dcee)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:53.816927 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3763a76d-e609-4808-84d8-af0860c27fd2 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:53.820504 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 207/406] 10.222.0.43 () {56 vars in 1186 bytes} [Wed Jun 22 10:02:53 2022] GET /identity/v3/projects/d828ff8720114b1b9da6709b7e51dcee => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:02:53.821997 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3763a76d-e609-4808-84d8-af0860c27fd2 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:53.858901 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435909bf-25d0-4d23-b7c6-11171a051d13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:53.859837 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435909bf-25d0-4d23-b7c6-11171a051d13 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:53.860127 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435909bf-25d0-4d23-b7c6-11171a051d13 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:53.860411 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435909bf-25d0-4d23-b7c6-11171a051d13 None admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:53.862098 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435909bf-25d0-4d23-b7c6-11171a051d13 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:02:53.862414 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435909bf-25d0-4d23-b7c6-11171a051d13 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:53.864376 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435909bf-25d0-4d23-b7c6-11171a051d13 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:53.877777 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 200/407] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Jun 22 10:02:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:02:53.878997 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435909bf-25d0-4d23-b7c6-11171a051d13 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:53.919217 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:53.961819 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3763a76d-e609-4808-84d8-af0860c27fd2 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:53.965529 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:53.998171 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435909bf-25d0-4d23-b7c6-11171a051d13 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:54.015367 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a739d77-4b43-4ec0-a799-2392b2df1222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:54.016408 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a739d77-4b43-4ec0-a799-2392b2df1222 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:54.016890 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a739d77-4b43-4ec0-a799-2392b2df1222 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:54.017385 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a739d77-4b43-4ec0-a799-2392b2df1222 None admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:54.018397 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a739d77-4b43-4ec0-a799-2392b2df1222 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:02:54.018906 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a739d77-4b43-4ec0-a799-2392b2df1222 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:54.021817 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a739d77-4b43-4ec0-a799-2392b2df1222 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:54.030729 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 208/408] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Jun 22 10:02:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:02:54.031884 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a739d77-4b43-4ec0-a799-2392b2df1222 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:54.037127 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ef2f35-a7e7-465c-84d8-0067b5532d41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:54.037364 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ef2f35-a7e7-465c-84d8-0067b5532d41 None admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:54.037610 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ef2f35-a7e7-465c-84d8-0067b5532d41 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:54.037942 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ef2f35-a7e7-465c-84d8-0067b5532d41 None admin] PATH_INFO: `/v3/projects/d828ff8720114b1b9da6709b7e51dcee/groups/363e63ca29024f308dbb8d31e1742695/roles/9f88c83743f745a9a785a2f454753f06` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:54.040060 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ef2f35-a7e7-465c-84d8-0067b5532d41 None admin] RBAC: Authorizing `identity:create_grant(project_id=d828ff8720114b1b9da6709b7e51dcee, group_id=363e63ca29024f308dbb8d31e1742695, role_id=9f88c83743f745a9a785a2f454753f06)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:54.041517 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ef2f35-a7e7-465c-84d8-0067b5532d41 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:54.061223 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 201/409] 10.222.0.43 () {58 vars in 1442 bytes} [Wed Jun 22 10:02:53 2022] PUT /identity/v3/projects/d828ff8720114b1b9da6709b7e51dcee/groups/363e63ca29024f308dbb8d31e1742695/roles/9f88c83743f745a9a785a2f454753f06 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:02:54.062133 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ef2f35-a7e7-465c-84d8-0067b5532d41 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:54.175333 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a739d77-4b43-4ec0-a799-2392b2df1222 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:54.229370 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d27006-b82d-412d-809d-22c15d891a86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:54.230832 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d27006-b82d-412d-809d-22c15d891a86 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:54.232832 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d27006-b82d-412d-809d-22c15d891a86 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:54.234269 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d27006-b82d-412d-809d-22c15d891a86 None admin] PATH_INFO: `/v3/groups/363e63ca29024f308dbb8d31e1742695` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:54.239508 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d27006-b82d-412d-809d-22c15d891a86 None admin] RBAC: Authorizing `identity:get_group(group_id=363e63ca29024f308dbb8d31e1742695)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:54.243206 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d27006-b82d-412d-809d-22c15d891a86 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:54.248514 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:54.253192 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 209/410] 10.222.0.43 () {56 vars in 1180 bytes} [Wed Jun 22 10:02:54 2022] GET /identity/v3/groups/363e63ca29024f308dbb8d31e1742695 => generated 226 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:02:54.254615 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d27006-b82d-412d-809d-22c15d891a86 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:54.268760 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ef2f35-a7e7-465c-84d8-0067b5532d41 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:54.295947 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:54.313855 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e756fa7-8375-4ba3-8e38-97071e55b48b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:54.315067 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e756fa7-8375-4ba3-8e38-97071e55b48b None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:54.315420 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e756fa7-8375-4ba3-8e38-97071e55b48b None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:54.315766 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e756fa7-8375-4ba3-8e38-97071e55b48b None admin] PATH_INFO: `/v3/groups/2b845b5bde804251ac3b4e081860c876` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:54.317173 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e756fa7-8375-4ba3-8e38-97071e55b48b None admin] RBAC: Authorizing `identity:get_group(group_id=2b845b5bde804251ac3b4e081860c876)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:54.319051 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e756fa7-8375-4ba3-8e38-97071e55b48b None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:54.321067 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 202/411] 10.222.0.43 () {56 vars in 1180 bytes} [Wed Jun 22 10:02:54 2022] GET /identity/v3/groups/2b845b5bde804251ac3b4e081860c876 => generated 229 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:02:54.322878 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2bc658-2f0f-46ea-b43e-041aff550607 None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:54.323488 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2bc658-2f0f-46ea-b43e-041aff550607 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:54.323842 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2bc658-2f0f-46ea-b43e-041aff550607 None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:54.325563 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 203/412] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:02:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:02:54.330517 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2bc658-2f0f-46ea-b43e-041aff550607 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:54.386134 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d27006-b82d-412d-809d-22c15d891a86 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:54.422949 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b83113-50e9-4dce-9763-383a01ed42e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:54.424167 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b83113-50e9-4dce-9763-383a01ed42e0 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:54.424645 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b83113-50e9-4dce-9763-383a01ed42e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:54.425111 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b83113-50e9-4dce-9763-383a01ed42e0 None admin] PATH_INFO: `/v3/projects/d828ff8720114b1b9da6709b7e51dcee` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:54.427434 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b83113-50e9-4dce-9763-383a01ed42e0 None admin] RBAC: Authorizing `identity:get_project(project_id=d828ff8720114b1b9da6709b7e51dcee)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:54.429247 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b83113-50e9-4dce-9763-383a01ed42e0 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:54.431631 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 210/413] 10.222.0.43 () {56 vars in 1186 bytes} [Wed Jun 22 10:02:54 2022] GET /identity/v3/projects/d828ff8720114b1b9da6709b7e51dcee => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:02:54.433127 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e48328-5922-46ad-af46-fc4fea874bcf None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:54.433474 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e48328-5922-46ad-af46-fc4fea874bcf None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:54.434060 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e48328-5922-46ad-af46-fc4fea874bcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:54.452534 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-16e48328-5922-46ad-af46-fc4fea874bcf None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:02:54.453727 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-16e48328-5922-46ad-af46-fc4fea874bcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:02:54.459485 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2bc658-2f0f-46ea-b43e-041aff550607 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:54.498778 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6a3290-6fa6-491f-8110-52879df3f807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:54.499655 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6a3290-6fa6-491f-8110-52879df3f807 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:54.499944 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6a3290-6fa6-491f-8110-52879df3f807 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:54.500222 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6a3290-6fa6-491f-8110-52879df3f807 None admin] PATH_INFO: `/v3/projects/24726cc2fba44a5087e961da4a7cd653` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:54.501483 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6a3290-6fa6-491f-8110-52879df3f807 None admin] RBAC: Authorizing `identity:get_project(project_id=24726cc2fba44a5087e961da4a7cd653)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:54.502982 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6a3290-6fa6-491f-8110-52879df3f807 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:54.505387 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 204/414] 10.222.0.43 () {56 vars in 1186 bytes} [Wed Jun 22 10:02:54 2022] GET /identity/v3/projects/24726cc2fba44a5087e961da4a7cd653 => generated 344 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:02:54.506649 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3150f044-e815-4dfa-b239-ad546bb4252f None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:54.506945 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3150f044-e815-4dfa-b239-ad546bb4252f None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:54.507226 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3150f044-e815-4dfa-b239-ad546bb4252f None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:54.508816 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 205/415] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:02:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:02:54.510589 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3150f044-e815-4dfa-b239-ad546bb4252f None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:54.545798 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 211/416] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:02:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 10:02:54.545798 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e48328-5922-46ad-af46-fc4fea874bcf None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:54.555264 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:54.583408 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:54.650832 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3150f044-e815-4dfa-b239-ad546bb4252f None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:54.660219 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e48328-5922-46ad-af46-fc4fea874bcf None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:54.688377 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dad86b-e1ba-4d64-9c4b-f21c84a8e5bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:54.689385 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dad86b-e1ba-4d64-9c4b-f21c84a8e5bf None admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:54.689669 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dad86b-e1ba-4d64-9c4b-f21c84a8e5bf None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:54.690098 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dad86b-e1ba-4d64-9c4b-f21c84a8e5bf None admin] PATH_INFO: `/v3/projects/d828ff8720114b1b9da6709b7e51dcee/groups/363e63ca29024f308dbb8d31e1742695/roles/23a6a1fcd69d4210a8f2b45559b65aea` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:54.692408 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dad86b-e1ba-4d64-9c4b-f21c84a8e5bf None admin] RBAC: Authorizing `identity:create_grant(project_id=d828ff8720114b1b9da6709b7e51dcee, group_id=363e63ca29024f308dbb8d31e1742695, role_id=23a6a1fcd69d4210a8f2b45559b65aea)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:54.693893 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dad86b-e1ba-4d64-9c4b-f21c84a8e5bf None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:54.702120 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0682d27-b03d-4314-9c8c-6f94f9013e8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:54.703009 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0682d27-b03d-4314-9c8c-6f94f9013e8b None admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:54.703293 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0682d27-b03d-4314-9c8c-6f94f9013e8b None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:54.703590 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0682d27-b03d-4314-9c8c-6f94f9013e8b None admin] PATH_INFO: `/v3/projects/24726cc2fba44a5087e961da4a7cd653/groups/2b845b5bde804251ac3b4e081860c876/roles/26d9c2ab5dfc4e6d9ca80c6014123906` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:54.705764 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0682d27-b03d-4314-9c8c-6f94f9013e8b None admin] RBAC: Authorizing `identity:create_grant(project_id=24726cc2fba44a5087e961da4a7cd653, group_id=2b845b5bde804251ac3b4e081860c876, role_id=26d9c2ab5dfc4e6d9ca80c6014123906)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:54.707263 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0682d27-b03d-4314-9c8c-6f94f9013e8b None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:54.716053 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 206/417] 10.222.0.43 () {58 vars in 1442 bytes} [Wed Jun 22 10:02:54 2022] PUT /identity/v3/projects/d828ff8720114b1b9da6709b7e51dcee/groups/363e63ca29024f308dbb8d31e1742695/roles/23a6a1fcd69d4210a8f2b45559b65aea => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:02:54.716053 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ed1834-eb68-4c74-b110-b8942ac8afd1 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:54.716053 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ed1834-eb68-4c74-b110-b8942ac8afd1 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:54.716053 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ed1834-eb68-4c74-b110-b8942ac8afd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:54.735735 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-f5ed1834-eb68-4c74-b110-b8942ac8afd1 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:02:54.736209 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 212/418] 10.222.0.43 () {58 vars in 1442 bytes} [Wed Jun 22 10:02:54 2022] PUT /identity/v3/projects/24726cc2fba44a5087e961da4a7cd653/groups/2b845b5bde804251ac3b4e081860c876/roles/26d9c2ab5dfc4e6d9ca80c6014123906 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:02:54.737311 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0682d27-b03d-4314-9c8c-6f94f9013e8b None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:54.747224 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-f5ed1834-eb68-4c74-b110-b8942ac8afd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:02:54.858412 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:54.869361 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0682d27-b03d-4314-9c8c-6f94f9013e8b None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:54.923622 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 207/419] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:02:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 10:02:54.941855 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25a58fe-9c4b-4ee4-9157-b985247e3225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:54.943728 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25a58fe-9c4b-4ee4-9157-b985247e3225 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:54.944252 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25a58fe-9c4b-4ee4-9157-b985247e3225 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:54.944729 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25a58fe-9c4b-4ee4-9157-b985247e3225 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:54.953356 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ed1834-eb68-4c74-b110-b8942ac8afd1 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:54.974829 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25a58fe-9c4b-4ee4-9157-b985247e3225 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:02:54.978846 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:54.984561 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-a25a58fe-9c4b-4ee4-9157-b985247e3225 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 10:02:54.984561 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:02:54.984561 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:02:54.984561 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:02:54.984561 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:02:54.984561 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:02:54.984561 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:02:54.984561 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:02:54.984561 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:02:54.984561 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:02:54.984561 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:02:54.984561 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:02:54.984561 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:02:54.984561 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:02:54.984561 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:02:54.984561 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:02:54.985575 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:02:54.985575 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:02:54.985575 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:02:54.985575 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:02:54.985575 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:02:54.985575 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:02:54.985575 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:02:54.985575 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:02:54.985575 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:02:54.985575 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:02:54.985575 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:02:54.985575 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jun 22 10:02:54.985575 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:02:54.985575 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:02:54.985575 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:02:54.985575 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:02:54.992733 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:02:54.992733 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:02:54.992733 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:02:54.992733 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:02:54.992733 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:02:54.992733 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:02:54.992733 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:02:54.992733 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:02:54.992733 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:02:54.992733 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:02:54.992733 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 10:02:54.992733 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:02:54.992733 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 213/420] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Jun 22 10:02:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:02:55.000786 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25a58fe-9c4b-4ee4-9157-b985247e3225 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:55.081534 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ed1834-eb68-4c74-b110-b8942ac8afd1 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:55.137530 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e24121-25ed-4c29-a748-fa8244b04401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:55.139506 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e24121-25ed-4c29-a748-fa8244b04401 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:55.140649 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e24121-25ed-4c29-a748-fa8244b04401 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:55.142083 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e24121-25ed-4c29-a748-fa8244b04401 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:55.158366 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25a58fe-9c4b-4ee4-9157-b985247e3225 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:55.166473 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e24121-25ed-4c29-a748-fa8244b04401 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:02:55.183851 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-65e24121-25ed-4c29-a748-fa8244b04401 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 10:02:55.183851 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:02:55.183851 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:02:55.183851 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:02:55.183851 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:02:55.183851 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:02:55.183851 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:02:55.183851 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:02:55.183851 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:02:55.183851 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:02:55.183851 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:02:55.183851 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:02:55.183851 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:02:55.183851 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:02:55.183851 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:02:55.183851 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:02:55.184756 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:02:55.184756 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:02:55.184756 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:02:55.184756 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:02:55.184756 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:02:55.184756 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:02:55.184756 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:02:55.184756 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:02:55.184756 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:02:55.184756 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:02:55.184756 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:02:55.184756 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( Jun 22 10:02:55.184756 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:02:55.184756 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:02:55.184756 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:02:55.184756 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:02:55.185568 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:02:55.185568 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:02:55.185568 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:02:55.185568 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:02:55.185568 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:02:55.185568 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:02:55.185568 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:02:55.185568 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:02:55.185568 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:02:55.185568 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:02:55.185568 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 10:02:55.185568 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:02:55.191913 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 208/421] 10.222.0.43 () {56 vars in 1114 bytes} [Wed Jun 22 10:02:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 10:02:55.218523 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e24121-25ed-4c29-a748-fa8244b04401 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:55.232938 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3c3309-814c-4998-878e-6f2bbc64117e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:55.233965 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3c3309-814c-4998-878e-6f2bbc64117e None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:55.234445 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3c3309-814c-4998-878e-6f2bbc64117e None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:55.234932 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3c3309-814c-4998-878e-6f2bbc64117e None admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:55.235916 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3c3309-814c-4998-878e-6f2bbc64117e None admin] RBAC: Adding query filter params (name=member) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:02:55.236482 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3c3309-814c-4998-878e-6f2bbc64117e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:55.238078 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3c3309-814c-4998-878e-6f2bbc64117e None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:55.252066 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 214/422] 10.222.0.43 () {56 vars in 1101 bytes} [Wed Jun 22 10:02:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:02:55.253653 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3c3309-814c-4998-878e-6f2bbc64117e None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:55.275279 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:55.374069 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:55.399614 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e24121-25ed-4c29-a748-fa8244b04401 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:55.413507 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3c3309-814c-4998-878e-6f2bbc64117e None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:55.464918 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ea91cf-b2bd-4f76-9890-2829869781c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:55.465595 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ea91cf-b2bd-4f76-9890-2829869781c1 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:55.465909 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ea91cf-b2bd-4f76-9890-2829869781c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:55.466193 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ea91cf-b2bd-4f76-9890-2829869781c1 None admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:55.466958 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ea91cf-b2bd-4f76-9890-2829869781c1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:02:55.467271 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ea91cf-b2bd-4f76-9890-2829869781c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:55.468688 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ea91cf-b2bd-4f76-9890-2829869781c1 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:55.474744 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c437374b-3f00-489b-ad97-93c10eb08db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:55.475791 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c437374b-3f00-489b-ad97-93c10eb08db6 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:55.476085 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c437374b-3f00-489b-ad97-93c10eb08db6 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:55.476857 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c437374b-3f00-489b-ad97-93c10eb08db6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:55.479841 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 209/423] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Jun 22 10:02:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:02:55.485663 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ea91cf-b2bd-4f76-9890-2829869781c1 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:55.584721 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c437374b-3f00-489b-ad97-93c10eb08db6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:55.586636 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c437374b-3f00-489b-ad97-93c10eb08db6 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:55.603984 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:55.647570 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ea91cf-b2bd-4f76-9890-2829869781c1 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:55.735328 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d41fd1f-15b0-4d91-a1a3-fca95631ba6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:55.736160 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d41fd1f-15b0-4d91-a1a3-fca95631ba6f None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:55.736347 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d41fd1f-15b0-4d91-a1a3-fca95631ba6f None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:55.736624 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d41fd1f-15b0-4d91-a1a3-fca95631ba6f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:55.754072 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:55.754858 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 215/424] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Jun 22 10:02:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 501 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 22 10:02:55.761791 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c437374b-3f00-489b-ad97-93c10eb08db6 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:55.839854 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d41fd1f-15b0-4d91-a1a3-fca95631ba6f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:55.841339 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d41fd1f-15b0-4d91-a1a3-fca95631ba6f None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:55.902888 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c437374b-3f00-489b-ad97-93c10eb08db6 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:55.921249 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:55.967838 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fce5131-2d2a-41eb-a323-b291b0dd71d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:55.968707 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fce5131-2d2a-41eb-a323-b291b0dd71d4 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:55.968996 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fce5131-2d2a-41eb-a323-b291b0dd71d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:55.969277 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fce5131-2d2a-41eb-a323-b291b0dd71d4 None admin] PATH_INFO: `/v3/projects/6008ad7344a543cdae5546c3d2f389b1` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:55.971480 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fce5131-2d2a-41eb-a323-b291b0dd71d4 None admin] RBAC: Authorizing `identity:get_project(project_id=6008ad7344a543cdae5546c3d2f389b1)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:55.972929 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fce5131-2d2a-41eb-a323-b291b0dd71d4 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:55.978423 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 216/425] 10.222.0.43 () {56 vars in 1186 bytes} [Wed Jun 22 10:02:55 2022] GET /identity/v3/projects/6008ad7344a543cdae5546c3d2f389b1 => generated 298 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:02:55.983780 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fce5131-2d2a-41eb-a323-b291b0dd71d4 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:56.064254 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 210/426] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Jun 22 10:02:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 579 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 10:02:56.068171 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d41fd1f-15b0-4d91-a1a3-fca95631ba6f None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:56.128040 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:56.186671 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d41fd1f-15b0-4d91-a1a3-fca95631ba6f None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:56.207062 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fce5131-2d2a-41eb-a323-b291b0dd71d4 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:56.248447 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a04f944-4934-4513-a0f3-bd03a4a83d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:56.249415 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a04f944-4934-4513-a0f3-bd03a4a83d50 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:56.249844 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a04f944-4934-4513-a0f3-bd03a4a83d50 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:56.250136 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a04f944-4934-4513-a0f3-bd03a4a83d50 None admin] PATH_INFO: `/v3/groups/363e63ca29024f308dbb8d31e1742695` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:56.251335 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a04f944-4934-4513-a0f3-bd03a4a83d50 None admin] RBAC: Authorizing `identity:get_group(group_id=363e63ca29024f308dbb8d31e1742695)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:56.253028 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a04f944-4934-4513-a0f3-bd03a4a83d50 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:56.255626 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 217/427] 10.222.0.43 () {56 vars in 1180 bytes} [Wed Jun 22 10:02:55 2022] GET /identity/v3/groups/363e63ca29024f308dbb8d31e1742695 => generated 226 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:02:56.261769 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a04f944-4934-4513-a0f3-bd03a4a83d50 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:56.275842 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d6354a-90ac-4db4-afa5-99a4fec644be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:56.276721 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d6354a-90ac-4db4-afa5-99a4fec644be None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:56.277007 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d6354a-90ac-4db4-afa5-99a4fec644be None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:56.277284 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d6354a-90ac-4db4-afa5-99a4fec644be None admin] PATH_INFO: `/v3/projects/6008ad7344a543cdae5546c3d2f389b1` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:56.279818 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d6354a-90ac-4db4-afa5-99a4fec644be None admin] RBAC: Authorizing `identity:get_project(project_id=6008ad7344a543cdae5546c3d2f389b1)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:56.281359 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d6354a-90ac-4db4-afa5-99a4fec644be None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:56.283123 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 211/428] 10.222.0.43 () {56 vars in 1186 bytes} [Wed Jun 22 10:02:56 2022] GET /identity/v3/projects/6008ad7344a543cdae5546c3d2f389b1 => generated 298 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:02:56.289200 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d6354a-90ac-4db4-afa5-99a4fec644be None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:56.350335 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:56.405556 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a04f944-4934-4513-a0f3-bd03a4a83d50 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:56.416266 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d6354a-90ac-4db4-afa5-99a4fec644be None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:56.426073 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:56.444139 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7f12f5-e230-4023-b7ec-7eef15cc0f49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:56.445106 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7f12f5-e230-4023-b7ec-7eef15cc0f49 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:56.445540 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7f12f5-e230-4023-b7ec-7eef15cc0f49 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:56.445990 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7f12f5-e230-4023-b7ec-7eef15cc0f49 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:56.447107 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7f12f5-e230-4023-b7ec-7eef15cc0f49 None admin] RBAC: Adding query filter params (group.id=363e63ca29024f308dbb8d31e1742695, role.id=9f88c83743f745a9a785a2f454753f06, scope.project.id=6008ad7344a543cdae5546c3d2f389b1) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:02:56.447569 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7f12f5-e230-4023-b7ec-7eef15cc0f49 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:56.449216 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7f12f5-e230-4023-b7ec-7eef15cc0f49 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:56.452598 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41720431-e083-429b-9e2f-77d6e278bf2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:56.453454 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41720431-e083-429b-9e2f-77d6e278bf2a None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:56.453793 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41720431-e083-429b-9e2f-77d6e278bf2a None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:56.454065 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41720431-e083-429b-9e2f-77d6e278bf2a None admin] PATH_INFO: `/v3/groups/363e63ca29024f308dbb8d31e1742695` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:56.455228 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41720431-e083-429b-9e2f-77d6e278bf2a None admin] RBAC: Authorizing `identity:get_group(group_id=363e63ca29024f308dbb8d31e1742695)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:56.456552 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 218/429] 10.222.0.43 () {56 vars in 1376 bytes} [Wed Jun 22 10:02:56 2022] GET /identity/v3/role_assignments?group.id=363e63ca29024f308dbb8d31e1742695&scope.project.id=6008ad7344a543cdae5546c3d2f389b1&role.id=9f88c83743f745a9a785a2f454753f06 => generated 611 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:02:56.456697 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41720431-e083-429b-9e2f-77d6e278bf2a None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:56.458493 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e8970f-217b-4aaf-8c24-55b8e9790b13 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:56.458787 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 212/430] 10.222.0.43 () {56 vars in 1180 bytes} [Wed Jun 22 10:02:56 2022] GET /identity/v3/groups/363e63ca29024f308dbb8d31e1742695 => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:02:56.459193 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e8970f-217b-4aaf-8c24-55b8e9790b13 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:56.459486 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e8970f-217b-4aaf-8c24-55b8e9790b13 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:56.460984 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 219/431] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:02:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:02:56.469719 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41720431-e083-429b-9e2f-77d6e278bf2a None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:56.469911 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776f9656-dac8-4616-8d0c-8e2d22d4542d None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:56.469911 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776f9656-dac8-4616-8d0c-8e2d22d4542d None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:56.469911 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776f9656-dac8-4616-8d0c-8e2d22d4542d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:56.504253 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-776f9656-dac8-4616-8d0c-8e2d22d4542d None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:02:56.507742 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-776f9656-dac8-4616-8d0c-8e2d22d4542d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:02:56.653744 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 220/432] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:02:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 10:02:56.665712 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41720431-e083-429b-9e2f-77d6e278bf2a None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:56.687022 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776f9656-dac8-4616-8d0c-8e2d22d4542d None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:56.709420 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b68a746-6cca-48bc-84c5-379a03bc4110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:56.710116 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b68a746-6cca-48bc-84c5-379a03bc4110 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:56.710398 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b68a746-6cca-48bc-84c5-379a03bc4110 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:56.710676 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b68a746-6cca-48bc-84c5-379a03bc4110 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:56.711511 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b68a746-6cca-48bc-84c5-379a03bc4110 None admin] RBAC: Adding query filter params (group.id=363e63ca29024f308dbb8d31e1742695, role.id=23a6a1fcd69d4210a8f2b45559b65aea, scope.project.id=6008ad7344a543cdae5546c3d2f389b1) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:02:56.712007 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b68a746-6cca-48bc-84c5-379a03bc4110 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:56.714189 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b68a746-6cca-48bc-84c5-379a03bc4110 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:56.723107 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 213/433] 10.222.0.43 () {56 vars in 1376 bytes} [Wed Jun 22 10:02:56 2022] GET /identity/v3/role_assignments?group.id=363e63ca29024f308dbb8d31e1742695&scope.project.id=6008ad7344a543cdae5546c3d2f389b1&role.id=23a6a1fcd69d4210a8f2b45559b65aea => generated 611 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:02:56.754477 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:56.826721 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776f9656-dac8-4616-8d0c-8e2d22d4542d None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:56.868562 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e20b89-bf8f-46ce-9c55-7065c97d2531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:56.869391 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e20b89-bf8f-46ce-9c55-7065c97d2531 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:56.869680 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e20b89-bf8f-46ce-9c55-7065c97d2531 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:56.869989 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e20b89-bf8f-46ce-9c55-7065c97d2531 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:56.883107 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e20b89-bf8f-46ce-9c55-7065c97d2531 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:02:56.891303 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-56e20b89-bf8f-46ce-9c55-7065c97d2531 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 10:02:56.891303 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:02:56.891303 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:02:56.891303 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:02:56.891303 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:02:56.891303 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:02:56.891303 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:02:56.891303 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:02:56.891303 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:02:56.891303 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:02:56.891303 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:02:56.891303 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:02:56.891303 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:02:56.891303 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:02:56.891303 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:02:56.891303 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:02:56.893464 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:02:56.893464 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:02:56.893464 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:02:56.893464 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:02:56.893464 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:02:56.893464 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:02:56.893464 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:02:56.893464 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:02:56.893464 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:02:56.893464 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:02:56.893464 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:02:56.893464 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jun 22 10:02:56.893464 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:02:56.893464 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:02:56.893464 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:02:56.893464 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:02:56.895009 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:02:56.895009 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:02:56.895009 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:02:56.895009 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:02:56.895009 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:02:56.895009 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:02:56.895009 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:02:56.895009 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:02:56.895009 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:02:56.895009 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:02:56.895009 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 10:02:56.895009 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:02:56.895009 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 221/434] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Jun 22 10:02:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 10:02:56.898943 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b68a746-6cca-48bc-84c5-379a03bc4110 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:56.947522 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:57.014957 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b68a746-6cca-48bc-84c5-379a03bc4110 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:57.054771 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4b75a3-cc2c-4fe9-bdf2-cd7bbb5be78a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:57.056340 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4b75a3-cc2c-4fe9-bdf2-cd7bbb5be78a None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:57.057033 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4b75a3-cc2c-4fe9-bdf2-cd7bbb5be78a None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:57.057732 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4b75a3-cc2c-4fe9-bdf2-cd7bbb5be78a None admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:57.058697 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4b75a3-cc2c-4fe9-bdf2-cd7bbb5be78a None admin] RBAC: Adding query filter params (name=member) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:02:57.059233 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4b75a3-cc2c-4fe9-bdf2-cd7bbb5be78a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:57.060827 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4b75a3-cc2c-4fe9-bdf2-cd7bbb5be78a None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:57.071205 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 214/435] 10.222.0.43 () {56 vars in 1101 bytes} [Wed Jun 22 10:02:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:02:57.076488 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e20b89-bf8f-46ce-9c55-7065c97d2531 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:57.201773 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e20b89-bf8f-46ce-9c55-7065c97d2531 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:57.204563 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:57.205947 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0eb317-9340-4f7a-9584-9077e3bdcb41 None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:57.206120 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0eb317-9340-4f7a-9584-9077e3bdcb41 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:57.206383 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0eb317-9340-4f7a-9584-9077e3bdcb41 None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:57.207916 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 215/436] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:02:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:02:57.213884 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17086da8-e768-4537-82e0-7ba2e2af9d88 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:57.214179 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17086da8-e768-4537-82e0-7ba2e2af9d88 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:57.214467 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17086da8-e768-4537-82e0-7ba2e2af9d88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:57.234600 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-17086da8-e768-4537-82e0-7ba2e2af9d88 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:02:57.235678 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-17086da8-e768-4537-82e0-7ba2e2af9d88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:02:57.253605 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2d5177-16dd-40f9-80ea-a8fd3dbe0524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:57.254298 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2d5177-16dd-40f9-80ea-a8fd3dbe0524 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:57.254673 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2d5177-16dd-40f9-80ea-a8fd3dbe0524 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:57.255000 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2d5177-16dd-40f9-80ea-a8fd3dbe0524 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:57.325395 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 216/437] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:02:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 10:02:57.327044 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93444350-f22d-4318-9daa-0288c2e0f940 None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:57.327337 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93444350-f22d-4318-9daa-0288c2e0f940 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:57.327619 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93444350-f22d-4318-9daa-0288c2e0f940 None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:57.328897 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 217/438] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:02:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:02:57.334937 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2d5177-16dd-40f9-80ea-a8fd3dbe0524 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:57.335870 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eca2cd-7649-4a8f-ac3d-b4b538de8f15 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:57.336159 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eca2cd-7649-4a8f-ac3d-b4b538de8f15 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:57.336422 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2d5177-16dd-40f9-80ea-a8fd3dbe0524 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:57.336517 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eca2cd-7649-4a8f-ac3d-b4b538de8f15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:57.354405 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-07eca2cd-7649-4a8f-ac3d-b4b538de8f15 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:02:57.355601 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-07eca2cd-7649-4a8f-ac3d-b4b538de8f15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:02:57.387484 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:57.429317 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 218/439] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:02:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 10:02:57.430184 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eca2cd-7649-4a8f-ac3d-b4b538de8f15 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:57.447125 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 222/440] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Jun 22 10:02:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 22 10:02:57.451577 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2d5177-16dd-40f9-80ea-a8fd3dbe0524 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:57.454639 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:57.539283 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eca2cd-7649-4a8f-ac3d-b4b538de8f15 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:57.550317 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2d5177-16dd-40f9-80ea-a8fd3dbe0524 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:57.573897 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea08a82-d8e9-42e3-b891-5ab8db4674ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:57.574704 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea08a82-d8e9-42e3-b891-5ab8db4674ca None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:57.574991 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea08a82-d8e9-42e3-b891-5ab8db4674ca None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:57.575269 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea08a82-d8e9-42e3-b891-5ab8db4674ca None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:57.584118 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5bdb35-82d4-4e17-9fb2-504716741ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:57.584979 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5bdb35-82d4-4e17-9fb2-504716741ee2 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:57.585255 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5bdb35-82d4-4e17-9fb2-504716741ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:57.585529 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5bdb35-82d4-4e17-9fb2-504716741ee2 None admin] PATH_INFO: `/v3/projects/d828ff8720114b1b9da6709b7e51dcee` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:57.586111 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea08a82-d8e9-42e3-b891-5ab8db4674ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:02:57.586725 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5bdb35-82d4-4e17-9fb2-504716741ee2 None admin] RBAC: Authorizing `identity:get_project(project_id=d828ff8720114b1b9da6709b7e51dcee)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:57.588158 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5bdb35-82d4-4e17-9fb2-504716741ee2 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:57.589851 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 223/441] 10.222.0.43 () {56 vars in 1186 bytes} [Wed Jun 22 10:02:57 2022] GET /identity/v3/projects/d828ff8720114b1b9da6709b7e51dcee => generated 302 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:02:57.590598 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5bdb35-82d4-4e17-9fb2-504716741ee2 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:57.594424 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-dea08a82-d8e9-42e3-b891-5ab8db4674ca None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 10:02:57.594424 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:02:57.594424 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:02:57.594424 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:02:57.594424 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:02:57.594424 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:02:57.594424 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:02:57.594424 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:02:57.594424 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:02:57.594424 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:02:57.594424 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:02:57.594424 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:02:57.594424 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:02:57.594424 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:02:57.594424 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:02:57.594424 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:02:57.595466 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:02:57.595466 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:02:57.595466 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:02:57.595466 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:02:57.595466 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:02:57.595466 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:02:57.595466 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:02:57.595466 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:02:57.595466 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:02:57.595466 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:02:57.595466 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:02:57.595466 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( Jun 22 10:02:57.595466 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:02:57.595466 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:02:57.595466 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:02:57.595466 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:02:57.596412 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:02:57.596412 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:02:57.596412 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:02:57.596412 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:02:57.596412 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:02:57.596412 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:02:57.596412 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:02:57.596412 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:02:57.596412 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:02:57.596412 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:02:57.596412 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 10:02:57.596412 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:02:57.596412 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 219/442] 10.222.0.43 () {56 vars in 1114 bytes} [Wed Jun 22 10:02:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:02:57.596412 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea08a82-d8e9-42e3-b891-5ab8db4674ca None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:57.622934 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:57.665991 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:57.695480 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5bdb35-82d4-4e17-9fb2-504716741ee2 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:57.700122 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea08a82-d8e9-42e3-b891-5ab8db4674ca None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:57.729516 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3e6039-632d-421e-8443-bde4ddcc98d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:57.730256 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3e6039-632d-421e-8443-bde4ddcc98d7 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:57.730547 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3e6039-632d-421e-8443-bde4ddcc98d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:57.730819 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3e6039-632d-421e-8443-bde4ddcc98d7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:57.733760 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c693cf-e369-4ea4-a39e-380d4f87a3d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:57.734617 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c693cf-e369-4ea4-a39e-380d4f87a3d9 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:57.734906 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c693cf-e369-4ea4-a39e-380d4f87a3d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:57.735186 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c693cf-e369-4ea4-a39e-380d4f87a3d9 None admin] PATH_INFO: `/v3/groups/363e63ca29024f308dbb8d31e1742695` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:57.736366 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c693cf-e369-4ea4-a39e-380d4f87a3d9 None admin] RBAC: Authorizing `identity:get_group(group_id=363e63ca29024f308dbb8d31e1742695)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:57.737869 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c693cf-e369-4ea4-a39e-380d4f87a3d9 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:57.740185 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 220/443] 10.222.0.43 () {56 vars in 1180 bytes} [Wed Jun 22 10:02:57 2022] GET /identity/v3/groups/363e63ca29024f308dbb8d31e1742695 => generated 226 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:02:57.740943 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c693cf-e369-4ea4-a39e-380d4f87a3d9 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:57.741675 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3e6039-632d-421e-8443-bde4ddcc98d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:02:57.749490 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-3d3e6039-632d-421e-8443-bde4ddcc98d7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 10:02:57.749490 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:02:57.749490 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:02:57.749490 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:02:57.749490 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:02:57.749490 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:02:57.749490 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:02:57.749490 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:02:57.749490 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:02:57.749490 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:02:57.749490 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:02:57.749490 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:02:57.749490 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:02:57.749490 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:02:57.749490 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:02:57.749490 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:02:57.750575 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:02:57.750575 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:02:57.750575 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:02:57.750575 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:02:57.750575 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:02:57.750575 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:02:57.750575 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:02:57.750575 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:02:57.750575 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:02:57.750575 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:02:57.750575 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:02:57.750575 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jun 22 10:02:57.750575 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:02:57.750575 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:02:57.750575 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:02:57.750575 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:02:57.751581 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:02:57.751581 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:02:57.751581 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:02:57.751581 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:02:57.751581 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:02:57.751581 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:02:57.751581 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:02:57.751581 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:02:57.751581 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:02:57.751581 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:02:57.751581 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 10:02:57.751581 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:02:57.751581 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 224/444] 10.222.0.43 () {56 vars in 1096 bytes} [Wed Jun 22 10:02:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:02:57.751581 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3e6039-632d-421e-8443-bde4ddcc98d7 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:57.837099 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:57.846989 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c693cf-e369-4ea4-a39e-380d4f87a3d9 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:57.853014 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3e6039-632d-421e-8443-bde4ddcc98d7 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:57.881352 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12985987-36a3-4b47-902f-470baa5b06f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:57.882063 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12985987-36a3-4b47-902f-470baa5b06f8 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:57.882352 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12985987-36a3-4b47-902f-470baa5b06f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:57.882641 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12985987-36a3-4b47-902f-470baa5b06f8 None admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:57.882826 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:57.883396 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12985987-36a3-4b47-902f-470baa5b06f8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:02:57.883756 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12985987-36a3-4b47-902f-470baa5b06f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:57.885240 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12985987-36a3-4b47-902f-470baa5b06f8 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:57.888103 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3dee83-2ede-447a-a5b8-0eb5f41bdc7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:57.888757 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3dee83-2ede-447a-a5b8-0eb5f41bdc7f None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:57.889044 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3dee83-2ede-447a-a5b8-0eb5f41bdc7f None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:57.889325 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3dee83-2ede-447a-a5b8-0eb5f41bdc7f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:57.890189 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3dee83-2ede-447a-a5b8-0eb5f41bdc7f None admin] RBAC: Adding query filter params (group.id=363e63ca29024f308dbb8d31e1742695, role.id=9f88c83743f745a9a785a2f454753f06, scope.project.id=d828ff8720114b1b9da6709b7e51dcee) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:02:57.890504 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3dee83-2ede-447a-a5b8-0eb5f41bdc7f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:57.891939 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3dee83-2ede-447a-a5b8-0eb5f41bdc7f None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:57.893444 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 221/445] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Jun 22 10:02:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:02:57.898251 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 225/446] 10.222.0.43 () {56 vars in 1376 bytes} [Wed Jun 22 10:02:57 2022] GET /identity/v3/role_assignments?group.id=363e63ca29024f308dbb8d31e1742695&scope.project.id=d828ff8720114b1b9da6709b7e51dcee&role.id=9f88c83743f745a9a785a2f454753f06 => generated 611 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:02:57.899040 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3dee83-2ede-447a-a5b8-0eb5f41bdc7f None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:57.902780 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12985987-36a3-4b47-902f-470baa5b06f8 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:58.013241 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3dee83-2ede-447a-a5b8-0eb5f41bdc7f None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:58.027911 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12985987-36a3-4b47-902f-470baa5b06f8 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:58.055253 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447439a2-c0f9-4a15-80e9-70460cca6c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:58.055927 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447439a2-c0f9-4a15-80e9-70460cca6c12 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:58.056234 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447439a2-c0f9-4a15-80e9-70460cca6c12 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:58.056477 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447439a2-c0f9-4a15-80e9-70460cca6c12 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:58.070583 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81e0a7a-3cb3-4749-9664-8c929779926d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:58.072254 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81e0a7a-3cb3-4749-9664-8c929779926d None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:58.072540 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81e0a7a-3cb3-4749-9664-8c929779926d None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:58.072816 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81e0a7a-3cb3-4749-9664-8c929779926d None admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:58.073567 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81e0a7a-3cb3-4749-9664-8c929779926d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:02:58.073946 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81e0a7a-3cb3-4749-9664-8c929779926d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:58.075332 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81e0a7a-3cb3-4749-9664-8c929779926d None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:58.087156 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 222/447] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Jun 22 10:02:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:02:58.093540 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81e0a7a-3cb3-4749-9664-8c929779926d None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:58.114651 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:58.137833 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:58.146592 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447439a2-c0f9-4a15-80e9-70460cca6c12 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:58.148582 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447439a2-c0f9-4a15-80e9-70460cca6c12 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:58.219566 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81e0a7a-3cb3-4749-9664-8c929779926d None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:58.258759 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbb73f7-f68b-4a4a-8a7e-8b6a48bcc1b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:58.259414 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbb73f7-f68b-4a4a-8a7e-8b6a48bcc1b8 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:58.259696 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbb73f7-f68b-4a4a-8a7e-8b6a48bcc1b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:58.259973 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbb73f7-f68b-4a4a-8a7e-8b6a48bcc1b8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:58.267012 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 226/448] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Jun 22 10:02:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 10:02:58.272728 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447439a2-c0f9-4a15-80e9-70460cca6c12 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:58.329932 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbb73f7-f68b-4a4a-8a7e-8b6a48bcc1b8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:58.331388 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbb73f7-f68b-4a4a-8a7e-8b6a48bcc1b8 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:58.346466 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:58.364738 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:58.371101 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447439a2-c0f9-4a15-80e9-70460cca6c12 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:58.408203 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1e6cd0-d016-46b8-b7fa-87832948e21d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:58.409072 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1e6cd0-d016-46b8-b7fa-87832948e21d None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:58.409352 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1e6cd0-d016-46b8-b7fa-87832948e21d None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:58.409627 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1e6cd0-d016-46b8-b7fa-87832948e21d None admin] PATH_INFO: `/v3/projects/d828ff8720114b1b9da6709b7e51dcee` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:58.411452 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1e6cd0-d016-46b8-b7fa-87832948e21d None admin] RBAC: Authorizing `identity:get_project(project_id=d828ff8720114b1b9da6709b7e51dcee)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:58.412890 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1e6cd0-d016-46b8-b7fa-87832948e21d None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:58.414627 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 227/449] 10.222.0.43 () {56 vars in 1186 bytes} [Wed Jun 22 10:02:58 2022] GET /identity/v3/projects/d828ff8720114b1b9da6709b7e51dcee => generated 302 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:02:58.419955 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1e6cd0-d016-46b8-b7fa-87832948e21d None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:58.433657 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 223/450] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Jun 22 10:02:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 22 10:02:58.439167 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbb73f7-f68b-4a4a-8a7e-8b6a48bcc1b8 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:58.520583 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1e6cd0-d016-46b8-b7fa-87832948e21d None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:58.535054 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbb73f7-f68b-4a4a-8a7e-8b6a48bcc1b8 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:58.554152 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:58.556214 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60641806-24d1-495b-bdd8-7fd4c6817f43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:58.556998 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60641806-24d1-495b-bdd8-7fd4c6817f43 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:58.557276 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60641806-24d1-495b-bdd8-7fd4c6817f43 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:58.557551 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60641806-24d1-495b-bdd8-7fd4c6817f43 None admin] PATH_INFO: `/v3/groups/363e63ca29024f308dbb8d31e1742695` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:58.558763 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60641806-24d1-495b-bdd8-7fd4c6817f43 None admin] RBAC: Authorizing `identity:get_group(group_id=363e63ca29024f308dbb8d31e1742695)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:58.560208 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60641806-24d1-495b-bdd8-7fd4c6817f43 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:58.561854 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 228/451] 10.222.0.43 () {56 vars in 1180 bytes} [Wed Jun 22 10:02:58 2022] GET /identity/v3/groups/363e63ca29024f308dbb8d31e1742695 => generated 226 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:02:58.567602 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60641806-24d1-495b-bdd8-7fd4c6817f43 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:58.579145 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d9dbf0-adb1-4fa5-9ea1-df1d6621fab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:58.579999 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d9dbf0-adb1-4fa5-9ea1-df1d6621fab9 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:58.580283 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d9dbf0-adb1-4fa5-9ea1-df1d6621fab9 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:58.580560 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d9dbf0-adb1-4fa5-9ea1-df1d6621fab9 None admin] PATH_INFO: `/v3/projects/24726cc2fba44a5087e961da4a7cd653` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:58.581760 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d9dbf0-adb1-4fa5-9ea1-df1d6621fab9 None admin] RBAC: Authorizing `identity:get_project(project_id=24726cc2fba44a5087e961da4a7cd653)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:58.583795 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d9dbf0-adb1-4fa5-9ea1-df1d6621fab9 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:58.585559 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 224/452] 10.222.0.43 () {56 vars in 1186 bytes} [Wed Jun 22 10:02:58 2022] GET /identity/v3/projects/24726cc2fba44a5087e961da4a7cd653 => generated 344 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:02:58.590716 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d9dbf0-adb1-4fa5-9ea1-df1d6621fab9 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:58.596799 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:58.669490 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60641806-24d1-495b-bdd8-7fd4c6817f43 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:58.696278 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d9dbf0-adb1-4fa5-9ea1-df1d6621fab9 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:58.703687 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88b1eb2-3b4b-4ad6-940e-65cb7fe0f638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:58.704336 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88b1eb2-3b4b-4ad6-940e-65cb7fe0f638 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:58.704619 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88b1eb2-3b4b-4ad6-940e-65cb7fe0f638 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:58.704895 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88b1eb2-3b4b-4ad6-940e-65cb7fe0f638 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:58.705759 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88b1eb2-3b4b-4ad6-940e-65cb7fe0f638 None admin] RBAC: Adding query filter params (group.id=363e63ca29024f308dbb8d31e1742695, role.id=23a6a1fcd69d4210a8f2b45559b65aea, scope.project.id=d828ff8720114b1b9da6709b7e51dcee) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:02:58.706071 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88b1eb2-3b4b-4ad6-940e-65cb7fe0f638 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:58.707504 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88b1eb2-3b4b-4ad6-940e-65cb7fe0f638 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:58.713491 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 229/453] 10.222.0.43 () {56 vars in 1376 bytes} [Wed Jun 22 10:02:58 2022] GET /identity/v3/role_assignments?group.id=363e63ca29024f308dbb8d31e1742695&scope.project.id=d828ff8720114b1b9da6709b7e51dcee&role.id=23a6a1fcd69d4210a8f2b45559b65aea => generated 611 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:02:58.731960 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c0a2bf-c991-4132-a84f-653616b9d8d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:58.732837 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c0a2bf-c991-4132-a84f-653616b9d8d1 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:58.733124 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c0a2bf-c991-4132-a84f-653616b9d8d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:58.733410 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c0a2bf-c991-4132-a84f-653616b9d8d1 None admin] PATH_INFO: `/v3/groups/2b845b5bde804251ac3b4e081860c876` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:58.734718 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c0a2bf-c991-4132-a84f-653616b9d8d1 None admin] RBAC: Authorizing `identity:get_group(group_id=2b845b5bde804251ac3b4e081860c876)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:58.736210 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c0a2bf-c991-4132-a84f-653616b9d8d1 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:58.737954 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 225/454] 10.222.0.43 () {56 vars in 1180 bytes} [Wed Jun 22 10:02:58 2022] GET /identity/v3/groups/2b845b5bde804251ac3b4e081860c876 => generated 229 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:02:58.745130 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88b1eb2-3b4b-4ad6-940e-65cb7fe0f638 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:02:58.846808 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:02:58.854543 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88b1eb2-3b4b-4ad6-940e-65cb7fe0f638 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:02:58.891910 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe979d0-b727-4221-ae00-fe553f2f5c21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:02:58.892563 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe979d0-b727-4221-ae00-fe553f2f5c21 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:02:58.892850 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe979d0-b727-4221-ae00-fe553f2f5c21 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:02:58.893126 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe979d0-b727-4221-ae00-fe553f2f5c21 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:02:58.893994 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe979d0-b727-4221-ae00-fe553f2f5c21 None admin] RBAC: Adding query filter params (group.id=2b845b5bde804251ac3b4e081860c876, role.id=26d9c2ab5dfc4e6d9ca80c6014123906, scope.project.id=24726cc2fba44a5087e961da4a7cd653) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:02:58.894307 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe979d0-b727-4221-ae00-fe553f2f5c21 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:02:58.896975 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe979d0-b727-4221-ae00-fe553f2f5c21 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:02:58.902939 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 230/455] 10.222.0.43 () {56 vars in 1376 bytes} [Wed Jun 22 10:02:58 2022] GET /identity/v3/role_assignments?group.id=2b845b5bde804251ac3b4e081860c876&scope.project.id=24726cc2fba44a5087e961da4a7cd653&role.id=26d9c2ab5dfc4e6d9ca80c6014123906 => generated 611 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:01.416032 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f1a31a-697b-4726-aad9-d6dff066349d None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:01.416527 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f1a31a-697b-4726-aad9-d6dff066349d None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:01.416601 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f1a31a-697b-4726-aad9-d6dff066349d None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:01.418318 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 226/456] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:03:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:03:01.423786 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d97d6e9-51d1-4940-aefe-08af591c4ba4 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:01.424624 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d97d6e9-51d1-4940-aefe-08af591c4ba4 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:01.425104 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d97d6e9-51d1-4940-aefe-08af591c4ba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:01.454780 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-6d97d6e9-51d1-4940-aefe-08af591c4ba4 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:03:01.456296 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-6d97d6e9-51d1-4940-aefe-08af591c4ba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:03:01.514404 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf7ada1-ae8f-4f1a-a5cd-6eaa0c9d423d None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:01.514926 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf7ada1-ae8f-4f1a-a5cd-6eaa0c9d423d None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:01.515416 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf7ada1-ae8f-4f1a-a5cd-6eaa0c9d423d None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:01.518358 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 227/457] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:03:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:03:01.524298 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7278b3-d5a0-49ce-af76-612afb9afe1d None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:01.524586 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7278b3-d5a0-49ce-af76-612afb9afe1d None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:01.525026 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7278b3-d5a0-49ce-af76-612afb9afe1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:01.543639 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 231/458] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:03:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 10:03:01.562798 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-4f7278b3-d5a0-49ce-af76-612afb9afe1d None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:03:01.564192 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-4f7278b3-d5a0-49ce-af76-612afb9afe1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:03:01.567866 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d97d6e9-51d1-4940-aefe-08af591c4ba4 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:01.655299 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:01.702345 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 228/459] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:03:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 10:03:01.717742 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:01.731141 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7278b3-d5a0-49ce-af76-612afb9afe1d None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:01.737097 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d97d6e9-51d1-4940-aefe-08af591c4ba4 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:01.801438 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c035747c-d8c3-4890-a81b-9d813c65c6d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:01.803218 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c035747c-d8c3-4890-a81b-9d813c65c6d4 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:01.803699 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c035747c-d8c3-4890-a81b-9d813c65c6d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:01.804077 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c035747c-d8c3-4890-a81b-9d813c65c6d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:01.815380 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c035747c-d8c3-4890-a81b-9d813c65c6d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:01.817085 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c035747c-d8c3-4890-a81b-9d813c65c6d4 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:01.837208 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-c035747c-d8c3-4890-a81b-9d813c65c6d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:03:01.837208 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:01.837208 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:01.837208 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:01.837208 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:01.837208 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:01.837208 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:01.837208 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:01.837208 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:01.837208 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:01.837208 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:01.837208 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:01.837208 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:03:01.837208 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:03:01.837208 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:03:01.838269 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:03:01.838269 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:01.838269 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:01.838269 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:01.838269 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:01.838269 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:01.838269 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:01.838269 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:01.838269 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:01.838269 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:01.838269 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:01.838269 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:01.838269 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:01.838269 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:01.838269 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:01.838269 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:01.838269 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:01.839118 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:03:01.839118 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:03:01.839118 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:03:01.839118 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:03:01.839118 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 232/460] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jun 22 10:03:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 10:03:01.844409 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5be1996-2bc1-4ae3-859d-b0730f5b5ed5 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:01.844409 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5be1996-2bc1-4ae3-859d-b0730f5b5ed5 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:01.844409 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5be1996-2bc1-4ae3-859d-b0730f5b5ed5 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:01.844409 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 233/461] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:03:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:03:01.847337 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5be1996-2bc1-4ae3-859d-b0730f5b5ed5 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:01.878630 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7278b3-d5a0-49ce-af76-612afb9afe1d None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:01.919079 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d11ce4d-0b25-4631-92a5-95785a3f54e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:01.920088 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d11ce4d-0b25-4631-92a5-95785a3f54e6 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:01.920270 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d11ce4d-0b25-4631-92a5-95785a3f54e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:01.920541 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d11ce4d-0b25-4631-92a5-95785a3f54e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:01.932336 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d11ce4d-0b25-4631-92a5-95785a3f54e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:01.934167 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d11ce4d-0b25-4631-92a5-95785a3f54e6 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:01.959337 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-7d11ce4d-0b25-4631-92a5-95785a3f54e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:03:01.959337 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:01.959337 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:01.959337 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:01.959337 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:01.959337 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:01.959337 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:01.959337 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:01.959337 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:01.959337 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:01.959337 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:01.959337 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:01.959337 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:03:01.959337 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:03:01.959337 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:03:01.960658 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:03:01.960658 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:01.960658 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:01.960658 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:01.960658 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:01.960658 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:01.960658 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:01.960658 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:01.960658 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:01.960658 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:01.960658 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:01.960658 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:01.960658 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:01.960658 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:01.960658 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:01.960658 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:01.960658 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:01.961498 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:03:01.961498 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:03:01.961498 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:03:01.961498 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:03:01.965503 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 229/462] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jun 22 10:03:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:03:01.967386 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d8731b-0374-4780-862f-440246bb5309 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:01.967680 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d8731b-0374-4780-862f-440246bb5309 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:01.967985 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d8731b-0374-4780-862f-440246bb5309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:01.978658 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5be1996-2bc1-4ae3-859d-b0730f5b5ed5 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:01.988967 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-83d8731b-0374-4780-862f-440246bb5309 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:03:01.991252 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-83d8731b-0374-4780-862f-440246bb5309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:03:02.021786 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9dcba0-0107-43c9-a2fe-46aef7d0c5d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:02.023005 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9dcba0-0107-43c9-a2fe-46aef7d0c5d9 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:02.023496 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9dcba0-0107-43c9-a2fe-46aef7d0c5d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:02.024057 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9dcba0-0107-43c9-a2fe-46aef7d0c5d9 None admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:02.025315 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:02.025589 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9dcba0-0107-43c9-a2fe-46aef7d0c5d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:02.026860 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9dcba0-0107-43c9-a2fe-46aef7d0c5d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:02.028600 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9dcba0-0107-43c9-a2fe-46aef7d0c5d9 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:02.048039 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 234/463] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Jun 22 10:03:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:02.049507 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9dcba0-0107-43c9-a2fe-46aef7d0c5d9 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:02.053459 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:02.082293 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 230/464] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:03:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 10:03:02.084232 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d8731b-0374-4780-862f-440246bb5309 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:02.199489 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9dcba0-0107-43c9-a2fe-46aef7d0c5d9 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:02.208670 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d8731b-0374-4780-862f-440246bb5309 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:02.236975 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0eb5d1-23e3-459f-b945-9f89e9ffbbeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:02.237678 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0eb5d1-23e3-459f-b945-9f89e9ffbbeb None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:02.238086 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0eb5d1-23e3-459f-b945-9f89e9ffbbeb None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:02.238373 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0eb5d1-23e3-459f-b945-9f89e9ffbbeb None admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:02.239090 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0eb5d1-23e3-459f-b945-9f89e9ffbbeb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:02.240181 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0eb5d1-23e3-459f-b945-9f89e9ffbbeb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:02.241572 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0eb5d1-23e3-459f-b945-9f89e9ffbbeb None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:02.243719 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6505d3-6c67-45d4-b990-869aea4c13c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:02.244388 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6505d3-6c67-45d4-b990-869aea4c13c7 None admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:02.244672 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6505d3-6c67-45d4-b990-869aea4c13c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:02.244948 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6505d3-6c67-45d4-b990-869aea4c13c7 None admin] PATH_INFO: `/v3/users` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:02.245645 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6505d3-6c67-45d4-b990-869aea4c13c7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:02.247110 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6505d3-6c67-45d4-b990-869aea4c13c7 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:02.258179 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 235/465] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Jun 22 10:03:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:02.258179 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0eb5d1-23e3-459f-b945-9f89e9ffbbeb None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:02.274678 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 231/466] 10.222.0.43 () {60 vars in 1132 bytes} [Wed Jun 22 10:03:02 2022] POST /identity/v3/users => generated 246 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:03:02.274678 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b2f99e-3440-46d5-a2a1-024faa31c37c None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:02.274678 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b2f99e-3440-46d5-a2a1-024faa31c37c None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:02.274678 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b2f99e-3440-46d5-a2a1-024faa31c37c None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:02.274678 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 232/467] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:03:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:03:02.274678 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b2f99e-3440-46d5-a2a1-024faa31c37c None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:02.309775 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:02.342889 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:02.396676 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0eb5d1-23e3-459f-b945-9f89e9ffbbeb None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:02.432598 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b2f99e-3440-46d5-a2a1-024faa31c37c None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:02.436205 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1365b6af-d0e7-4a15-a60e-743df62e361b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:02.437126 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1365b6af-d0e7-4a15-a60e-743df62e361b None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:02.437513 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1365b6af-d0e7-4a15-a60e-743df62e361b None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:02.437931 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1365b6af-d0e7-4a15-a60e-743df62e361b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:02.450446 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1365b6af-d0e7-4a15-a60e-743df62e361b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:02.452150 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1365b6af-d0e7-4a15-a60e-743df62e361b None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:02.475499 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-1365b6af-d0e7-4a15-a60e-743df62e361b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:03:02.475499 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:02.475499 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:02.475499 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:02.475499 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:02.475499 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:02.475499 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:02.475499 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:02.475499 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:02.475499 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:02.475499 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:02.475499 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:02.475499 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:03:02.475499 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:03:02.475499 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:03:02.476720 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:03:02.476720 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:02.476720 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:02.476720 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:02.476720 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:02.476720 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:02.476720 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:02.476720 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:02.476720 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:02.476720 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:02.476720 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:02.476720 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:02.476720 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:02.476720 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:02.476720 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:02.476720 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:02.476720 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:02.477580 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:03:02.477580 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:03:02.477580 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:03:02.477580 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:03:02.477580 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 236/468] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jun 22 10:03:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:03:02.477862 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9de879a-4637-4a5d-a528-fa625f771c3c None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:02.478048 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9de879a-4637-4a5d-a528-fa625f771c3c None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:02.478539 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9de879a-4637-4a5d-a528-fa625f771c3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:02.485848 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a6bd65-e7e9-415a-91fc-b45d763f379d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:02.486717 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a6bd65-e7e9-415a-91fc-b45d763f379d None admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:02.487204 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a6bd65-e7e9-415a-91fc-b45d763f379d None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:02.487632 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a6bd65-e7e9-415a-91fc-b45d763f379d None admin] PATH_INFO: `/v3/users` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:02.488496 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a6bd65-e7e9-415a-91fc-b45d763f379d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:02.491984 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a6bd65-e7e9-415a-91fc-b45d763f379d None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:02.497437 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-c9de879a-4637-4a5d-a528-fa625f771c3c None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:03:02.498918 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-c9de879a-4637-4a5d-a528-fa625f771c3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:03:02.517750 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 233/469] 10.222.0.43 () {60 vars in 1132 bytes} [Wed Jun 22 10:03:02 2022] POST /identity/v3/users => generated 248 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:03:02.518870 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a6bd65-e7e9-415a-91fc-b45d763f379d None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:02.590135 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 237/470] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:03:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 10:03:02.624945 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:02.625859 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9de879a-4637-4a5d-a528-fa625f771c3c None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:02.661474 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a6bd65-e7e9-415a-91fc-b45d763f379d None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:02.694087 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:02.704955 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e02403-7d42-4f5d-a0c7-9244f28d7fa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:02.705636 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e02403-7d42-4f5d-a0c7-9244f28d7fa2 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:02.705988 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e02403-7d42-4f5d-a0c7-9244f28d7fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:02.706273 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e02403-7d42-4f5d-a0c7-9244f28d7fa2 None admin] PATH_INFO: `/v3/domains` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:02.707017 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e02403-7d42-4f5d-a0c7-9244f28d7fa2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:02.707329 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e02403-7d42-4f5d-a0c7-9244f28d7fa2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:02.708853 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e02403-7d42-4f5d-a0c7-9244f28d7fa2 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:02.729345 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 234/471] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Jun 22 10:03:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:02.735586 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e02403-7d42-4f5d-a0c7-9244f28d7fa2 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:02.767523 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9de879a-4637-4a5d-a528-fa625f771c3c None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:02.813586 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b3fa49-13dc-4d5f-bdf0-4df4eba2ce61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:02.815092 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b3fa49-13dc-4d5f-bdf0-4df4eba2ce61 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:02.815532 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b3fa49-13dc-4d5f-bdf0-4df4eba2ce61 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:02.816218 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b3fa49-13dc-4d5f-bdf0-4df4eba2ce61 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:02.831452 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b3fa49-13dc-4d5f-bdf0-4df4eba2ce61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:02.833178 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b3fa49-13dc-4d5f-bdf0-4df4eba2ce61 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:02.853479 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-00b3fa49-13dc-4d5f-bdf0-4df4eba2ce61 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:03:02.853479 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:02.853479 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:02.853479 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:02.853479 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:02.853479 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:02.853479 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:02.853479 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:02.853479 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:02.853479 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:02.853479 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:02.853479 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:02.853479 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:03:02.853479 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:03:02.853479 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:03:02.854478 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:03:02.854478 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:02.854478 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:02.854478 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:02.854478 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:02.854478 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:02.854478 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:02.854478 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:02.854478 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:02.854478 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:02.854478 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:02.854478 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:02.854478 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:02.854478 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:02.854478 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:02.854478 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:02.854478 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:02.855329 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:03:02.855329 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:03:02.855329 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:03:02.855329 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:03:02.855543 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 238/472] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jun 22 10:03:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 10:03:02.861497 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b3fa49-13dc-4d5f-bdf0-4df4eba2ce61 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:02.869864 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e02403-7d42-4f5d-a0c7-9244f28d7fa2 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:02.906866 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a074d9-008e-4fdd-95e4-8bef521bba9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:02.907846 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a074d9-008e-4fdd-95e4-8bef521bba9b None admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:02.908410 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a074d9-008e-4fdd-95e4-8bef521bba9b None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:02.908868 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a074d9-008e-4fdd-95e4-8bef521bba9b None admin] PATH_INFO: `/v3/users` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:02.909832 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a074d9-008e-4fdd-95e4-8bef521bba9b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:02.912053 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a074d9-008e-4fdd-95e4-8bef521bba9b None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:02.920093 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:02.937674 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 235/473] 10.222.0.43 () {60 vars in 1132 bytes} [Wed Jun 22 10:03:02 2022] POST /identity/v3/users => generated 248 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 10:03:02.987648 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:02.997621 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b3fa49-13dc-4d5f-bdf0-4df4eba2ce61 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:03.021612 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0414220b-dceb-4804-aaac-80441bf013d0 None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:03.022280 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0414220b-dceb-4804-aaac-80441bf013d0 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:03.022779 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0414220b-dceb-4804-aaac-80441bf013d0 None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:03.024556 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 236/474] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:03:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 10:03:03.032491 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca227c59-60d6-4f0f-b185-1911b1cfed66 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:03.032785 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca227c59-60d6-4f0f-b185-1911b1cfed66 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:03.033070 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca227c59-60d6-4f0f-b185-1911b1cfed66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:03.049588 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d67c3ed-08a8-4918-9778-a37e23dab711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:03.050593 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d67c3ed-08a8-4918-9778-a37e23dab711 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:03.051022 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d67c3ed-08a8-4918-9778-a37e23dab711 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:03.051493 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d67c3ed-08a8-4918-9778-a37e23dab711 None admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:03.053107 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d67c3ed-08a8-4918-9778-a37e23dab711 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:03.053571 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d67c3ed-08a8-4918-9778-a37e23dab711 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:03.053791 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-ca227c59-60d6-4f0f-b185-1911b1cfed66 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:03:03.055049 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-ca227c59-60d6-4f0f-b185-1911b1cfed66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:03:03.055648 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d67c3ed-08a8-4918-9778-a37e23dab711 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:03.076812 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 239/475] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Jun 22 10:03:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:03.082788 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d67c3ed-08a8-4918-9778-a37e23dab711 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:03.174054 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 237/476] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:03:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 10:03:03.193204 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca227c59-60d6-4f0f-b185-1911b1cfed66 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:03.221272 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d67c3ed-08a8-4918-9778-a37e23dab711 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:03.264195 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9ee650-1202-447f-bed7-26810b997494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:03.264940 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9ee650-1202-447f-bed7-26810b997494 None admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:03.265284 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9ee650-1202-447f-bed7-26810b997494 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:03.265502 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9ee650-1202-447f-bed7-26810b997494 None admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:03.266406 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9ee650-1202-447f-bed7-26810b997494 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:03.268105 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9ee650-1202-447f-bed7-26810b997494 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:03.295623 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 240/477] 10.222.0.43 () {60 vars in 1132 bytes} [Wed Jun 22 10:03:03 2022] POST /identity/v3/users => generated 249 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:03:03.323098 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca227c59-60d6-4f0f-b185-1911b1cfed66 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:03.347119 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:03.366872 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2792031c-01a6-44b6-b341-187f7a34408a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:03.367580 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2792031c-01a6-44b6-b341-187f7a34408a None admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:03.367921 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2792031c-01a6-44b6-b341-187f7a34408a None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:03.368208 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2792031c-01a6-44b6-b341-187f7a34408a None admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:03.368995 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2792031c-01a6-44b6-b341-187f7a34408a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:03.370589 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2792031c-01a6-44b6-b341-187f7a34408a None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:03.380823 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.sql.core [None req-2792031c-01a6-44b6-b341-187f7a34408a None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 22 10:03:03.380823 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 22 10:03:03.380823 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [parameters: {'id': '907c1c666fe44f1f86a0316cef211b54', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 22 10:03:03.380823 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80378) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 22 10:03:03.399383 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-2792031c-01a6-44b6-b341-187f7a34408a None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 22 10:03:03.399383 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:03.399383 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 22 10:03:03.399383 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 22 10:03:03.399383 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 22 10:03:03.399383 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 22 10:03:03.399383 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 22 10:03:03.399383 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application result = self._query(query) Jun 22 10:03:03.399383 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 22 10:03:03.399383 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application conn.query(q) Jun 22 10:03:03.399383 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 22 10:03:03.399383 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 22 10:03:03.399383 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 22 10:03:03.399383 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application result.read() Jun 22 10:03:03.399383 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 22 10:03:03.400319 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 22 10:03:03.400319 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 22 10:03:03.400319 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 22 10:03:03.400319 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 22 10:03:03.400319 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 22 10:03:03.400319 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 22 10:03:03.400319 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 22 10:03:03.400319 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 22 10:03:03.400319 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:03:03.400319 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 22 10:03:03.400319 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:03:03.400319 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:03.400319 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 22 10:03:03.400319 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 22 10:03:03.400319 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jun 22 10:03:03.400319 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return ref.to_dict() Jun 22 10:03:03.400319 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 22 10:03:03.400319 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application next(self.gen) Jun 22 10:03:03.401219 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 22 10:03:03.401219 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application yield resource Jun 22 10:03:03.401219 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 22 10:03:03.401219 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application next(self.gen) Jun 22 10:03:03.401219 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 22 10:03:03.401219 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application self.session.rollback() Jun 22 10:03:03.401219 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 22 10:03:03.401219 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application self.force_reraise() Jun 22 10:03:03.401219 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 22 10:03:03.401219 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise self.value Jun 22 10:03:03.401219 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 22 10:03:03.401219 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 22 10:03:03.401219 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 22 10:03:03.401219 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application session.commit() Jun 22 10:03:03.401219 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 22 10:03:03.401219 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 22 10:03:03.401219 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 22 10:03:03.402113 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application self._prepare_impl() Jun 22 10:03:03.402113 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 22 10:03:03.402113 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application self.session.flush() Jun 22 10:03:03.402113 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 22 10:03:03.402113 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application self._flush(objects) Jun 22 10:03:03.402113 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 22 10:03:03.402113 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 22 10:03:03.402113 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 22 10:03:03.402113 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application compat.raise_( Jun 22 10:03:03.402113 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 22 10:03:03.402113 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception Jun 22 10:03:03.402113 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 22 10:03:03.402113 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application flush_context.execute() Jun 22 10:03:03.402113 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 22 10:03:03.402113 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rec.execute(self) Jun 22 10:03:03.402113 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 22 10:03:03.402113 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 22 10:03:03.402976 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 22 10:03:03.402976 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 22 10:03:03.402976 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 22 10:03:03.402976 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 22 10:03:03.402976 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 22 10:03:03.402976 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 22 10:03:03.402976 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 22 10:03:03.402976 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 22 10:03:03.402976 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 22 10:03:03.402976 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 22 10:03:03.402976 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 22 10:03:03.402976 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 22 10:03:03.402976 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 22 10:03:03.402976 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 22 10:03:03.402976 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 22 10:03:03.402976 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception Jun 22 10:03:03.403778 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 22 10:03:03.403778 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 22 10:03:03.403778 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 22 10:03:03.403778 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 22 10:03:03.403778 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 22 10:03:03.403778 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application result = self._query(query) Jun 22 10:03:03.403778 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 22 10:03:03.403778 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application conn.query(q) Jun 22 10:03:03.403778 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 22 10:03:03.403778 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 22 10:03:03.403778 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 22 10:03:03.403778 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application result.read() Jun 22 10:03:03.403778 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 22 10:03:03.403778 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 22 10:03:03.403778 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 22 10:03:03.403778 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 22 10:03:03.404550 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 22 10:03:03.404550 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 22 10:03:03.404550 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 22 10:03:03.404550 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 22 10:03:03.404550 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 22 10:03:03.404550 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 22 10:03:03.404550 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [parameters: {'id': '907c1c666fe44f1f86a0316cef211b54', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 22 10:03:03.404550 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 22 10:03:03.404550 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:03:03.404550 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 10:03:03.404550 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:03:03.404550 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:03.404550 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:03.404550 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:03.404550 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:03.404550 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:03.405339 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:03.405339 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:03.405339 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:03.405339 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:03.405339 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:03.405339 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:03.405339 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jun 22 10:03:03.405339 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jun 22 10:03:03.405339 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:03.405339 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:03.405339 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jun 22 10:03:03.405339 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jun 22 10:03:03.405339 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 22 10:03:03.405339 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 22 10:03:03.405339 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 22 10:03:03.405339 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:03:03.408430 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 238/478] 10.222.0.43 () {60 vars in 1131 bytes} [Wed Jun 22 10:03:03 2022] POST /identity/v3/roles => generated 144 bytes in 209 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jun 22 10:03:03.413003 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9ee650-1202-447f-bed7-26810b997494 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:03.438756 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:03.564629 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9ee650-1202-447f-bed7-26810b997494 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:03.603971 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b0e6d6-75ac-453d-a542-9767a17ef706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:03.604801 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b0e6d6-75ac-453d-a542-9767a17ef706 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:03.605085 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b0e6d6-75ac-453d-a542-9767a17ef706 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:03.605360 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b0e6d6-75ac-453d-a542-9767a17ef706 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:03.617465 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b0e6d6-75ac-453d-a542-9767a17ef706 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:03:03.625845 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-e5b0e6d6-75ac-453d-a542-9767a17ef706 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 10:03:03.625845 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:03.625845 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:03.625845 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:03.625845 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:03.625845 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:03.625845 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:03.625845 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:03.625845 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:03.625845 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:03.625845 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:03.625845 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:03.625845 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:03:03.625845 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:03:03.625845 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:03:03.625845 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:03:03.626724 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:03:03.626724 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:03:03.626724 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:03:03.626724 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:03:03.626724 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:03.626724 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:03.626724 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:03.626724 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:03.626724 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:03.626724 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:03.626724 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:03.626724 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:03.626724 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:03.626724 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:03.626724 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:03.626724 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:03.627500 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:03.627500 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:03.627500 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:03.627500 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:03.627500 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:03:03.627500 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:03:03.627500 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:03:03.627500 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:03:03.627500 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:03:03.627500 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:03:03.627500 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 10:03:03.627500 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:03:03.627500 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 241/479] 10.222.0.43 () {56 vars in 1114 bytes} [Wed Jun 22 10:03:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:03:03.634148 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2792031c-01a6-44b6-b341-187f7a34408a None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:03.756843 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2792031c-01a6-44b6-b341-187f7a34408a None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:03.795654 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dc3b64-8243-4cad-bc05-10da4f22878c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:03.796373 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dc3b64-8243-4cad-bc05-10da4f22878c None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:03.796741 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dc3b64-8243-4cad-bc05-10da4f22878c None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:03.796951 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dc3b64-8243-4cad-bc05-10da4f22878c None admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:03.797729 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dc3b64-8243-4cad-bc05-10da4f22878c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:03.800881 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dc3b64-8243-4cad-bc05-10da4f22878c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:03.800881 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dc3b64-8243-4cad-bc05-10da4f22878c None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:03.813822 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 239/480] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Jun 22 10:03:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:05.154326 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aad14e-07e9-4ad5-966d-b1dde46c1764 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:05.154835 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aad14e-07e9-4ad5-966d-b1dde46c1764 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:05.154910 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aad14e-07e9-4ad5-966d-b1dde46c1764 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:05.156516 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 242/481] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:03:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:03:05.162279 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c874943f-cfdc-4ee3-985f-eca89eb52a76 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:05.162755 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c874943f-cfdc-4ee3-985f-eca89eb52a76 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:05.162829 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c874943f-cfdc-4ee3-985f-eca89eb52a76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:05.182529 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-c874943f-cfdc-4ee3-985f-eca89eb52a76 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:03:05.184088 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-c874943f-cfdc-4ee3-985f-eca89eb52a76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:03:05.219393 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acaf737-2351-4c89-a96d-bc974553fb41 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:05.219713 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acaf737-2351-4c89-a96d-bc974553fb41 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:05.220008 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acaf737-2351-4c89-a96d-bc974553fb41 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:05.221622 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 243/482] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:03:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:03:05.231899 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da8cebf-2dc9-498a-aa7f-55fe4e8532d8 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:05.232181 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da8cebf-2dc9-498a-aa7f-55fe4e8532d8 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:05.232455 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da8cebf-2dc9-498a-aa7f-55fe4e8532d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:05.233777 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:05.261386 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 240/483] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:03:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 10:03:05.270065 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-9da8cebf-2dc9-498a-aa7f-55fe4e8532d8 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:03:05.271859 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-9da8cebf-2dc9-498a-aa7f-55fe4e8532d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:03:05.299821 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c874943f-cfdc-4ee3-985f-eca89eb52a76 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:05.407626 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 244/484] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:03:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 10:03:05.439423 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c874943f-cfdc-4ee3-985f-eca89eb52a76 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:05.449318 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da8cebf-2dc9-498a-aa7f-55fe4e8532d8 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:05.451745 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:05.480684 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3478cc5-2c49-49a2-bbca-d6e62b21d205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:05.481871 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3478cc5-2c49-49a2-bbca-d6e62b21d205 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:05.482526 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3478cc5-2c49-49a2-bbca-d6e62b21d205 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:05.483004 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3478cc5-2c49-49a2-bbca-d6e62b21d205 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:05.496140 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3478cc5-2c49-49a2-bbca-d6e62b21d205 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:03:05.504873 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-c3478cc5-2c49-49a2-bbca-d6e62b21d205 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 10:03:05.504873 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:05.504873 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:05.504873 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:05.504873 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:05.504873 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:05.504873 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:05.504873 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:05.504873 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:05.504873 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:05.504873 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:05.504873 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:05.504873 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:03:05.504873 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:03:05.504873 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:03:05.504873 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:03:05.506300 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:03:05.506300 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:03:05.506300 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:03:05.506300 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:03:05.506300 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:05.506300 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:05.506300 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:05.506300 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:05.506300 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:05.506300 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:05.506300 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:05.506300 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:05.506300 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:05.506300 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:05.506300 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:05.506300 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:05.507099 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:05.507099 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:05.507099 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:05.507099 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:05.507099 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:03:05.507099 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:03:05.507099 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:03:05.507099 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:03:05.507099 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:03:05.507099 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:03:05.507099 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 10:03:05.507099 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:03:05.510366 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 241/485] 10.222.0.43 () {56 vars in 1102 bytes} [Wed Jun 22 10:03:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:03:05.521711 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3478cc5-2c49-49a2-bbca-d6e62b21d205 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:05.587893 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:05.650722 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da8cebf-2dc9-498a-aa7f-55fe4e8532d8 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:05.711488 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907c3643-74bf-4c40-ad9a-6fa0cc8ed88f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:05.713720 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907c3643-74bf-4c40-ad9a-6fa0cc8ed88f None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:05.715558 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907c3643-74bf-4c40-ad9a-6fa0cc8ed88f None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:05.715966 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907c3643-74bf-4c40-ad9a-6fa0cc8ed88f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:05.717380 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3478cc5-2c49-49a2-bbca-d6e62b21d205 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:05.741423 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907c3643-74bf-4c40-ad9a-6fa0cc8ed88f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:03:05.750726 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-907c3643-74bf-4c40-ad9a-6fa0cc8ed88f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 10:03:05.750726 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:05.750726 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:05.750726 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:05.750726 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:05.750726 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:05.750726 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:05.750726 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:05.750726 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:05.750726 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:05.750726 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:05.750726 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:05.750726 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:03:05.750726 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:03:05.750726 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:03:05.750726 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:03:05.751807 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:03:05.751807 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:03:05.751807 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:03:05.751807 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:03:05.751807 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:05.751807 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:05.751807 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:05.751807 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:05.751807 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:05.751807 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:05.751807 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:05.751807 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:05.751807 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:05.751807 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:05.751807 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:05.751807 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:05.752787 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:05.752787 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:05.752787 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:05.752787 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:05.752787 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:03:05.752787 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:03:05.752787 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:03:05.752787 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:03:05.752787 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:03:05.752787 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:03:05.752787 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 10:03:05.752787 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:03:05.764641 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 245/486] 10.222.0.43 () {56 vars in 1102 bytes} [Wed Jun 22 10:03:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 10:03:05.770826 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907c3643-74bf-4c40-ad9a-6fa0cc8ed88f None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:05.780410 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8323ac97-22c7-43c3-811b-a41c7feb2da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:05.781342 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8323ac97-22c7-43c3-811b-a41c7feb2da2 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:05.781788 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8323ac97-22c7-43c3-811b-a41c7feb2da2 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:05.782232 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8323ac97-22c7-43c3-811b-a41c7feb2da2 None admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:05.783145 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8323ac97-22c7-43c3-811b-a41c7feb2da2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:05.783594 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8323ac97-22c7-43c3-811b-a41c7feb2da2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:05.785116 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8323ac97-22c7-43c3-811b-a41c7feb2da2 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:05.795261 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 242/487] 10.222.0.43 () {56 vars in 1103 bytes} [Wed Jun 22 10:03:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:05.801248 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8323ac97-22c7-43c3-811b-a41c7feb2da2 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:05.852034 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:05.892546 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907c3643-74bf-4c40-ad9a-6fa0cc8ed88f None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:05.913408 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:05.918260 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8323ac97-22c7-43c3-811b-a41c7feb2da2 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:05.929573 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e3fe0c-2e55-4c4c-8bae-1aac54fe3d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:05.930371 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e3fe0c-2e55-4c4c-8bae-1aac54fe3d3e None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:05.930758 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e3fe0c-2e55-4c4c-8bae-1aac54fe3d3e None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:05.931140 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e3fe0c-2e55-4c4c-8bae-1aac54fe3d3e None admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:05.932003 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e3fe0c-2e55-4c4c-8bae-1aac54fe3d3e None admin] RBAC: Adding query filter params (name=service) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:05.932446 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e3fe0c-2e55-4c4c-8bae-1aac54fe3d3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:05.933942 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e3fe0c-2e55-4c4c-8bae-1aac54fe3d3e None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:05.943605 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 246/488] 10.222.0.43 () {56 vars in 1103 bytes} [Wed Jun 22 10:03:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:05.944991 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a504df-5331-4da3-9590-001d495e5245 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:05.945342 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a504df-5331-4da3-9590-001d495e5245 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:05.945704 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a504df-5331-4da3-9590-001d495e5245 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:05.951243 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 247/489] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:03:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:03:05.952083 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a504df-5331-4da3-9590-001d495e5245 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:05.959881 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3da2482-bf6f-4632-b15d-b1745ba82eaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:05.960872 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3da2482-bf6f-4632-b15d-b1745ba82eaf None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:05.961295 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3da2482-bf6f-4632-b15d-b1745ba82eaf None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:05.961810 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3da2482-bf6f-4632-b15d-b1745ba82eaf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:05.975011 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3da2482-bf6f-4632-b15d-b1745ba82eaf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:05.977069 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3da2482-bf6f-4632-b15d-b1745ba82eaf None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:05.998543 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-c3da2482-bf6f-4632-b15d-b1745ba82eaf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:03:05.998543 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:05.998543 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:05.998543 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:05.998543 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:05.998543 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:05.998543 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:05.998543 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:05.998543 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:05.998543 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:05.998543 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:05.998543 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:05.998543 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:03:05.998543 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:03:05.998543 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:03:05.999444 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:03:05.999444 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:05.999444 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:05.999444 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:05.999444 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:05.999444 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:05.999444 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:05.999444 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:05.999444 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:05.999444 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:05.999444 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:05.999444 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:05.999444 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:05.999444 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:05.999444 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:05.999444 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:05.999444 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:06.000262 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:03:06.000262 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:03:06.000262 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:03:06.000262 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:03:06.001940 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 243/490] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jun 22 10:03:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:03:06.003517 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2106a0f-c475-4741-bf37-978c07b0257e None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:06.003941 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2106a0f-c475-4741-bf37-978c07b0257e None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:06.004456 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2106a0f-c475-4741-bf37-978c07b0257e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:06.023480 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-d2106a0f-c475-4741-bf37-978c07b0257e None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:03:06.025007 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-d2106a0f-c475-4741-bf37-978c07b0257e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:03:06.063964 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a504df-5331-4da3-9590-001d495e5245 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:06.091436 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:06.102883 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fbd467-f82b-464b-9f30-d480992b9c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:06.103368 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fbd467-f82b-464b-9f30-d480992b9c27 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:06.103658 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fbd467-f82b-464b-9f30-d480992b9c27 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:06.103938 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fbd467-f82b-464b-9f30-d480992b9c27 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:06.116106 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fbd467-f82b-464b-9f30-d480992b9c27 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:06.117826 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fbd467-f82b-464b-9f30-d480992b9c27 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:06.118860 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 244/491] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:03:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 10:03:06.120068 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2106a0f-c475-4741-bf37-978c07b0257e None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:06.163417 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-58fbd467-f82b-464b-9f30-d480992b9c27 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:03:06.163417 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:06.163417 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:06.163417 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:06.163417 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:06.163417 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:06.163417 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:06.163417 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:06.163417 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:06.163417 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:06.163417 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:06.163417 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:06.163417 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:03:06.163417 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:03:06.163417 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:03:06.165166 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:03:06.165166 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:06.165166 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:06.165166 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:06.165166 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:06.165166 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:06.165166 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:06.165166 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:06.165166 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:06.165166 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:06.165166 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:06.165166 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:06.165166 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:06.165166 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:06.165166 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:06.165166 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:06.165166 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:06.166343 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:03:06.166343 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:03:06.166343 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:03:06.166343 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:03:06.166343 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 248/492] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jun 22 10:03:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:03:06.167164 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fbd467-f82b-464b-9f30-d480992b9c27 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:06.219183 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:06.243430 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2106a0f-c475-4741-bf37-978c07b0257e None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:06.271435 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fbd467-f82b-464b-9f30-d480992b9c27 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:06.281961 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ecbf55-836b-4cf2-8bd3-08ff39cf9add None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:06.283073 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ecbf55-836b-4cf2-8bd3-08ff39cf9add None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:06.283555 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ecbf55-836b-4cf2-8bd3-08ff39cf9add None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:06.284028 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ecbf55-836b-4cf2-8bd3-08ff39cf9add None admin] PATH_INFO: `/v3/domains` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:06.284950 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ecbf55-836b-4cf2-8bd3-08ff39cf9add None admin] RBAC: Adding query filter params (name=Default) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:06.285549 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ecbf55-836b-4cf2-8bd3-08ff39cf9add None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:06.287656 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ecbf55-836b-4cf2-8bd3-08ff39cf9add None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:06.301173 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 245/493] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Jun 22 10:03:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:06.303194 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ecbf55-836b-4cf2-8bd3-08ff39cf9add None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:06.312423 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be28982-c789-484a-b0d9-fd8d319b7858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:06.312423 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be28982-c789-484a-b0d9-fd8d319b7858 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:06.312423 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be28982-c789-484a-b0d9-fd8d319b7858 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:06.312423 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be28982-c789-484a-b0d9-fd8d319b7858 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:06.320259 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be28982-c789-484a-b0d9-fd8d319b7858 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:03:06.328140 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-2be28982-c789-484a-b0d9-fd8d319b7858 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 10:03:06.328140 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:06.328140 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:06.328140 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:06.328140 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:06.328140 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:06.328140 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:06.328140 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:06.328140 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:06.328140 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:06.328140 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:06.328140 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:06.328140 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:03:06.328140 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:03:06.328140 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:03:06.328140 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:03:06.329037 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:03:06.329037 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:03:06.329037 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:03:06.329037 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:03:06.329037 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:06.329037 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:06.329037 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:06.329037 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:06.329037 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:06.329037 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:06.329037 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:06.329037 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:06.329037 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:06.329037 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:06.329037 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:06.329037 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:06.330245 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:06.330245 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:06.330245 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:06.330245 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:06.330245 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:03:06.330245 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:03:06.330245 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:03:06.330245 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:03:06.330245 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:03:06.330245 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:03:06.330245 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 10:03:06.330245 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:03:06.330245 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 249/494] 10.222.0.43 () {56 vars in 1102 bytes} [Wed Jun 22 10:03:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 10:03:06.334303 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be28982-c789-484a-b0d9-fd8d319b7858 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:06.393468 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:06.415149 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ecbf55-836b-4cf2-8bd3-08ff39cf9add None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:06.443567 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be28982-c789-484a-b0d9-fd8d319b7858 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:06.452555 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b5717f-98d6-4cbe-ba9d-cb4080b9976e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:06.453239 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b5717f-98d6-4cbe-ba9d-cb4080b9976e None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:06.453522 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b5717f-98d6-4cbe-ba9d-cb4080b9976e None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:06.453868 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b5717f-98d6-4cbe-ba9d-cb4080b9976e None admin] PATH_INFO: `/v3/domains` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:06.454601 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b5717f-98d6-4cbe-ba9d-cb4080b9976e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:06.454917 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b5717f-98d6-4cbe-ba9d-cb4080b9976e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:06.456306 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b5717f-98d6-4cbe-ba9d-cb4080b9976e None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:06.467850 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:06.478268 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 246/495] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Jun 22 10:03:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:06.479215 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b5717f-98d6-4cbe-ba9d-cb4080b9976e None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:06.481744 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cfbdc9-b5d1-4d67-afc4-a1e556994d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:06.482580 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cfbdc9-b5d1-4d67-afc4-a1e556994d45 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:06.482871 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cfbdc9-b5d1-4d67-afc4-a1e556994d45 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:06.483157 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cfbdc9-b5d1-4d67-afc4-a1e556994d45 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:06.491375 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cfbdc9-b5d1-4d67-afc4-a1e556994d45 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:06.492830 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cfbdc9-b5d1-4d67-afc4-a1e556994d45 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:06.509113 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-a5cfbdc9-b5d1-4d67-afc4-a1e556994d45 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 22 10:03:06.509113 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:06.509113 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:06.509113 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:06.509113 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:06.509113 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:06.509113 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:06.509113 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:06.509113 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:06.509113 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:06.509113 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:06.509113 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:06.509113 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 10:03:06.509113 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 10:03:06.509113 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 10:03:06.509113 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 10:03:06.510082 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:06.510082 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:06.510082 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 10:03:06.510082 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:03:06.510082 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 10:03:06.510082 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:03:06.510082 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:06.510082 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:06.510082 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:06.510082 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:06.510082 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:06.510082 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:06.510082 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:06.510082 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:06.510082 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:06.510082 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:06.510082 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:06.510082 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:06.510971 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:06.510971 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:06.510971 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 10:03:06.510971 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 10:03:06.510971 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 10:03:06.510971 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 10:03:06.510971 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 10:03:06.510971 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 10:03:06.510971 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 22 10:03:06.510971 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:03:06.510971 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 250/496] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Jun 22 10:03:06 2022] GET /identity/v3/users/glance => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:03:06.512127 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679f1fb8-802d-40fd-b362-f971800d99b6 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:06.512127 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679f1fb8-802d-40fd-b362-f971800d99b6 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:06.512296 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679f1fb8-802d-40fd-b362-f971800d99b6 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:06.517341 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 251/497] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:03:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:03:06.517341 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679f1fb8-802d-40fd-b362-f971800d99b6 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:06.587561 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b5717f-98d6-4cbe-ba9d-cb4080b9976e None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:06.612678 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:06.621375 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679f1fb8-802d-40fd-b362-f971800d99b6 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:06.624660 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c00fc39-3a17-4ae1-a615-b249cfae77bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:06.625321 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c00fc39-3a17-4ae1-a615-b249cfae77bd None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:06.625600 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c00fc39-3a17-4ae1-a615-b249cfae77bd None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:06.625901 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c00fc39-3a17-4ae1-a615-b249cfae77bd None admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:06.626644 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c00fc39-3a17-4ae1-a615-b249cfae77bd None admin] RBAC: Adding query filter params (name=service) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:06.626948 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c00fc39-3a17-4ae1-a615-b249cfae77bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:06.628318 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c00fc39-3a17-4ae1-a615-b249cfae77bd None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:06.637093 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 247/498] 10.222.0.43 () {56 vars in 1103 bytes} [Wed Jun 22 10:03:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:06.637926 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c00fc39-3a17-4ae1-a615-b249cfae77bd None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:06.657498 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b39941-71db-4987-babf-fe25fdc72857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:06.658354 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b39941-71db-4987-babf-fe25fdc72857 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:06.658642 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b39941-71db-4987-babf-fe25fdc72857 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:06.658955 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b39941-71db-4987-babf-fe25fdc72857 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:06.666037 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b39941-71db-4987-babf-fe25fdc72857 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:06.667486 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b39941-71db-4987-babf-fe25fdc72857 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:06.681488 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-26b39941-71db-4987-babf-fe25fdc72857 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 22 10:03:06.681488 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:06.681488 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:06.681488 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:06.681488 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:06.681488 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:06.681488 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:06.681488 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:06.681488 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:06.681488 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:06.681488 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:06.681488 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:06.681488 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 10:03:06.681488 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 10:03:06.681488 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 10:03:06.681488 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 10:03:06.682385 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:06.682385 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:06.682385 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 10:03:06.682385 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:03:06.682385 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 10:03:06.682385 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:03:06.682385 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:06.682385 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:06.682385 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:06.682385 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:06.682385 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:06.682385 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:06.682385 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:06.682385 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:06.682385 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:06.682385 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:06.682385 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:06.682385 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:06.683749 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:06.683749 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:06.683749 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 10:03:06.683749 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 10:03:06.683749 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 10:03:06.683749 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 10:03:06.683749 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 10:03:06.683749 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 10:03:06.683749 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 22 10:03:06.683749 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:03:06.683749 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 252/499] 10.222.0.43 () {56 vars in 1093 bytes} [Wed Jun 22 10:03:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:03:06.684511 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70202853-f3c9-45ec-80f1-3c4fb5bab573 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:06.684511 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70202853-f3c9-45ec-80f1-3c4fb5bab573 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:06.684511 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70202853-f3c9-45ec-80f1-3c4fb5bab573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:06.700714 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-70202853-f3c9-45ec-80f1-3c4fb5bab573 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:03:06.700854 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:06.701950 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-70202853-f3c9-45ec-80f1-3c4fb5bab573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:03:06.741972 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c00fc39-3a17-4ae1-a615-b249cfae77bd None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:06.769407 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 253/500] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:03:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 10:03:06.771383 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24201a8-c433-499e-99d7-30951a9bbb6d None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:06.771769 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24201a8-c433-499e-99d7-30951a9bbb6d None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:06.772054 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24201a8-c433-499e-99d7-30951a9bbb6d None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:06.773301 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 254/501] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:03:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:03:06.774013 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24201a8-c433-499e-99d7-30951a9bbb6d None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:06.788753 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9882f145-69bb-4394-aa3e-1241622c195a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:06.789442 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9882f145-69bb-4394-aa3e-1241622c195a None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:06.789755 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9882f145-69bb-4394-aa3e-1241622c195a None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:06.790045 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9882f145-69bb-4394-aa3e-1241622c195a None admin] PATH_INFO: `/v3/users` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:06.790895 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9882f145-69bb-4394-aa3e-1241622c195a None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:06.791212 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9882f145-69bb-4394-aa3e-1241622c195a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:06.792731 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9882f145-69bb-4394-aa3e-1241622c195a None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:06.831353 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 248/502] 10.222.0.43 () {56 vars in 1137 bytes} [Wed Jun 22 10:03:06 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:06.832191 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9882f145-69bb-4394-aa3e-1241622c195a None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:06.865854 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:06.882994 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24201a8-c433-499e-99d7-30951a9bbb6d None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:06.916859 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0b509c-8043-4de9-b683-a05cf52ad57b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:06.917658 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0b509c-8043-4de9-b683-a05cf52ad57b None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:06.917976 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0b509c-8043-4de9-b683-a05cf52ad57b None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:06.918258 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0b509c-8043-4de9-b683-a05cf52ad57b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:06.928345 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0b509c-8043-4de9-b683-a05cf52ad57b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:06.929852 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0b509c-8043-4de9-b683-a05cf52ad57b None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:06.933116 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9882f145-69bb-4394-aa3e-1241622c195a None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:06.947693 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-4b0b509c-8043-4de9-b683-a05cf52ad57b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:03:06.947693 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:06.947693 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:06.947693 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:06.947693 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:06.947693 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:06.947693 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:06.947693 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:06.947693 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:06.947693 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:06.947693 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:06.947693 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:06.947693 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:03:06.947693 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:03:06.947693 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:03:06.948545 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:03:06.948545 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:06.948545 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:06.948545 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:06.948545 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:06.948545 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:06.948545 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:06.948545 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:06.948545 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:06.948545 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:06.948545 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:06.948545 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:06.948545 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:06.948545 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:06.948545 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:06.948545 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:06.948545 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:06.949381 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:03:06.949381 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:03:06.949381 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:03:06.949381 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:03:06.949381 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 255/503] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jun 22 10:03:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:03:06.950251 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6c3df8-7266-4160-9f48-badd10944fe7 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:06.950543 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6c3df8-7266-4160-9f48-badd10944fe7 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:06.950823 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6c3df8-7266-4160-9f48-badd10944fe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:06.960341 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:06.968025 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-3d6c3df8-7266-4160-9f48-badd10944fe7 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:03:06.969251 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-3d6c3df8-7266-4160-9f48-badd10944fe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:03:06.974548 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bd8e7b-5068-40b3-bdd0-1a30c2f8e0ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:06.975226 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bd8e7b-5068-40b3-bdd0-1a30c2f8e0ae None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:06.975769 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bd8e7b-5068-40b3-bdd0-1a30c2f8e0ae None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:06.976051 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bd8e7b-5068-40b3-bdd0-1a30c2f8e0ae None admin] PATH_INFO: `/v3/users` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:06.976889 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bd8e7b-5068-40b3-bdd0-1a30c2f8e0ae None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:06.977204 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bd8e7b-5068-40b3-bdd0-1a30c2f8e0ae None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:06.978679 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bd8e7b-5068-40b3-bdd0-1a30c2f8e0ae None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:06.996807 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 249/504] 10.222.0.43 () {56 vars in 1133 bytes} [Wed Jun 22 10:03:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:06.997545 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bd8e7b-5068-40b3-bdd0-1a30c2f8e0ae None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:07.039964 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 256/505] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:03:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 10:03:07.040801 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6c3df8-7266-4160-9f48-badd10944fe7 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:07.105181 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bd8e7b-5068-40b3-bdd0-1a30c2f8e0ae None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:07.113488 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:07.140886 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0674591-bf46-45f1-a6fa-417a17ddca18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:07.141682 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0674591-bf46-45f1-a6fa-417a17ddca18 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:07.141993 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0674591-bf46-45f1-a6fa-417a17ddca18 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:07.142270 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0674591-bf46-45f1-a6fa-417a17ddca18 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:07.150648 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6c3df8-7266-4160-9f48-badd10944fe7 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:07.152748 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0674591-bf46-45f1-a6fa-417a17ddca18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:03:07.160574 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-d0674591-bf46-45f1-a6fa-417a17ddca18 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 10:03:07.160574 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:07.160574 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:07.160574 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:07.160574 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:07.160574 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:07.160574 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:07.160574 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:07.160574 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:07.160574 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:07.160574 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:07.160574 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:07.160574 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:03:07.160574 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:03:07.160574 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:03:07.160574 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:03:07.161674 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:03:07.161674 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:03:07.161674 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:03:07.161674 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:03:07.161674 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:07.161674 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:07.161674 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:07.161674 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:07.161674 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:07.161674 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:07.161674 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:07.161674 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:07.161674 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:07.161674 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:07.161674 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:07.161674 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:07.162502 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:07.162502 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:07.162502 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:07.162502 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:07.162502 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:03:07.162502 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:03:07.162502 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:03:07.162502 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:03:07.162502 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:03:07.162502 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:03:07.162502 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 10:03:07.162502 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:03:07.162502 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 250/506] 10.222.0.43 () {56 vars in 1102 bytes} [Wed Jun 22 10:03:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:03:07.163189 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0674591-bf46-45f1-a6fa-417a17ddca18 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:07.190265 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aa536f-ba89-43bf-b7d3-565fdb945fdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:07.191475 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aa536f-ba89-43bf-b7d3-565fdb945fdc None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:07.191761 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aa536f-ba89-43bf-b7d3-565fdb945fdc None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:07.192039 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aa536f-ba89-43bf-b7d3-565fdb945fdc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:07.202247 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:07.262730 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52aa536f-ba89-43bf-b7d3-565fdb945fdc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:07.264143 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52aa536f-ba89-43bf-b7d3-565fdb945fdc None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:07.265077 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0674591-bf46-45f1-a6fa-417a17ddca18 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:07.300268 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882154c7-bd58-43fb-b35f-dd4b1d9866fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:07.300930 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882154c7-bd58-43fb-b35f-dd4b1d9866fa None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:07.301217 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882154c7-bd58-43fb-b35f-dd4b1d9866fa None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:07.301494 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882154c7-bd58-43fb-b35f-dd4b1d9866fa None admin] PATH_INFO: `/v3/domains` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:07.302868 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882154c7-bd58-43fb-b35f-dd4b1d9866fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:07.303184 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882154c7-bd58-43fb-b35f-dd4b1d9866fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:07.304569 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882154c7-bd58-43fb-b35f-dd4b1d9866fa None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:07.316086 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 251/507] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Jun 22 10:03:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:07.316870 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882154c7-bd58-43fb-b35f-dd4b1d9866fa None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:07.328268 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:07.363339 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 257/508] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Jun 22 10:03:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 10:03:07.364201 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aa536f-ba89-43bf-b7d3-565fdb945fdc None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:07.417968 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:07.421585 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882154c7-bd58-43fb-b35f-dd4b1d9866fa None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:07.459337 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65d43fc-0377-42f6-b351-9f806698d5f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:07.459919 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65d43fc-0377-42f6-b351-9f806698d5f1 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:07.460200 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65d43fc-0377-42f6-b351-9f806698d5f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:07.460474 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65d43fc-0377-42f6-b351-9f806698d5f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:07.477941 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aa536f-ba89-43bf-b7d3-565fdb945fdc None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:07.521860 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8119392-be78-4334-85ea-6a3776a756ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:07.522928 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8119392-be78-4334-85ea-6a3776a756ed None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:07.523346 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8119392-be78-4334-85ea-6a3776a756ed None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:07.523758 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8119392-be78-4334-85ea-6a3776a756ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:07.531199 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65d43fc-0377-42f6-b351-9f806698d5f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:07.532687 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65d43fc-0377-42f6-b351-9f806698d5f1 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:07.535976 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8119392-be78-4334-85ea-6a3776a756ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:07.537573 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8119392-be78-4334-85ea-6a3776a756ed None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:07.554958 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-f8119392-be78-4334-85ea-6a3776a756ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:03:07.554958 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:07.554958 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:07.554958 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:07.554958 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:07.554958 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:07.554958 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:07.554958 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:07.554958 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:07.554958 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:07.554958 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:07.554958 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:07.554958 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:03:07.554958 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:03:07.554958 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:03:07.555954 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:03:07.555954 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:07.555954 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:07.555954 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:07.555954 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:07.555954 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:07.555954 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:07.555954 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:07.555954 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:07.555954 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:07.555954 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:07.555954 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:07.555954 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:07.555954 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:07.555954 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:07.555954 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:07.555954 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:07.556898 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:03:07.556898 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:03:07.556898 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:03:07.556898 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:03:07.556898 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 258/509] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jun 22 10:03:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:03:07.556898 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8119392-be78-4334-85ea-6a3776a756ed None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:07.578547 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:07.631728 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:07.636216 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 252/510] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Jun 22 10:03:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 10:03:07.637168 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65d43fc-0377-42f6-b351-9f806698d5f1 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:07.663699 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8119392-be78-4334-85ea-6a3776a756ed None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:07.697248 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947df751-a5dd-4929-b7a0-4891b5d5a01f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:07.697939 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947df751-a5dd-4929-b7a0-4891b5d5a01f None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:07.698225 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947df751-a5dd-4929-b7a0-4891b5d5a01f None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:07.698513 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947df751-a5dd-4929-b7a0-4891b5d5a01f None admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:07.699255 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947df751-a5dd-4929-b7a0-4891b5d5a01f None admin] RBAC: Adding query filter params (name=service) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:07.699564 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947df751-a5dd-4929-b7a0-4891b5d5a01f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:07.700935 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947df751-a5dd-4929-b7a0-4891b5d5a01f None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:07.709844 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 259/511] 10.222.0.43 () {56 vars in 1103 bytes} [Wed Jun 22 10:03:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:07.710632 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947df751-a5dd-4929-b7a0-4891b5d5a01f None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:07.736484 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65d43fc-0377-42f6-b351-9f806698d5f1 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:07.771956 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2601c04-5379-4d38-a363-587091147710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:07.773019 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2601c04-5379-4d38-a363-587091147710 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:07.773300 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2601c04-5379-4d38-a363-587091147710 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:07.773578 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2601c04-5379-4d38-a363-587091147710 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:07.781002 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2601c04-5379-4d38-a363-587091147710 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:07.782508 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2601c04-5379-4d38-a363-587091147710 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:07.794517 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:07.799157 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-f2601c04-5379-4d38-a363-587091147710 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 22 10:03:07.799157 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:07.799157 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:07.799157 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:07.799157 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:07.799157 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:07.799157 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:07.799157 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:07.799157 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:07.799157 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:07.799157 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:07.799157 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:07.799157 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 10:03:07.799157 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 10:03:07.799157 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 10:03:07.799157 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 10:03:07.800237 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:07.800237 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:07.800237 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 10:03:07.800237 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:03:07.800237 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 10:03:07.800237 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:03:07.800237 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:07.800237 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:07.800237 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:07.800237 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:07.800237 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:07.800237 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:07.800237 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:07.800237 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:07.800237 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:07.800237 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:07.800237 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:07.800237 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:07.801162 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:07.801162 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:07.801162 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 10:03:07.801162 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 10:03:07.801162 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 10:03:07.801162 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 10:03:07.801162 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 10:03:07.801162 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 10:03:07.801162 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 22 10:03:07.801162 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:03:07.801162 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 253/512] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Jun 22 10:03:07 2022] GET /identity/v3/users/cinder => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:03:07.801162 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2601c04-5379-4d38-a363-587091147710 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:07.819763 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947df751-a5dd-4929-b7a0-4891b5d5a01f None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:07.855719 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d38c25b-814d-4c87-8b64-d6f8357a5918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:07.856507 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d38c25b-814d-4c87-8b64-d6f8357a5918 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:07.856793 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d38c25b-814d-4c87-8b64-d6f8357a5918 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:07.857068 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d38c25b-814d-4c87-8b64-d6f8357a5918 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:07.868249 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d38c25b-814d-4c87-8b64-d6f8357a5918 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:07.869698 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d38c25b-814d-4c87-8b64-d6f8357a5918 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:07.869971 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:07.887674 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-0d38c25b-814d-4c87-8b64-d6f8357a5918 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:03:07.887674 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:07.887674 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:07.887674 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:07.887674 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:07.887674 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:07.887674 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:07.887674 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:07.887674 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:07.887674 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:07.887674 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:07.887674 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:07.887674 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:03:07.887674 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:03:07.887674 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:03:07.888711 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:03:07.888711 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:07.888711 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:07.888711 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:07.888711 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:07.888711 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:07.888711 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:07.888711 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:07.888711 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:07.888711 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:07.888711 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:07.888711 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:07.888711 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:07.888711 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:07.888711 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:07.888711 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:07.888711 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:07.890122 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:03:07.890122 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:03:07.890122 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:03:07.890122 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:03:07.890122 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 260/513] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jun 22 10:03:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:03:07.890122 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d38c25b-814d-4c87-8b64-d6f8357a5918 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:07.913870 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2601c04-5379-4d38-a363-587091147710 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:07.947968 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232111a0-60a8-44c4-8d74-c61d3b826765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:07.948637 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232111a0-60a8-44c4-8d74-c61d3b826765 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:07.948924 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232111a0-60a8-44c4-8d74-c61d3b826765 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:07.949207 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232111a0-60a8-44c4-8d74-c61d3b826765 None admin] PATH_INFO: `/v3/domains` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:07.949957 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232111a0-60a8-44c4-8d74-c61d3b826765 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:07.950269 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232111a0-60a8-44c4-8d74-c61d3b826765 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:07.951675 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232111a0-60a8-44c4-8d74-c61d3b826765 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:07.962782 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 254/514] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Jun 22 10:03:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:07.963870 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232111a0-60a8-44c4-8d74-c61d3b826765 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:07.992377 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d38c25b-814d-4c87-8b64-d6f8357a5918 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:08.025579 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dba5aeb-5802-434d-bc6b-58dcb486fbb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:08.026316 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dba5aeb-5802-434d-bc6b-58dcb486fbb0 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:08.026599 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dba5aeb-5802-434d-bc6b-58dcb486fbb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:08.026875 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dba5aeb-5802-434d-bc6b-58dcb486fbb0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:08.028748 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:08.038456 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dba5aeb-5802-434d-bc6b-58dcb486fbb0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:08.040337 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dba5aeb-5802-434d-bc6b-58dcb486fbb0 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:08.057929 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-6dba5aeb-5802-434d-bc6b-58dcb486fbb0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:03:08.057929 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:08.057929 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:08.057929 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:08.057929 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:08.057929 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:08.057929 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:08.057929 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:08.057929 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:08.057929 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:08.057929 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:08.057929 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:08.057929 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:03:08.057929 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:03:08.057929 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:03:08.058934 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:03:08.058934 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:08.058934 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:08.058934 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:08.058934 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:08.058934 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:08.058934 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:08.058934 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:08.058934 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:08.058934 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:08.058934 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:08.058934 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:08.058934 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:08.058934 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:08.058934 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:08.058934 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:08.058934 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:08.059972 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:03:08.059972 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:03:08.059972 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:03:08.059972 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:03:08.059972 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 261/515] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jun 22 10:03:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:03:08.060308 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dba5aeb-5802-434d-bc6b-58dcb486fbb0 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:08.067345 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232111a0-60a8-44c4-8d74-c61d3b826765 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:08.084735 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:08.102987 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a194b3a9-f68e-4f01-b114-43d8f3e27c26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:08.104238 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a194b3a9-f68e-4f01-b114-43d8f3e27c26 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:08.104238 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a194b3a9-f68e-4f01-b114-43d8f3e27c26 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:08.104396 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a194b3a9-f68e-4f01-b114-43d8f3e27c26 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:08.116214 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a194b3a9-f68e-4f01-b114-43d8f3e27c26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:08.117705 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a194b3a9-f68e-4f01-b114-43d8f3e27c26 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:08.135864 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-a194b3a9-f68e-4f01-b114-43d8f3e27c26 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:03:08.135864 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:08.135864 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:08.135864 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:08.135864 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:08.135864 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:08.135864 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:08.135864 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:08.135864 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:08.135864 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:08.135864 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:08.135864 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:08.135864 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:03:08.135864 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:03:08.135864 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:03:08.136747 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:03:08.136747 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:08.136747 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:08.136747 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:08.136747 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:08.136747 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:08.136747 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:08.136747 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:08.136747 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:08.136747 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:08.136747 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:08.136747 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:08.136747 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:08.136747 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:08.136747 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:08.136747 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:08.136747 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:08.137587 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:03:08.137587 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:03:08.137587 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:03:08.137587 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:03:08.137587 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 255/516] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jun 22 10:03:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:03:08.137868 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a194b3a9-f68e-4f01-b114-43d8f3e27c26 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:08.163308 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dba5aeb-5802-434d-bc6b-58dcb486fbb0 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:08.197551 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d761e99-5422-419e-b58c-d243496e3935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:08.198258 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d761e99-5422-419e-b58c-d243496e3935 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:08.198545 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d761e99-5422-419e-b58c-d243496e3935 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:08.198826 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d761e99-5422-419e-b58c-d243496e3935 None admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:08.199670 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d761e99-5422-419e-b58c-d243496e3935 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:08.199985 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d761e99-5422-419e-b58c-d243496e3935 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:08.201426 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d761e99-5422-419e-b58c-d243496e3935 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:08.239077 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 262/517] 10.222.0.43 () {56 vars in 1137 bytes} [Wed Jun 22 10:03:08 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:08.240179 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d761e99-5422-419e-b58c-d243496e3935 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:08.240662 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a194b3a9-f68e-4f01-b114-43d8f3e27c26 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:08.276771 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b4cfcd-1283-4a01-a6fc-d4e8549fcfc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:08.277373 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b4cfcd-1283-4a01-a6fc-d4e8549fcfc6 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:08.277635 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b4cfcd-1283-4a01-a6fc-d4e8549fcfc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:08.277945 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b4cfcd-1283-4a01-a6fc-d4e8549fcfc6 None admin] PATH_INFO: `/v3/domains` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:08.278672 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b4cfcd-1283-4a01-a6fc-d4e8549fcfc6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:08.278983 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b4cfcd-1283-4a01-a6fc-d4e8549fcfc6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:08.280382 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b4cfcd-1283-4a01-a6fc-d4e8549fcfc6 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:08.286568 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:08.292241 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 256/518] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Jun 22 10:03:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:08.293077 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b4cfcd-1283-4a01-a6fc-d4e8549fcfc6 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:08.323104 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:08.345330 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d761e99-5422-419e-b58c-d243496e3935 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:08.379057 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8141f42b-600b-4f70-8bd7-80750b7a4dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:08.380273 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8141f42b-600b-4f70-8bd7-80750b7a4dd8 None admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:08.380732 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8141f42b-600b-4f70-8bd7-80750b7a4dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:08.381010 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8141f42b-600b-4f70-8bd7-80750b7a4dd8 None admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:08.381739 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8141f42b-600b-4f70-8bd7-80750b7a4dd8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:08.383174 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8141f42b-600b-4f70-8bd7-80750b7a4dd8 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:08.393473 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b4cfcd-1283-4a01-a6fc-d4e8549fcfc6 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:08.403517 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 263/519] 10.222.0.43 () {60 vars in 1132 bytes} [Wed Jun 22 10:03:08 2022] POST /identity/v3/users => generated 247 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:03:08.404323 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8141f42b-600b-4f70-8bd7-80750b7a4dd8 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:08.437439 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad57620-0ccc-4f22-bb33-a5c2afa06cd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:08.438157 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad57620-0ccc-4f22-bb33-a5c2afa06cd9 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:08.438449 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad57620-0ccc-4f22-bb33-a5c2afa06cd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:08.438730 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad57620-0ccc-4f22-bb33-a5c2afa06cd9 None admin] PATH_INFO: `/v3/domains` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:08.439479 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad57620-0ccc-4f22-bb33-a5c2afa06cd9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:08.439788 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad57620-0ccc-4f22-bb33-a5c2afa06cd9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:08.441244 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad57620-0ccc-4f22-bb33-a5c2afa06cd9 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:08.454662 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 257/520] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Jun 22 10:03:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:08.455347 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad57620-0ccc-4f22-bb33-a5c2afa06cd9 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:08.534253 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:08.538874 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8141f42b-600b-4f70-8bd7-80750b7a4dd8 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:08.562745 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:08.574640 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad57620-0ccc-4f22-bb33-a5c2afa06cd9 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:08.588832 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05451d0a-4608-4589-a3e4-107f2008ef34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:08.589516 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05451d0a-4608-4589-a3e4-107f2008ef34 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:08.589861 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05451d0a-4608-4589-a3e4-107f2008ef34 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:08.590151 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05451d0a-4608-4589-a3e4-107f2008ef34 None admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:08.590898 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05451d0a-4608-4589-a3e4-107f2008ef34 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:08.591210 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05451d0a-4608-4589-a3e4-107f2008ef34 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:08.595441 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05451d0a-4608-4589-a3e4-107f2008ef34 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:08.605430 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 264/521] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Jun 22 10:03:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:08.606324 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05451d0a-4608-4589-a3e4-107f2008ef34 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:08.617486 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87417555-8720-4159-8394-27befc9137f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:08.618218 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87417555-8720-4159-8394-27befc9137f9 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:08.618516 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87417555-8720-4159-8394-27befc9137f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:08.618796 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87417555-8720-4159-8394-27befc9137f9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:08.700319 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87417555-8720-4159-8394-27befc9137f9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:08.701821 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87417555-8720-4159-8394-27befc9137f9 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:08.717896 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05451d0a-4608-4589-a3e4-107f2008ef34 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:08.754844 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bad4c83-b0f6-4cc2-90f2-d2d168a9362b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:08.756171 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bad4c83-b0f6-4cc2-90f2-d2d168a9362b None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:08.756452 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bad4c83-b0f6-4cc2-90f2-d2d168a9362b None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:08.756734 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bad4c83-b0f6-4cc2-90f2-d2d168a9362b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:08.763668 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bad4c83-b0f6-4cc2-90f2-d2d168a9362b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:08.765123 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bad4c83-b0f6-4cc2-90f2-d2d168a9362b None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:08.780224 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-1bad4c83-b0f6-4cc2-90f2-d2d168a9362b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:03:08.780224 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:08.780224 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:08.780224 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:08.780224 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:08.780224 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:08.780224 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:08.780224 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:08.780224 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:08.780224 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:08.780224 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:08.780224 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:08.780224 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 10:03:08.780224 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 10:03:08.780224 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 10:03:08.781129 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 10:03:08.781129 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:08.781129 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:08.781129 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:08.781129 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:08.781129 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:08.781129 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:08.781129 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:08.781129 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:08.781129 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:08.781129 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:08.781129 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:08.781129 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:08.781129 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:08.781129 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:08.781129 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:08.781129 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:08.782004 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 10:03:08.782004 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 10:03:08.782004 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 10:03:08.782004 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 10:03:08.782004 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 10:03:08.782004 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 10:03:08.782004 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:03:08.782004 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:03:08.782004 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 265/522] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Jun 22 10:03:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:03:08.782472 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bad4c83-b0f6-4cc2-90f2-d2d168a9362b None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:08.806814 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:08.813575 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:08.819150 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 258/523] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Jun 22 10:03:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 10:03:08.819856 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87417555-8720-4159-8394-27befc9137f9 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:08.910380 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bad4c83-b0f6-4cc2-90f2-d2d168a9362b None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:08.940415 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87417555-8720-4159-8394-27befc9137f9 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:08.948132 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4bb09e-91e6-4de1-a9ce-e9b0b1343f60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:08.948935 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4bb09e-91e6-4de1-a9ce-e9b0b1343f60 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:08.949225 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4bb09e-91e6-4de1-a9ce-e9b0b1343f60 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:08.949509 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4bb09e-91e6-4de1-a9ce-e9b0b1343f60 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:08.956563 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4bb09e-91e6-4de1-a9ce-e9b0b1343f60 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:08.958101 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4bb09e-91e6-4de1-a9ce-e9b0b1343f60 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:08.975217 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-7f4bb09e-91e6-4de1-a9ce-e9b0b1343f60 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:03:08.975217 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:08.975217 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:08.975217 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:08.975217 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:08.975217 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:08.975217 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:08.975217 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:08.975217 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:08.975217 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:08.975217 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:08.975217 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:08.975217 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 10:03:08.975217 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 10:03:08.975217 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 10:03:08.976347 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 10:03:08.976347 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:08.976347 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:08.976347 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:08.976347 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:08.976347 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:08.976347 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:08.976347 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:08.976347 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:08.976347 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:08.976347 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:08.976347 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:08.976347 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:08.976347 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:08.976347 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:08.976347 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:08.976347 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:08.977324 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 10:03:08.977324 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 10:03:08.977324 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 10:03:08.977324 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 10:03:08.977324 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 10:03:08.977324 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 10:03:08.977324 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:03:08.977324 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:03:08.977324 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 266/524] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Jun 22 10:03:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:03:08.978428 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4bb09e-91e6-4de1-a9ce-e9b0b1343f60 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:08.980475 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945487e6-f2b8-4f83-a6a1-24dacc5e00b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:08.981289 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945487e6-f2b8-4f83-a6a1-24dacc5e00b1 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:08.981883 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945487e6-f2b8-4f83-a6a1-24dacc5e00b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:08.982170 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945487e6-f2b8-4f83-a6a1-24dacc5e00b1 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:08.992137 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945487e6-f2b8-4f83-a6a1-24dacc5e00b1 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:08.994238 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945487e6-f2b8-4f83-a6a1-24dacc5e00b1 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:09.010429 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-945487e6-f2b8-4f83-a6a1-24dacc5e00b1 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 22 10:03:09.010429 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:09.010429 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:09.010429 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:09.010429 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:09.010429 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:09.010429 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:09.010429 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:09.010429 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:09.010429 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:09.010429 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:09.010429 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:09.010429 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 10:03:09.010429 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 10:03:09.010429 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 10:03:09.010429 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 10:03:09.011339 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:09.011339 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:09.011339 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 10:03:09.011339 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:03:09.011339 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 10:03:09.011339 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:03:09.011339 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:09.011339 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:09.011339 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:09.011339 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:09.011339 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:09.011339 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:09.011339 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:09.011339 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:09.011339 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:09.011339 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:09.011339 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:09.011339 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:09.017387 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:09.017387 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:09.017387 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 10:03:09.017387 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 10:03:09.017387 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 10:03:09.017387 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 10:03:09.017387 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 10:03:09.017387 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 10:03:09.017387 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 22 10:03:09.017387 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:03:09.017387 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 259/525] 10.222.0.43 () {56 vars in 1102 bytes} [Wed Jun 22 10:03:08 2022] GET /identity/v3/users/neutron => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:03:09.017387 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945487e6-f2b8-4f83-a6a1-24dacc5e00b1 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:09.068888 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:09.078508 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:09.102072 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4bb09e-91e6-4de1-a9ce-e9b0b1343f60 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:09.128087 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945487e6-f2b8-4f83-a6a1-24dacc5e00b1 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:09.138964 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7e1c70-2887-42a9-bbb5-a5c3b363854a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:09.139870 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7e1c70-2887-42a9-bbb5-a5c3b363854a None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:09.139990 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7e1c70-2887-42a9-bbb5-a5c3b363854a None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:09.140179 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7e1c70-2887-42a9-bbb5-a5c3b363854a None admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:09.140972 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7e1c70-2887-42a9-bbb5-a5c3b363854a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:09.141290 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7e1c70-2887-42a9-bbb5-a5c3b363854a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:09.142781 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7e1c70-2887-42a9-bbb5-a5c3b363854a None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:09.161962 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 267/526] 10.222.0.43 () {56 vars in 1148 bytes} [Wed Jun 22 10:03:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:09.162873 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7e1c70-2887-42a9-bbb5-a5c3b363854a None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:09.169872 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f88264-5b51-4e86-a1b4-1cabfc775052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:09.170916 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f88264-5b51-4e86-a1b4-1cabfc775052 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:09.171051 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f88264-5b51-4e86-a1b4-1cabfc775052 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:09.171304 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f88264-5b51-4e86-a1b4-1cabfc775052 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:09.182824 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f88264-5b51-4e86-a1b4-1cabfc775052 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:09.185426 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f88264-5b51-4e86-a1b4-1cabfc775052 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:09.207657 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-78f88264-5b51-4e86-a1b4-1cabfc775052 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:03:09.207657 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:09.207657 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:09.207657 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:09.207657 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:09.207657 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:09.207657 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:09.207657 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:09.207657 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:09.207657 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:09.207657 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:09.207657 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:09.207657 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:03:09.207657 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:03:09.207657 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:03:09.209435 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:03:09.209435 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:09.209435 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:09.209435 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:09.209435 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:09.209435 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:09.209435 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:09.209435 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:09.209435 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:09.209435 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:09.209435 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:09.209435 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:09.209435 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:09.209435 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:09.209435 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:09.209435 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:09.209435 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:09.210331 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:03:09.210331 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:03:09.210331 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:03:09.210331 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:03:09.213652 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 260/527] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jun 22 10:03:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:03:09.213652 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f88264-5b51-4e86-a1b4-1cabfc775052 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:09.289544 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7e1c70-2887-42a9-bbb5-a5c3b363854a None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:09.327188 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c79dec-5ad9-4c95-b155-d43def3d944f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:09.327776 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c79dec-5ad9-4c95-b155-d43def3d944f None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:09.328062 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c79dec-5ad9-4c95-b155-d43def3d944f None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:09.328339 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c79dec-5ad9-4c95-b155-d43def3d944f None admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:09.329119 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c79dec-5ad9-4c95-b155-d43def3d944f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:09.329431 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c79dec-5ad9-4c95-b155-d43def3d944f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:09.330895 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c79dec-5ad9-4c95-b155-d43def3d944f None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:09.331379 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f88264-5b51-4e86-a1b4-1cabfc775052 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:09.335495 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:09.340424 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:09.349430 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 268/528] 10.222.0.43 () {56 vars in 1148 bytes} [Wed Jun 22 10:03:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:09.350850 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c79dec-5ad9-4c95-b155-d43def3d944f None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:09.378158 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3c70c2-b210-44f3-8eaf-0adeb29a6525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:09.378742 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3c70c2-b210-44f3-8eaf-0adeb29a6525 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:09.379030 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3c70c2-b210-44f3-8eaf-0adeb29a6525 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:09.379313 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3c70c2-b210-44f3-8eaf-0adeb29a6525 None admin] PATH_INFO: `/v3/users` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:09.380907 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3c70c2-b210-44f3-8eaf-0adeb29a6525 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:09.381224 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3c70c2-b210-44f3-8eaf-0adeb29a6525 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:09.382721 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3c70c2-b210-44f3-8eaf-0adeb29a6525 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:09.404753 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 261/529] 10.222.0.43 () {56 vars in 1139 bytes} [Wed Jun 22 10:03:09 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:09.404753 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3c70c2-b210-44f3-8eaf-0adeb29a6525 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:09.462644 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c79dec-5ad9-4c95-b155-d43def3d944f None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:09.499235 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d8928f-0f63-4cf7-9002-ba39288e344f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:09.499900 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d8928f-0f63-4cf7-9002-ba39288e344f None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:09.500189 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d8928f-0f63-4cf7-9002-ba39288e344f None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:09.500469 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d8928f-0f63-4cf7-9002-ba39288e344f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:09.501515 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d8928f-0f63-4cf7-9002-ba39288e344f None admin] RBAC: Adding query filter params (role.id=18493ce78e7c480c9202245b6d93cb4c, scope.project.id=e03f1c17e0884f188231d2949dc6f956, user.id=a2418acec46b4db48346129004827853) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:09.501623 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d8928f-0f63-4cf7-9002-ba39288e344f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:09.503092 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d8928f-0f63-4cf7-9002-ba39288e344f None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:09.517738 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 269/530] 10.222.0.43 () {56 vars in 1374 bytes} [Wed Jun 22 10:03:09 2022] GET /identity/v3/role_assignments?user.id=a2418acec46b4db48346129004827853&scope.project.id=e03f1c17e0884f188231d2949dc6f956&role.id=18493ce78e7c480c9202245b6d93cb4c => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:09.517738 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d8928f-0f63-4cf7-9002-ba39288e344f None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:09.518043 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3c70c2-b210-44f3-8eaf-0adeb29a6525 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:09.559388 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c6e1e5-848c-432f-8296-be102e139a71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:09.560085 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c6e1e5-848c-432f-8296-be102e139a71 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:09.560375 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c6e1e5-848c-432f-8296-be102e139a71 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:09.560720 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c6e1e5-848c-432f-8296-be102e139a71 None admin] PATH_INFO: `/v3/domains` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:09.561487 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c6e1e5-848c-432f-8296-be102e139a71 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:09.561832 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c6e1e5-848c-432f-8296-be102e139a71 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:09.563737 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c6e1e5-848c-432f-8296-be102e139a71 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:09.583945 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 262/531] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Jun 22 10:03:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:09.584895 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c6e1e5-848c-432f-8296-be102e139a71 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:09.610875 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:09.646145 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:09.689970 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d8928f-0f63-4cf7-9002-ba39288e344f None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:09.705333 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c6e1e5-848c-432f-8296-be102e139a71 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:09.727169 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0368a0-2cc4-46b1-81ab-f893a6be63b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:09.727837 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0368a0-2cc4-46b1-81ab-f893a6be63b1 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:09.728124 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0368a0-2cc4-46b1-81ab-f893a6be63b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:09.728405 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0368a0-2cc4-46b1-81ab-f893a6be63b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:09.729252 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0368a0-2cc4-46b1-81ab-f893a6be63b1 None admin] RBAC: Adding query filter params (role.id=18493ce78e7c480c9202245b6d93cb4c, scope.project.id=e03f1c17e0884f188231d2949dc6f956, user.id=158a49aa3750478a84bf71b9aad24397) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:09.729570 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0368a0-2cc4-46b1-81ab-f893a6be63b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:09.731054 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0368a0-2cc4-46b1-81ab-f893a6be63b1 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:09.737067 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 270/532] 10.222.0.43 () {56 vars in 1374 bytes} [Wed Jun 22 10:03:09 2022] GET /identity/v3/role_assignments?user.id=158a49aa3750478a84bf71b9aad24397&scope.project.id=e03f1c17e0884f188231d2949dc6f956&role.id=18493ce78e7c480c9202245b6d93cb4c => generated 259 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:09.737885 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0368a0-2cc4-46b1-81ab-f893a6be63b1 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:09.763526 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3e52c3-4822-40c0-b78a-da4b5835e3c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:09.764203 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3e52c3-4822-40c0-b78a-da4b5835e3c3 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:09.764493 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3e52c3-4822-40c0-b78a-da4b5835e3c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:09.764779 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3e52c3-4822-40c0-b78a-da4b5835e3c3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:09.854554 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0368a0-2cc4-46b1-81ab-f893a6be63b1 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:09.884099 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:09.892283 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe78470-4c19-4125-9a06-2fe02585f1d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:09.893178 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe78470-4c19-4125-9a06-2fe02585f1d2 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:09.893682 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe78470-4c19-4125-9a06-2fe02585f1d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:09.894065 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe78470-4c19-4125-9a06-2fe02585f1d2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:09.902739 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe78470-4c19-4125-9a06-2fe02585f1d2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:09.904319 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe78470-4c19-4125-9a06-2fe02585f1d2 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:09.922788 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-fbe78470-4c19-4125-9a06-2fe02585f1d2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:03:09.922788 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:09.922788 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:09.922788 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:09.922788 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:09.922788 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:09.922788 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:09.922788 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:09.922788 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:09.922788 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:09.922788 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:09.922788 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:09.922788 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 10:03:09.922788 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 10:03:09.922788 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 10:03:09.923683 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 10:03:09.923683 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:09.923683 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:09.923683 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:09.923683 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:09.923683 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:09.923683 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:09.923683 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:09.923683 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:09.923683 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:09.923683 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:09.923683 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:09.923683 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:09.923683 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:09.923683 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:09.923683 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:09.923683 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:09.924495 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 10:03:09.924495 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 10:03:09.924495 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 10:03:09.924495 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 10:03:09.924495 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 10:03:09.924495 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 10:03:09.924495 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:03:09.924495 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:03:09.924495 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 271/533] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Jun 22 10:03:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:03:09.929766 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe78470-4c19-4125-9a06-2fe02585f1d2 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:09.931030 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3e52c3-4822-40c0-b78a-da4b5835e3c3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:09.932546 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3e52c3-4822-40c0-b78a-da4b5835e3c3 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:09.979953 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:10.058641 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe78470-4c19-4125-9a06-2fe02585f1d2 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:10.081812 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 263/534] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Jun 22 10:03:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 10:03:10.084691 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3e52c3-4822-40c0-b78a-da4b5835e3c3 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:10.111233 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdf6ee3-f2f4-4691-b579-07c1dfb90f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:10.112040 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdf6ee3-f2f4-4691-b579-07c1dfb90f64 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:10.112327 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdf6ee3-f2f4-4691-b579-07c1dfb90f64 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:10.112610 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdf6ee3-f2f4-4691-b579-07c1dfb90f64 None admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:10.113424 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdf6ee3-f2f4-4691-b579-07c1dfb90f64 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:10.113784 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdf6ee3-f2f4-4691-b579-07c1dfb90f64 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:10.116474 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdf6ee3-f2f4-4691-b579-07c1dfb90f64 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:10.143622 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 272/535] 10.222.0.43 () {56 vars in 1148 bytes} [Wed Jun 22 10:03:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:03:10.150712 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdf6ee3-f2f4-4691-b579-07c1dfb90f64 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:10.201830 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3e52c3-4822-40c0-b78a-da4b5835e3c3 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:10.224527 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:10.238320 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:10.242753 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab4e882-dd58-4cfa-b304-df70dedc5f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:10.243665 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab4e882-dd58-4cfa-b304-df70dedc5f61 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:10.244026 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab4e882-dd58-4cfa-b304-df70dedc5f61 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:10.244379 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab4e882-dd58-4cfa-b304-df70dedc5f61 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:10.258640 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab4e882-dd58-4cfa-b304-df70dedc5f61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:10.260421 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab4e882-dd58-4cfa-b304-df70dedc5f61 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:10.288664 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-aab4e882-dd58-4cfa-b304-df70dedc5f61 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:03:10.288664 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:10.288664 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:10.288664 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:10.288664 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:10.288664 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:10.288664 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:10.288664 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:10.288664 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:10.288664 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:10.288664 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:10.288664 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:10.288664 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:03:10.288664 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:03:10.288664 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:03:10.289576 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:03:10.289576 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:10.289576 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:10.289576 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:10.289576 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:10.289576 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:10.289576 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:10.289576 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:10.289576 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:10.289576 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:10.289576 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:10.289576 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:10.289576 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:10.289576 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:10.289576 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:10.289576 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:10.289576 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:10.290440 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:03:10.290440 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:03:10.290440 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:03:10.290440 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:03:10.299115 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 264/536] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jun 22 10:03:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:03:10.306813 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab4e882-dd58-4cfa-b304-df70dedc5f61 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:10.342552 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdf6ee3-f2f4-4691-b579-07c1dfb90f64 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:10.411709 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ed66e0-cb9e-4f08-8d9b-2ae4fdf45889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:10.412806 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ed66e0-cb9e-4f08-8d9b-2ae4fdf45889 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:10.413326 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ed66e0-cb9e-4f08-8d9b-2ae4fdf45889 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:10.414476 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ed66e0-cb9e-4f08-8d9b-2ae4fdf45889 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:10.415604 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ed66e0-cb9e-4f08-8d9b-2ae4fdf45889 None admin] RBAC: Adding query filter params (role.id=18493ce78e7c480c9202245b6d93cb4c, scope.project.id=e03f1c17e0884f188231d2949dc6f956, user.id=9bbcb3d4dc704dfdb0097abc594ca855) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:10.416723 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ed66e0-cb9e-4f08-8d9b-2ae4fdf45889 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:10.418612 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ed66e0-cb9e-4f08-8d9b-2ae4fdf45889 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:10.430421 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 273/537] 10.222.0.43 () {56 vars in 1374 bytes} [Wed Jun 22 10:03:10 2022] GET /identity/v3/role_assignments?user.id=9bbcb3d4dc704dfdb0097abc594ca855&scope.project.id=e03f1c17e0884f188231d2949dc6f956&role.id=18493ce78e7c480c9202245b6d93cb4c => generated 259 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:10.491572 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab4e882-dd58-4cfa-b304-df70dedc5f61 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:10.512317 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fd4aa0-2723-4951-81a7-ed2406af961d None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:10.512606 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fd4aa0-2723-4951-81a7-ed2406af961d None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:10.512889 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fd4aa0-2723-4951-81a7-ed2406af961d None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:10.514716 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 274/538] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:03:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:03:10.519837 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81962c2-2469-4c00-99c4-8bec29ff0780 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:10.520124 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81962c2-2469-4c00-99c4-8bec29ff0780 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:10.520461 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81962c2-2469-4c00-99c4-8bec29ff0780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:10.530922 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10703b7-ba1f-49f9-896b-6dc784462ad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:10.531601 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10703b7-ba1f-49f9-896b-6dc784462ad7 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:10.531897 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10703b7-ba1f-49f9-896b-6dc784462ad7 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:10.532182 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10703b7-ba1f-49f9-896b-6dc784462ad7 None admin] PATH_INFO: `/v3/domains` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:10.533554 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10703b7-ba1f-49f9-896b-6dc784462ad7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:10.534064 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10703b7-ba1f-49f9-896b-6dc784462ad7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:10.535637 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10703b7-ba1f-49f9-896b-6dc784462ad7 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:10.538806 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-e81962c2-2469-4c00-99c4-8bec29ff0780 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:03:10.540023 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-e81962c2-2469-4c00-99c4-8bec29ff0780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:03:10.552732 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 265/539] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Jun 22 10:03:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:10.562543 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10703b7-ba1f-49f9-896b-6dc784462ad7 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:10.631523 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:10.686005 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 275/540] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:03:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 10:03:10.716087 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81962c2-2469-4c00-99c4-8bec29ff0780 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:10.764869 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10703b7-ba1f-49f9-896b-6dc784462ad7 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:10.800991 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:10.832197 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fed70d-bb9b-405b-ab7a-b36926caa8d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:10.833860 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fed70d-bb9b-405b-ab7a-b36926caa8d5 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:10.834354 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fed70d-bb9b-405b-ab7a-b36926caa8d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:10.834657 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fed70d-bb9b-405b-ab7a-b36926caa8d5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:10.841999 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fed70d-bb9b-405b-ab7a-b36926caa8d5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:10.843457 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fed70d-bb9b-405b-ab7a-b36926caa8d5 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:10.860413 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-37fed70d-bb9b-405b-ab7a-b36926caa8d5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:03:10.860413 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:10.860413 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:10.860413 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:10.860413 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:10.860413 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:10.860413 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:10.860413 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:10.860413 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:10.860413 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:10.860413 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:10.860413 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:10.860413 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 10:03:10.860413 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 10:03:10.860413 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 10:03:10.861329 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 10:03:10.861329 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:10.861329 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:10.861329 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:10.861329 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:10.861329 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:10.861329 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:10.861329 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:10.861329 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:10.861329 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:10.861329 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:10.861329 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:10.861329 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:10.861329 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:10.861329 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:10.861329 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:10.861329 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:10.862194 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 10:03:10.862194 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 10:03:10.862194 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 10:03:10.862194 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 10:03:10.862194 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 10:03:10.862194 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 10:03:10.862194 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:03:10.862194 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:03:10.862194 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 266/541] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Jun 22 10:03:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:03:10.874673 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fed70d-bb9b-405b-ab7a-b36926caa8d5 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:10.897922 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81962c2-2469-4c00-99c4-8bec29ff0780 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:10.940690 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27d1bda-6272-426d-9c49-9a20be0a4833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:10.941437 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27d1bda-6272-426d-9c49-9a20be0a4833 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:10.941748 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27d1bda-6272-426d-9c49-9a20be0a4833 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:10.942241 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27d1bda-6272-426d-9c49-9a20be0a4833 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:10.954987 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27d1bda-6272-426d-9c49-9a20be0a4833 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:03:10.973243 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-e27d1bda-6272-426d-9c49-9a20be0a4833 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 10:03:10.973243 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:10.973243 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:10.973243 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:10.973243 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:10.973243 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:10.973243 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:10.973243 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:10.973243 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:10.973243 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:10.973243 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:10.973243 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:10.973243 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:03:10.973243 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:03:10.973243 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:03:10.973243 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:03:10.974815 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:03:10.974815 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:03:10.974815 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:03:10.974815 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:03:10.974815 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:10.974815 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:10.974815 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:10.974815 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:10.974815 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:10.974815 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:10.974815 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:10.974815 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:10.974815 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:10.974815 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:10.974815 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:10.974815 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:10.975869 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:10.975869 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:10.975869 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:10.975869 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:10.975869 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:03:10.975869 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:03:10.975869 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:03:10.975869 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:03:10.975869 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:03:10.975869 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:03:10.975869 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 10:03:10.975869 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:03:10.976471 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 276/542] 10.222.0.43 () {56 vars in 1102 bytes} [Wed Jun 22 10:03:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 10:03:10.981499 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27d1bda-6272-426d-9c49-9a20be0a4833 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:11.110120 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27d1bda-6272-426d-9c49-9a20be0a4833 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:11.110626 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:11.146417 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dbb619-9b7a-4e1e-beff-3f2dcf90edaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:11.147122 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dbb619-9b7a-4e1e-beff-3f2dcf90edaa None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:11.147411 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dbb619-9b7a-4e1e-beff-3f2dcf90edaa None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:11.147683 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dbb619-9b7a-4e1e-beff-3f2dcf90edaa None admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:11.148546 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dbb619-9b7a-4e1e-beff-3f2dcf90edaa None admin] RBAC: Adding query filter params (name=service) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:11.148859 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dbb619-9b7a-4e1e-beff-3f2dcf90edaa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:11.150280 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dbb619-9b7a-4e1e-beff-3f2dcf90edaa None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:11.158961 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:11.164845 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 277/543] 10.222.0.43 () {56 vars in 1103 bytes} [Wed Jun 22 10:03:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:11.166165 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dbb619-9b7a-4e1e-beff-3f2dcf90edaa None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:11.171175 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fed70d-bb9b-405b-ab7a-b36926caa8d5 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:11.268959 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dbb619-9b7a-4e1e-beff-3f2dcf90edaa None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:11.305567 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4ea6ea-0c19-4dd7-9ce6-ba115eaf6344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:11.306555 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4ea6ea-0c19-4dd7-9ce6-ba115eaf6344 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:11.306897 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4ea6ea-0c19-4dd7-9ce6-ba115eaf6344 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:11.307244 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4ea6ea-0c19-4dd7-9ce6-ba115eaf6344 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:11.308583 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7866962c-d2e0-42f1-bce2-9025f776f47e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:11.309472 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7866962c-d2e0-42f1-bce2-9025f776f47e None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:11.310023 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7866962c-d2e0-42f1-bce2-9025f776f47e None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:11.317715 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7866962c-d2e0-42f1-bce2-9025f776f47e None admin] PATH_INFO: `/v3/projects` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:11.318889 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7866962c-d2e0-42f1-bce2-9025f776f47e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:11.319564 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7866962c-d2e0-42f1-bce2-9025f776f47e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:11.319932 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4ea6ea-0c19-4dd7-9ce6-ba115eaf6344 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:11.321399 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4ea6ea-0c19-4dd7-9ce6-ba115eaf6344 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:11.321946 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7866962c-d2e0-42f1-bce2-9025f776f47e None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:11.345716 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-5f4ea6ea-0c19-4dd7-9ce6-ba115eaf6344 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:03:11.345716 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:11.345716 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:11.345716 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:11.345716 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:11.345716 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:11.345716 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:11.345716 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:11.345716 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:11.345716 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:11.345716 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:11.345716 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:11.345716 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:03:11.345716 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:03:11.345716 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:03:11.346928 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:03:11.346928 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:11.346928 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:11.346928 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:11.346928 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:11.346928 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:11.346928 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:11.346928 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:11.346928 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:11.346928 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:11.346928 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:11.346928 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:11.346928 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:11.346928 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:11.346928 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:11.346928 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:11.346928 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:11.347808 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:03:11.347808 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:03:11.347808 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:03:11.347808 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:03:11.347808 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 278/544] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jun 22 10:03:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:03:11.347808 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4ea6ea-0c19-4dd7-9ce6-ba115eaf6344 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:11.361253 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 267/545] 10.222.0.43 () {56 vars in 1148 bytes} [Wed Jun 22 10:03:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 487 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:11.367654 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7866962c-d2e0-42f1-bce2-9025f776f47e None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:11.386083 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:11.478432 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4ea6ea-0c19-4dd7-9ce6-ba115eaf6344 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:11.513943 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3fd81d-0ec9-4ba0-9360-3b7b96196cba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:11.514612 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3fd81d-0ec9-4ba0-9360-3b7b96196cba None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:11.514895 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3fd81d-0ec9-4ba0-9360-3b7b96196cba None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:11.515171 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3fd81d-0ec9-4ba0-9360-3b7b96196cba None admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:11.516014 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3fd81d-0ec9-4ba0-9360-3b7b96196cba None admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:11.516325 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3fd81d-0ec9-4ba0-9360-3b7b96196cba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:11.517831 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3fd81d-0ec9-4ba0-9360-3b7b96196cba None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:11.530332 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 279/546] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Jun 22 10:03:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:03:11.535651 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3fd81d-0ec9-4ba0-9360-3b7b96196cba None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:11.558948 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7866962c-d2e0-42f1-bce2-9025f776f47e None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:11.619970 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b8987d-1158-49fc-804f-a532ebae4226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:11.620647 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b8987d-1158-49fc-804f-a532ebae4226 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:11.620934 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b8987d-1158-49fc-804f-a532ebae4226 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:11.621215 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b8987d-1158-49fc-804f-a532ebae4226 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:11.622083 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b8987d-1158-49fc-804f-a532ebae4226 None admin] RBAC: Adding query filter params (role.id=18493ce78e7c480c9202245b6d93cb4c, scope.project.id=e03f1c17e0884f188231d2949dc6f956, user.id=fe93d4c0737249fd8623bb5ce188e34e) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:11.622397 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b8987d-1158-49fc-804f-a532ebae4226 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:11.623856 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b8987d-1158-49fc-804f-a532ebae4226 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:11.626889 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:11.631617 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 268/547] 10.222.0.43 () {56 vars in 1374 bytes} [Wed Jun 22 10:03:11 2022] GET /identity/v3/role_assignments?user.id=fe93d4c0737249fd8623bb5ce188e34e&scope.project.id=e03f1c17e0884f188231d2949dc6f956&role.id=18493ce78e7c480c9202245b6d93cb4c => generated 259 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:03:11.653750 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3fd81d-0ec9-4ba0-9360-3b7b96196cba None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:11.699336 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492cd96c-6147-4b23-bcfc-c967cc0b2100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:11.700158 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492cd96c-6147-4b23-bcfc-c967cc0b2100 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:11.700443 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492cd96c-6147-4b23-bcfc-c967cc0b2100 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:11.700725 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492cd96c-6147-4b23-bcfc-c967cc0b2100 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:11.717786 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492cd96c-6147-4b23-bcfc-c967cc0b2100 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:11.719294 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492cd96c-6147-4b23-bcfc-c967cc0b2100 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:11.735700 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-492cd96c-6147-4b23-bcfc-c967cc0b2100 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 22 10:03:11.735700 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:11.735700 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:11.735700 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:11.735700 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:11.735700 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:11.735700 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:11.735700 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:11.735700 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:11.735700 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:11.735700 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:11.735700 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:11.735700 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 10:03:11.735700 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 10:03:11.735700 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 10:03:11.735700 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 10:03:11.736723 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:11.736723 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:11.736723 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 10:03:11.736723 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:03:11.736723 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 10:03:11.736723 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:03:11.736723 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:11.736723 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:11.736723 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:11.736723 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:11.736723 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:11.736723 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:11.736723 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:11.736723 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:11.736723 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:11.736723 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:11.736723 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:11.736723 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:11.738142 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:11.738142 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:11.738142 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 10:03:11.738142 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 10:03:11.738142 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 10:03:11.738142 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 10:03:11.738142 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 10:03:11.738142 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 10:03:11.738142 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 22 10:03:11.738142 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:03:11.741846 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 280/548] 10.222.0.43 () {56 vars in 1096 bytes} [Wed Jun 22 10:03:11 2022] GET /identity/v3/users/swift => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 10:03:11.743240 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b8987d-1158-49fc-804f-a532ebae4226 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:11.764027 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:11.873736 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b8987d-1158-49fc-804f-a532ebae4226 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:11.921201 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766edde9-f508-4057-ba09-8e8b72d9969a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:11.921923 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766edde9-f508-4057-ba09-8e8b72d9969a None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:11.922212 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766edde9-f508-4057-ba09-8e8b72d9969a None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:11.922493 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766edde9-f508-4057-ba09-8e8b72d9969a None admin] PATH_INFO: `/v3/users` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:11.923350 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766edde9-f508-4057-ba09-8e8b72d9969a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:11.923660 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766edde9-f508-4057-ba09-8e8b72d9969a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:11.925120 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766edde9-f508-4057-ba09-8e8b72d9969a None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:11.949610 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 269/549] 10.222.0.43 () {56 vars in 1135 bytes} [Wed Jun 22 10:03:11 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:11.956097 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492cd96c-6147-4b23-bcfc-c967cc0b2100 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:11.983908 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ec2cbc-b361-4ce6-9b47-425820d24d34 None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:11.984221 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ec2cbc-b361-4ce6-9b47-425820d24d34 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:11.984486 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ec2cbc-b361-4ce6-9b47-425820d24d34 None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:11.987093 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 270/550] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:03:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:03:12.002978 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d8343b-bc22-49de-a734-72ef8e9055e7 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:12.003333 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d8343b-bc22-49de-a734-72ef8e9055e7 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:12.003543 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d8343b-bc22-49de-a734-72ef8e9055e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:12.042806 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-77d8343b-bc22-49de-a734-72ef8e9055e7 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:03:12.044020 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-77d8343b-bc22-49de-a734-72ef8e9055e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:03:12.109763 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492cd96c-6147-4b23-bcfc-c967cc0b2100 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:12.154186 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c99cc2-f334-4014-9668-d62f71471020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:12.154772 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c99cc2-f334-4014-9668-d62f71471020 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:12.155053 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c99cc2-f334-4014-9668-d62f71471020 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:12.155328 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c99cc2-f334-4014-9668-d62f71471020 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:12.178098 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 271/551] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:03:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 10:03:12.179417 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:12.251198 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d8343b-bc22-49de-a734-72ef8e9055e7 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:12.257712 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c99cc2-f334-4014-9668-d62f71471020 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:12.257712 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c99cc2-f334-4014-9668-d62f71471020 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:12.278099 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:12.401796 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 281/552] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Jun 22 10:03:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 10:03:12.406845 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c99cc2-f334-4014-9668-d62f71471020 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:12.443442 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:12.486491 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d8343b-bc22-49de-a734-72ef8e9055e7 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:12.513195 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c99cc2-f334-4014-9668-d62f71471020 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:12.548963 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d84de6-7082-419f-be19-84859598a889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:12.549775 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d84de6-7082-419f-be19-84859598a889 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:12.550066 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d84de6-7082-419f-be19-84859598a889 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:12.550349 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d84de6-7082-419f-be19-84859598a889 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:12.561683 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d84de6-7082-419f-be19-84859598a889 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:12.563137 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d84de6-7082-419f-be19-84859598a889 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:12.564719 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69c4dde-c800-4e3f-b68f-e3de8caf2f4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:12.566062 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69c4dde-c800-4e3f-b68f-e3de8caf2f4b None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:12.566498 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69c4dde-c800-4e3f-b68f-e3de8caf2f4b None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:12.566943 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69c4dde-c800-4e3f-b68f-e3de8caf2f4b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:12.581804 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-93d84de6-7082-419f-be19-84859598a889 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:03:12.581804 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:12.581804 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:12.581804 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:12.581804 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:12.581804 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:12.581804 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:12.581804 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:12.581804 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:12.581804 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:12.581804 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:12.581804 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:12.581804 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:03:12.581804 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:03:12.581804 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:03:12.583090 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:03:12.583090 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:12.583090 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:12.583090 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:12.583090 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:12.583090 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:12.583090 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:12.583090 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:12.583090 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:12.583090 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:12.583090 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:12.583090 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:12.583090 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:12.583090 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:12.583090 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:12.583090 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:12.583090 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:12.584098 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:03:12.584098 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:03:12.584098 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:03:12.584098 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:03:12.584098 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 282/553] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jun 22 10:03:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 10:03:12.588742 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d84de6-7082-419f-be19-84859598a889 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:12.604742 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69c4dde-c800-4e3f-b68f-e3de8caf2f4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:03:12.620128 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-f69c4dde-c800-4e3f-b68f-e3de8caf2f4b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 10:03:12.620128 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:12.620128 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:12.620128 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:12.620128 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:12.620128 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:12.620128 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:12.620128 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:12.620128 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:12.620128 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:12.620128 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:12.620128 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:12.620128 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:03:12.620128 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:03:12.620128 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:03:12.620128 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:03:12.621081 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:03:12.621081 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:03:12.621081 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:03:12.621081 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:03:12.621081 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:12.621081 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:12.621081 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:12.621081 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:12.621081 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:12.621081 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:12.621081 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:12.621081 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:12.621081 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:12.621081 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:12.621081 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:12.621081 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:12.621943 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:12.621943 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:12.621943 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:12.621943 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:12.621943 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:03:12.621943 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:03:12.621943 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:03:12.621943 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:03:12.621943 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:03:12.621943 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:03:12.621943 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 10:03:12.621943 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:03:12.623090 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 272/554] 10.222.0.43 () {56 vars in 1102 bytes} [Wed Jun 22 10:03:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 372 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:03:12.627021 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe768962-69da-4f17-980f-06c65779a84a None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:12.627523 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe768962-69da-4f17-980f-06c65779a84a None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:12.628030 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe768962-69da-4f17-980f-06c65779a84a None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:12.629613 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 273/555] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:03:12 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:03:12.630634 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe768962-69da-4f17-980f-06c65779a84a None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:12.702496 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:12.710900 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:12.718262 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d84de6-7082-419f-be19-84859598a889 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:12.757963 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe768962-69da-4f17-980f-06c65779a84a None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:12.760917 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8028b6d7-cdf4-44c8-9209-39954abb13e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:12.761899 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8028b6d7-cdf4-44c8-9209-39954abb13e4 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:12.762392 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8028b6d7-cdf4-44c8-9209-39954abb13e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:12.762897 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8028b6d7-cdf4-44c8-9209-39954abb13e4 None admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:12.763831 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8028b6d7-cdf4-44c8-9209-39954abb13e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:12.764343 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8028b6d7-cdf4-44c8-9209-39954abb13e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:12.766059 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8028b6d7-cdf4-44c8-9209-39954abb13e4 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:12.780143 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 283/556] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Jun 22 10:03:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:12.781801 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0460fada-de67-4a04-bd2c-2c26bb1bdc86 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:12.782392 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0460fada-de67-4a04-bd2c-2c26bb1bdc86 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:12.782930 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0460fada-de67-4a04-bd2c-2c26bb1bdc86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:12.805394 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982b882b-9a4f-4af2-ab5b-ba20eeb40156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:12.806460 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982b882b-9a4f-4af2-ab5b-ba20eeb40156 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:12.806786 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-0460fada-de67-4a04-bd2c-2c26bb1bdc86 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:03:12.807216 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982b882b-9a4f-4af2-ab5b-ba20eeb40156 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:12.807699 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982b882b-9a4f-4af2-ab5b-ba20eeb40156 None admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:12.808039 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-0460fada-de67-4a04-bd2c-2c26bb1bdc86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:03:12.808873 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982b882b-9a4f-4af2-ab5b-ba20eeb40156 None admin] RBAC: Adding query filter params (name=service) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:12.809404 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982b882b-9a4f-4af2-ab5b-ba20eeb40156 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:12.812119 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982b882b-9a4f-4af2-ab5b-ba20eeb40156 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:12.824128 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 274/557] 10.222.0.43 () {56 vars in 1103 bytes} [Wed Jun 22 10:03:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:12.825403 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982b882b-9a4f-4af2-ab5b-ba20eeb40156 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:12.917967 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 284/558] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:03:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 10:03:12.918913 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0460fada-de67-4a04-bd2c-2c26bb1bdc86 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:12.950514 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982b882b-9a4f-4af2-ab5b-ba20eeb40156 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:12.981035 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:12.992572 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1830b89a-8570-4443-8d81-6f047f774f7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:12.993600 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1830b89a-8570-4443-8d81-6f047f774f7d None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:12.994029 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1830b89a-8570-4443-8d81-6f047f774f7d None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:12.994335 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1830b89a-8570-4443-8d81-6f047f774f7d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:13.002347 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1830b89a-8570-4443-8d81-6f047f774f7d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:13.004156 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1830b89a-8570-4443-8d81-6f047f774f7d None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:13.017410 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:13.024689 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-1830b89a-8570-4443-8d81-6f047f774f7d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:03:13.024689 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:13.024689 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:13.024689 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:13.024689 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:13.024689 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:13.024689 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:13.024689 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:13.024689 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:13.024689 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:13.024689 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:13.024689 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:13.024689 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 10:03:13.024689 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 10:03:13.024689 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 10:03:13.025901 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 10:03:13.025901 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:13.025901 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:13.025901 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:13.025901 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:13.025901 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:13.025901 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:13.025901 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:13.025901 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:13.025901 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:13.025901 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:13.025901 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:13.025901 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:13.025901 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:13.025901 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:13.025901 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:13.025901 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:13.027762 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 10:03:13.027762 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 10:03:13.027762 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 10:03:13.027762 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 10:03:13.027762 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 10:03:13.027762 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 10:03:13.027762 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:03:13.027762 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:03:13.032018 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 275/559] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Jun 22 10:03:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:03:13.032018 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1830b89a-8570-4443-8d81-6f047f774f7d None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:13.042411 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0460fada-de67-4a04-bd2c-2c26bb1bdc86 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:13.080033 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835b9c6b-171c-474c-8a3d-09ea730b85ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:13.080830 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835b9c6b-171c-474c-8a3d-09ea730b85ca None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:13.081116 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835b9c6b-171c-474c-8a3d-09ea730b85ca None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:13.081399 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835b9c6b-171c-474c-8a3d-09ea730b85ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:13.093265 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835b9c6b-171c-474c-8a3d-09ea730b85ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:13.094768 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835b9c6b-171c-474c-8a3d-09ea730b85ca None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:13.115147 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-835b9c6b-171c-474c-8a3d-09ea730b85ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:03:13.115147 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:13.115147 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:13.115147 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:13.115147 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:13.115147 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:13.115147 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:13.115147 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:13.115147 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:13.115147 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:13.115147 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:13.115147 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:13.115147 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:03:13.115147 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:03:13.115147 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:03:13.116153 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:03:13.116153 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:13.116153 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:13.116153 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:13.116153 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:13.116153 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:13.116153 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:13.116153 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:13.116153 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:13.116153 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:13.116153 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:13.116153 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:13.116153 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:13.116153 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:13.116153 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:13.116153 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:13.116153 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:13.117050 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:03:13.117050 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:03:13.117050 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:03:13.117050 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:03:13.117050 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 285/560] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jun 22 10:03:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:03:13.117858 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835b9c6b-171c-474c-8a3d-09ea730b85ca None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:13.150813 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1830b89a-8570-4443-8d81-6f047f774f7d None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:13.190673 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314f7745-9b2f-4819-9d99-23fbe857c343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:13.191471 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314f7745-9b2f-4819-9d99-23fbe857c343 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:13.191757 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314f7745-9b2f-4819-9d99-23fbe857c343 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:13.192034 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314f7745-9b2f-4819-9d99-23fbe857c343 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:13.204377 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314f7745-9b2f-4819-9d99-23fbe857c343 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:03:13.212844 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-314f7745-9b2f-4819-9d99-23fbe857c343 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 10:03:13.212844 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:13.212844 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:13.212844 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:13.212844 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:13.212844 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:13.212844 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:13.212844 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:13.212844 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:13.212844 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:13.212844 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:13.212844 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:13.212844 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:03:13.212844 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:03:13.212844 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:03:13.212844 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:03:13.213812 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:03:13.213812 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:03:13.213812 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:03:13.213812 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:03:13.213812 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:13.213812 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:13.213812 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:13.213812 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:13.213812 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:13.213812 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:13.213812 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:13.213812 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:13.213812 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:13.213812 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:13.213812 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:13.213812 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:13.214654 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:13.214654 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:13.214654 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:13.214654 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:13.214654 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:03:13.214654 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:03:13.214654 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:03:13.214654 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:03:13.214654 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:03:13.214654 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:03:13.214654 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 10:03:13.214654 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:03:13.214654 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 276/561] 10.222.0.43 () {56 vars in 1102 bytes} [Wed Jun 22 10:03:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:03:13.215406 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c616c1-440c-407a-a899-72f31d1315fe None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:13.216244 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c616c1-440c-407a-a899-72f31d1315fe None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:13.216244 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c616c1-440c-407a-a899-72f31d1315fe None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:13.217174 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 277/562] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:03:13 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:03:13.221677 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c616c1-440c-407a-a899-72f31d1315fe None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:13.233170 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835b9c6b-171c-474c-8a3d-09ea730b85ca None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:13.264308 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:13.271179 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de3010a-ad39-4570-9497-c2fa5e729710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:13.272031 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de3010a-ad39-4570-9497-c2fa5e729710 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:13.272493 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de3010a-ad39-4570-9497-c2fa5e729710 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:13.272981 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de3010a-ad39-4570-9497-c2fa5e729710 None admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:13.274744 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de3010a-ad39-4570-9497-c2fa5e729710 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:13.275942 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de3010a-ad39-4570-9497-c2fa5e729710 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:13.277422 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de3010a-ad39-4570-9497-c2fa5e729710 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:13.281332 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:13.294243 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 286/563] 10.222.0.43 () {56 vars in 1148 bytes} [Wed Jun 22 10:03:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:13.295122 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de3010a-ad39-4570-9497-c2fa5e729710 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:13.357816 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c616c1-440c-407a-a899-72f31d1315fe None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:13.400460 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4af50c4-4529-4eab-9829-d30136000251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:13.401134 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4af50c4-4529-4eab-9829-d30136000251 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:13.401425 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4af50c4-4529-4eab-9829-d30136000251 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:13.401721 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4af50c4-4529-4eab-9829-d30136000251 None admin] PATH_INFO: `/v3/domains` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:13.402459 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4af50c4-4529-4eab-9829-d30136000251 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:13.402769 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4af50c4-4529-4eab-9829-d30136000251 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:13.404161 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4af50c4-4529-4eab-9829-d30136000251 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:13.416917 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 278/564] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Jun 22 10:03:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:13.419686 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ff6dae-1bcf-4496-ab07-83017803c911 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:13.419976 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ff6dae-1bcf-4496-ab07-83017803c911 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:13.420255 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ff6dae-1bcf-4496-ab07-83017803c911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:13.430638 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de3010a-ad39-4570-9497-c2fa5e729710 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:13.438889 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-a7ff6dae-1bcf-4496-ab07-83017803c911 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:03:13.440442 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-a7ff6dae-1bcf-4496-ab07-83017803c911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:03:13.464170 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d829ff3-ac5d-4f78-baec-7f1cd2fa18cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:13.464845 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d829ff3-ac5d-4f78-baec-7f1cd2fa18cd None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:13.465138 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d829ff3-ac5d-4f78-baec-7f1cd2fa18cd None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:13.465422 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d829ff3-ac5d-4f78-baec-7f1cd2fa18cd None admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:13.466207 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d829ff3-ac5d-4f78-baec-7f1cd2fa18cd None admin] RBAC: Adding query filter params (name=service) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:13.466516 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d829ff3-ac5d-4f78-baec-7f1cd2fa18cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:13.467882 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d829ff3-ac5d-4f78-baec-7f1cd2fa18cd None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:13.477442 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 287/565] 10.222.0.43 () {56 vars in 1103 bytes} [Wed Jun 22 10:03:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:13.477442 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d829ff3-ac5d-4f78-baec-7f1cd2fa18cd None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:13.520115 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 279/566] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:03:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 10:03:13.521293 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ff6dae-1bcf-4496-ab07-83017803c911 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:13.552180 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:13.566908 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:13.606019 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d829ff3-ac5d-4f78-baec-7f1cd2fa18cd None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:13.648264 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ff6dae-1bcf-4496-ab07-83017803c911 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:13.648600 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baa248f-fe3c-407c-9454-8ce51fa61913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:13.649160 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baa248f-fe3c-407c-9454-8ce51fa61913 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:13.649443 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baa248f-fe3c-407c-9454-8ce51fa61913 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:13.649749 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baa248f-fe3c-407c-9454-8ce51fa61913 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:13.650593 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baa248f-fe3c-407c-9454-8ce51fa61913 None admin] RBAC: Adding query filter params (role.id=18493ce78e7c480c9202245b6d93cb4c, scope.project.id=e03f1c17e0884f188231d2949dc6f956, user.id=9566f8cca2574f4cb5edcbf384f368a7) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:13.650905 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baa248f-fe3c-407c-9454-8ce51fa61913 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:13.652332 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baa248f-fe3c-407c-9454-8ce51fa61913 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:13.658232 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 288/567] 10.222.0.43 () {56 vars in 1374 bytes} [Wed Jun 22 10:03:13 2022] GET /identity/v3/role_assignments?user.id=9566f8cca2574f4cb5edcbf384f368a7&scope.project.id=e03f1c17e0884f188231d2949dc6f956&role.id=18493ce78e7c480c9202245b6d93cb4c => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:13.666796 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baa248f-fe3c-407c-9454-8ce51fa61913 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:13.695647 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c597249-31c4-4dd1-a50c-90e642873da9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:13.696499 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c597249-31c4-4dd1-a50c-90e642873da9 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:13.696756 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c597249-31c4-4dd1-a50c-90e642873da9 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:13.697035 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c597249-31c4-4dd1-a50c-90e642873da9 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:13.706107 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c597249-31c4-4dd1-a50c-90e642873da9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:13.707717 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c597249-31c4-4dd1-a50c-90e642873da9 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:13.725776 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-6c597249-31c4-4dd1-a50c-90e642873da9 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 22 10:03:13.725776 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:13.725776 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:13.725776 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:13.725776 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:13.725776 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:13.725776 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:13.725776 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:13.725776 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:13.725776 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:13.725776 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:13.725776 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:13.725776 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 10:03:13.725776 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 10:03:13.725776 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 10:03:13.725776 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 10:03:13.726800 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:13.726800 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:13.726800 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 10:03:13.726800 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:03:13.726800 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 10:03:13.726800 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:03:13.726800 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:13.726800 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:13.726800 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:13.726800 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:13.726800 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:13.726800 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:13.726800 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:13.726800 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:13.726800 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:13.726800 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:13.726800 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:13.726800 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:13.727769 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:13.727769 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:13.727769 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 10:03:13.727769 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 10:03:13.727769 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 10:03:13.727769 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 10:03:13.727769 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 10:03:13.727769 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 10:03:13.727769 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 22 10:03:13.727769 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:03:13.731822 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 280/568] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Jun 22 10:03:13 2022] GET /identity/v3/users/glance => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:03:13.732895 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c597249-31c4-4dd1-a50c-90e642873da9 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:13.791331 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baa248f-fe3c-407c-9454-8ce51fa61913 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:13.810762 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:13.831807 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e238d096-d6c6-412c-b047-ddec127408c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:13.833022 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e238d096-d6c6-412c-b047-ddec127408c8 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:13.833537 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e238d096-d6c6-412c-b047-ddec127408c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:13.833981 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e238d096-d6c6-412c-b047-ddec127408c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:13.845417 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e238d096-d6c6-412c-b047-ddec127408c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:13.846963 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e238d096-d6c6-412c-b047-ddec127408c8 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:13.848183 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:13.856285 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c597249-31c4-4dd1-a50c-90e642873da9 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:13.868840 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-e238d096-d6c6-412c-b047-ddec127408c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:03:13.868840 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:13.868840 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:13.868840 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:13.868840 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:13.868840 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:13.868840 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:13.868840 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:13.868840 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:13.868840 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:13.868840 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:13.868840 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:13.868840 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:03:13.868840 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:03:13.868840 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:03:13.869955 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:03:13.869955 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:13.869955 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:13.869955 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:13.869955 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:13.869955 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:13.869955 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:13.869955 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:13.869955 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:13.869955 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:13.869955 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:13.869955 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:13.869955 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:13.869955 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:13.869955 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:13.869955 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:13.869955 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:13.874560 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:03:13.874560 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:03:13.874560 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:03:13.874560 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:03:13.874560 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 289/569] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jun 22 10:03:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:03:13.874560 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e238d096-d6c6-412c-b047-ddec127408c8 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:13.901539 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9937c0aa-1f90-44e5-978f-dc9dd502ecd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:13.902377 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9937c0aa-1f90-44e5-978f-dc9dd502ecd2 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:13.902666 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9937c0aa-1f90-44e5-978f-dc9dd502ecd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:13.902947 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9937c0aa-1f90-44e5-978f-dc9dd502ecd2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:13.914861 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9937c0aa-1f90-44e5-978f-dc9dd502ecd2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:03:13.923444 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-9937c0aa-1f90-44e5-978f-dc9dd502ecd2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 10:03:13.923444 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:13.923444 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:13.923444 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:13.923444 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:13.923444 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:13.923444 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:13.923444 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:13.923444 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:13.923444 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:13.923444 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:13.923444 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:13.923444 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:03:13.923444 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:03:13.923444 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:03:13.923444 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:03:13.924375 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:03:13.924375 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:03:13.924375 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:03:13.924375 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:03:13.924375 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:13.924375 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:13.924375 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:13.924375 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:13.924375 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:13.924375 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:13.924375 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:13.924375 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:13.924375 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:13.924375 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:13.924375 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:13.924375 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:13.925225 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:13.925225 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:13.925225 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:13.925225 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:13.925225 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:03:13.925225 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:03:13.925225 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:03:13.925225 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:03:13.925225 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:03:13.925225 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:03:13.925225 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 10:03:13.925225 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:03:13.925225 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 281/570] 10.222.0.43 () {56 vars in 1102 bytes} [Wed Jun 22 10:03:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:03:13.926454 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e689577-113c-4fc4-8721-dd6011fe36c6 None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:13.926856 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e689577-113c-4fc4-8721-dd6011fe36c6 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:13.927045 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e689577-113c-4fc4-8721-dd6011fe36c6 None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:13.932286 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 282/571] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:03:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:03:13.932286 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e689577-113c-4fc4-8721-dd6011fe36c6 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:13.987046 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e238d096-d6c6-412c-b047-ddec127408c8 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:14.026999 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7bbde3-e112-47d7-b195-7efb250d6418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:14.027777 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7bbde3-e112-47d7-b195-7efb250d6418 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:14.028062 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7bbde3-e112-47d7-b195-7efb250d6418 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:14.028340 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7bbde3-e112-47d7-b195-7efb250d6418 None admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:14.029182 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7bbde3-e112-47d7-b195-7efb250d6418 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:14.029494 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7bbde3-e112-47d7-b195-7efb250d6418 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:14.031082 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7bbde3-e112-47d7-b195-7efb250d6418 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:14.042795 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e689577-113c-4fc4-8721-dd6011fe36c6 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:14.054336 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 290/572] 10.222.0.43 () {56 vars in 1137 bytes} [Wed Jun 22 10:03:13 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:14.055608 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7bbde3-e112-47d7-b195-7efb250d6418 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:14.079844 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69bf140-5e5f-4aee-bd2e-6541f31c0b21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:14.080506 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69bf140-5e5f-4aee-bd2e-6541f31c0b21 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:14.080824 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69bf140-5e5f-4aee-bd2e-6541f31c0b21 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:14.081058 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69bf140-5e5f-4aee-bd2e-6541f31c0b21 None admin] PATH_INFO: `/v3/domains` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:14.081805 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69bf140-5e5f-4aee-bd2e-6541f31c0b21 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:14.082305 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69bf140-5e5f-4aee-bd2e-6541f31c0b21 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:14.083780 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69bf140-5e5f-4aee-bd2e-6541f31c0b21 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:14.084926 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:14.098692 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 283/573] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Jun 22 10:03:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:14.100123 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e664483b-9e39-43a5-b94f-1bdb8bd65dc3 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:14.100663 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e664483b-9e39-43a5-b94f-1bdb8bd65dc3 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:14.100959 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e664483b-9e39-43a5-b94f-1bdb8bd65dc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:14.119155 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-e664483b-9e39-43a5-b94f-1bdb8bd65dc3 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:03:14.120356 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-e664483b-9e39-43a5-b94f-1bdb8bd65dc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:03:14.133618 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:14.172713 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7bbde3-e112-47d7-b195-7efb250d6418 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:14.201263 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 284/574] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:03:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 10:03:14.202618 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e664483b-9e39-43a5-b94f-1bdb8bd65dc3 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:14.209977 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dbd7b3-6f64-4194-8ea6-46d9c57da3ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:14.210657 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dbd7b3-6f64-4194-8ea6-46d9c57da3ee None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:14.210950 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dbd7b3-6f64-4194-8ea6-46d9c57da3ee None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:14.211234 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dbd7b3-6f64-4194-8ea6-46d9c57da3ee None admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:14.211996 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dbd7b3-6f64-4194-8ea6-46d9c57da3ee None admin] RBAC: Adding query filter params (name=service) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:14.212309 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dbd7b3-6f64-4194-8ea6-46d9c57da3ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:14.213717 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dbd7b3-6f64-4194-8ea6-46d9c57da3ee None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:14.225335 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 291/575] 10.222.0.43 () {56 vars in 1103 bytes} [Wed Jun 22 10:03:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:14.226640 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dbd7b3-6f64-4194-8ea6-46d9c57da3ee None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:14.313283 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e664483b-9e39-43a5-b94f-1bdb8bd65dc3 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:14.328615 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:14.343445 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dbd7b3-6f64-4194-8ea6-46d9c57da3ee None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:14.349960 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef95cc4d-2c72-496e-964e-f2276ce7bf6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:14.351205 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef95cc4d-2c72-496e-964e-f2276ce7bf6f None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:14.351633 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef95cc4d-2c72-496e-964e-f2276ce7bf6f None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:14.352083 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef95cc4d-2c72-496e-964e-f2276ce7bf6f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:14.362338 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef95cc4d-2c72-496e-964e-f2276ce7bf6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:14.364825 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef95cc4d-2c72-496e-964e-f2276ce7bf6f None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:14.372138 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:14.382749 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dc7a82-0c94-4669-bd4a-0e143b274e1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:14.383542 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dc7a82-0c94-4669-bd4a-0e143b274e1d None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:14.383824 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dc7a82-0c94-4669-bd4a-0e143b274e1d None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:14.384102 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dc7a82-0c94-4669-bd4a-0e143b274e1d None admin] PATH_INFO: `/v3/users/nova` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:14.384431 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-ef95cc4d-2c72-496e-964e-f2276ce7bf6f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:03:14.384431 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:14.384431 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:14.384431 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:14.384431 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:14.384431 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:14.384431 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:14.384431 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:14.384431 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:14.384431 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:14.384431 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:14.384431 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:14.384431 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:03:14.384431 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:03:14.384431 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:03:14.385263 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:03:14.385263 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:14.385263 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:14.385263 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:14.385263 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:14.385263 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:14.385263 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:14.385263 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:14.385263 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:14.385263 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:14.385263 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:14.385263 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:14.385263 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:14.385263 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:14.385263 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:14.385263 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:14.385263 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:14.386145 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:03:14.386145 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:03:14.386145 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:03:14.386145 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:03:14.386145 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 285/576] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jun 22 10:03:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:03:14.386418 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef95cc4d-2c72-496e-964e-f2276ce7bf6f None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:14.397005 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dc7a82-0c94-4669-bd4a-0e143b274e1d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:14.398502 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dc7a82-0c94-4669-bd4a-0e143b274e1d None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:14.413488 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-47dc7a82-0c94-4669-bd4a-0e143b274e1d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 22 10:03:14.413488 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:14.413488 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:14.413488 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:14.413488 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:14.413488 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:14.413488 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:14.413488 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:14.413488 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:14.413488 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:14.413488 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:14.413488 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:14.413488 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 10:03:14.413488 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 10:03:14.413488 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 10:03:14.413488 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 10:03:14.414497 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:14.414497 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:14.414497 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 10:03:14.414497 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:03:14.414497 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 10:03:14.414497 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:03:14.414497 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:14.414497 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:14.414497 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:14.414497 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:14.414497 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:14.414497 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:14.414497 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:14.414497 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:14.414497 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:14.414497 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:14.414497 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:14.414497 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:14.415447 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:14.415447 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:14.415447 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 10:03:14.415447 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 10:03:14.415447 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 10:03:14.415447 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 10:03:14.415447 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 10:03:14.415447 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 10:03:14.415447 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 22 10:03:14.415447 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:03:14.419318 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 292/577] 10.222.0.43 () {56 vars in 1093 bytes} [Wed Jun 22 10:03:14 2022] GET /identity/v3/users/nova => generated 82 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:03:14.420139 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dc7a82-0c94-4669-bd4a-0e143b274e1d None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:14.504408 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef95cc4d-2c72-496e-964e-f2276ce7bf6f None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:14.522901 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dc7a82-0c94-4669-bd4a-0e143b274e1d None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:14.540815 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0a4e03-5917-4c70-8747-a7e7f8ae19c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:14.541608 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0a4e03-5917-4c70-8747-a7e7f8ae19c9 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:14.541921 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0a4e03-5917-4c70-8747-a7e7f8ae19c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:14.542200 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0a4e03-5917-4c70-8747-a7e7f8ae19c9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:14.554449 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0a4e03-5917-4c70-8747-a7e7f8ae19c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:03:14.558471 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cbdb1a-69dd-433e-a410-a74e01b5adef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:14.559264 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cbdb1a-69dd-433e-a410-a74e01b5adef None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:14.559555 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cbdb1a-69dd-433e-a410-a74e01b5adef None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:14.559837 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cbdb1a-69dd-433e-a410-a74e01b5adef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:14.562218 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-3e0a4e03-5917-4c70-8747-a7e7f8ae19c9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 10:03:14.562218 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:14.562218 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:14.562218 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:14.562218 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:14.562218 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:14.562218 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:14.562218 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:14.562218 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:14.562218 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:14.562218 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:14.562218 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:14.562218 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:03:14.562218 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:03:14.562218 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:03:14.562218 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:03:14.563107 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:03:14.563107 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:03:14.563107 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:03:14.563107 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:03:14.563107 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:14.563107 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:14.563107 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:14.563107 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:14.563107 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:14.563107 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:14.563107 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:14.563107 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:14.563107 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:14.563107 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:14.563107 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:14.563107 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:14.563979 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:14.563979 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:14.563979 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:14.563979 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:14.563979 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:03:14.563979 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:03:14.563979 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:03:14.563979 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:03:14.563979 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:03:14.563979 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:03:14.563979 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 10:03:14.563979 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:03:14.563979 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 286/578] 10.222.0.43 () {56 vars in 1102 bytes} [Wed Jun 22 10:03:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:03:14.564706 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0a4e03-5917-4c70-8747-a7e7f8ae19c9 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:14.577356 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cbdb1a-69dd-433e-a410-a74e01b5adef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:14.578853 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cbdb1a-69dd-433e-a410-a74e01b5adef None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:14.588112 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:14.599107 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-31cbdb1a-69dd-433e-a410-a74e01b5adef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:03:14.599107 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:14.599107 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:14.599107 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:14.599107 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:14.599107 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:14.599107 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:14.599107 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:14.599107 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:14.599107 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:14.599107 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:14.599107 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:14.599107 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:03:14.599107 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:03:14.599107 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:03:14.599967 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:03:14.599967 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:14.599967 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:14.599967 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:14.599967 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:14.599967 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:14.599967 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:14.599967 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:14.599967 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:14.599967 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:14.599967 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:14.599967 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:14.599967 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:14.599967 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:14.599967 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:14.599967 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:14.599967 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:14.601117 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:03:14.601117 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:03:14.601117 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:03:14.601117 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:03:14.602643 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 293/579] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jun 22 10:03:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:03:14.603547 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cbdb1a-69dd-433e-a410-a74e01b5adef None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:14.628608 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:14.679194 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0a4e03-5917-4c70-8747-a7e7f8ae19c9 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:14.717804 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cbdb1a-69dd-433e-a410-a74e01b5adef None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:14.734176 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f176cae0-5e84-405c-95c6-d3924c4f1077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:14.734848 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f176cae0-5e84-405c-95c6-d3924c4f1077 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:14.735142 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f176cae0-5e84-405c-95c6-d3924c4f1077 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:14.735418 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f176cae0-5e84-405c-95c6-d3924c4f1077 None admin] PATH_INFO: `/v3/domains` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:14.736147 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f176cae0-5e84-405c-95c6-d3924c4f1077 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:14.736456 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f176cae0-5e84-405c-95c6-d3924c4f1077 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:14.737877 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f176cae0-5e84-405c-95c6-d3924c4f1077 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:14.755816 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 287/580] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Jun 22 10:03:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:14.755816 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f176cae0-5e84-405c-95c6-d3924c4f1077 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:14.757943 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febf6a7d-9271-46cf-a7c8-2f08a044b5f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:14.758636 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febf6a7d-9271-46cf-a7c8-2f08a044b5f8 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:14.758923 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febf6a7d-9271-46cf-a7c8-2f08a044b5f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:14.759202 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febf6a7d-9271-46cf-a7c8-2f08a044b5f8 None admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:14.760051 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febf6a7d-9271-46cf-a7c8-2f08a044b5f8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:14.760365 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febf6a7d-9271-46cf-a7c8-2f08a044b5f8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:14.761837 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febf6a7d-9271-46cf-a7c8-2f08a044b5f8 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:14.785451 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 294/581] 10.222.0.43 () {56 vars in 1133 bytes} [Wed Jun 22 10:03:14 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:14.786811 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febf6a7d-9271-46cf-a7c8-2f08a044b5f8 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:14.856330 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:14.869912 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f176cae0-5e84-405c-95c6-d3924c4f1077 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:14.888048 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:14.905419 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01ef258-04a1-4513-9e85-aa7a7de8be1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:14.906024 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01ef258-04a1-4513-9e85-aa7a7de8be1a None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:14.906307 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01ef258-04a1-4513-9e85-aa7a7de8be1a None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:14.906639 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01ef258-04a1-4513-9e85-aa7a7de8be1a None admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:14.907422 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01ef258-04a1-4513-9e85-aa7a7de8be1a None admin] RBAC: Adding query filter params (name=service) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:14.907726 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01ef258-04a1-4513-9e85-aa7a7de8be1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:14.909111 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01ef258-04a1-4513-9e85-aa7a7de8be1a None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:14.911410 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febf6a7d-9271-46cf-a7c8-2f08a044b5f8 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:14.922357 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 288/582] 10.222.0.43 () {56 vars in 1103 bytes} [Wed Jun 22 10:03:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:14.922357 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01ef258-04a1-4513-9e85-aa7a7de8be1a None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:14.948320 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541cff96-d8b3-4a26-a829-797c052b3c84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:14.948998 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541cff96-d8b3-4a26-a829-797c052b3c84 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:14.949287 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541cff96-d8b3-4a26-a829-797c052b3c84 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:14.949569 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541cff96-d8b3-4a26-a829-797c052b3c84 None admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:14.950329 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541cff96-d8b3-4a26-a829-797c052b3c84 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:14.950640 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541cff96-d8b3-4a26-a829-797c052b3c84 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:14.952050 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541cff96-d8b3-4a26-a829-797c052b3c84 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:14.964662 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 295/583] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Jun 22 10:03:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:14.965596 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541cff96-d8b3-4a26-a829-797c052b3c84 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:15.044553 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01ef258-04a1-4513-9e85-aa7a7de8be1a None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:15.073886 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541cff96-d8b3-4a26-a829-797c052b3c84 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:15.080473 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1f4bb4-9c18-4366-8974-eec4f76814cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:15.081282 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1f4bb4-9c18-4366-8974-eec4f76814cd None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:15.081548 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1f4bb4-9c18-4366-8974-eec4f76814cd None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:15.081847 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1f4bb4-9c18-4366-8974-eec4f76814cd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:15.089927 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1f4bb4-9c18-4366-8974-eec4f76814cd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:15.091393 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1f4bb4-9c18-4366-8974-eec4f76814cd None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:15.097386 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:15.106492 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-1e1f4bb4-9c18-4366-8974-eec4f76814cd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:03:15.106492 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:15.106492 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:15.106492 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:15.106492 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:15.106492 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:15.106492 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:15.106492 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:15.106492 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:15.106492 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:15.106492 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:15.106492 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:15.106492 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 10:03:15.106492 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 10:03:15.106492 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 10:03:15.107544 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 10:03:15.107544 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:15.107544 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:15.107544 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:15.107544 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:15.107544 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:15.107544 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:15.107544 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:15.107544 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:15.107544 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:15.107544 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:15.107544 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:15.107544 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:15.107544 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:15.107544 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:15.107544 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:15.107544 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:15.108617 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 10:03:15.108617 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 10:03:15.108617 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 10:03:15.108617 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 10:03:15.108617 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 10:03:15.108617 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 10:03:15.108617 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:03:15.108617 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:03:15.109989 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 289/584] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Jun 22 10:03:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:03:15.111047 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1f4bb4-9c18-4366-8974-eec4f76814cd None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:15.119805 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cee54e-c46e-467b-8f7a-dcacaefbec28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:15.121040 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cee54e-c46e-467b-8f7a-dcacaefbec28 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:15.121332 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cee54e-c46e-467b-8f7a-dcacaefbec28 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:15.121617 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cee54e-c46e-467b-8f7a-dcacaefbec28 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:15.133949 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cee54e-c46e-467b-8f7a-dcacaefbec28 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:15.135411 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cee54e-c46e-467b-8f7a-dcacaefbec28 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:15.153269 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-89cee54e-c46e-467b-8f7a-dcacaefbec28 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:03:15.153269 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:15.153269 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:15.153269 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:15.153269 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:15.153269 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:15.153269 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:15.153269 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:15.153269 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:15.153269 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:15.153269 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:15.153269 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:15.153269 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:03:15.153269 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:03:15.153269 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:03:15.154383 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:03:15.154383 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:15.154383 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:15.154383 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:15.154383 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:15.154383 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:15.154383 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:15.154383 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:15.154383 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:15.154383 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:15.154383 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:15.154383 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:15.154383 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:15.154383 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:15.154383 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:15.154383 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:15.154383 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:15.155265 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:03:15.155265 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:03:15.155265 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:03:15.155265 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:03:15.155265 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 296/585] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jun 22 10:03:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:03:15.155265 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cee54e-c46e-467b-8f7a-dcacaefbec28 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:15.162762 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:15.227113 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1f4bb4-9c18-4366-8974-eec4f76814cd None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:15.261756 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec807cd-dc8c-4c8a-9764-e6bc494e8f84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:15.262555 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec807cd-dc8c-4c8a-9764-e6bc494e8f84 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:15.262837 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec807cd-dc8c-4c8a-9764-e6bc494e8f84 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:15.263114 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec807cd-dc8c-4c8a-9764-e6bc494e8f84 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:15.271517 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cee54e-c46e-467b-8f7a-dcacaefbec28 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:15.274192 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec807cd-dc8c-4c8a-9764-e6bc494e8f84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:15.275653 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec807cd-dc8c-4c8a-9764-e6bc494e8f84 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:15.295321 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-2ec807cd-dc8c-4c8a-9764-e6bc494e8f84 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:03:15.295321 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:15.295321 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:15.295321 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:15.295321 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:15.295321 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:15.295321 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:15.295321 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:15.295321 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:15.295321 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:15.295321 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:15.295321 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:15.295321 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:03:15.295321 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:03:15.295321 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:03:15.296252 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:03:15.296252 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:15.296252 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:15.296252 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:15.296252 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:15.296252 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:15.296252 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:15.296252 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:15.296252 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:15.296252 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:15.296252 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:15.296252 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:15.296252 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:15.296252 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:15.296252 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:15.296252 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:15.296252 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:15.298242 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:03:15.298242 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:03:15.298242 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:03:15.298242 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:03:15.298242 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 290/586] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jun 22 10:03:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:03:15.298242 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec807cd-dc8c-4c8a-9764-e6bc494e8f84 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:15.314720 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a68f478-0240-43a5-9245-07f453440727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:15.315523 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a68f478-0240-43a5-9245-07f453440727 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:15.315810 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a68f478-0240-43a5-9245-07f453440727 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:15.316090 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a68f478-0240-43a5-9245-07f453440727 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:15.324341 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a68f478-0240-43a5-9245-07f453440727 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:15.325839 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a68f478-0240-43a5-9245-07f453440727 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:15.341242 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-9a68f478-0240-43a5-9245-07f453440727 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 22 10:03:15.341242 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:15.341242 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:15.341242 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:15.341242 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:15.341242 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:15.341242 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:15.341242 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:15.341242 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:15.341242 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:15.341242 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:15.341242 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:15.341242 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 10:03:15.341242 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 10:03:15.341242 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 10:03:15.341242 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 10:03:15.342252 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:15.342252 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:15.342252 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 10:03:15.342252 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:03:15.342252 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 10:03:15.342252 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:03:15.342252 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:15.342252 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:15.342252 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:15.342252 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:15.342252 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:15.342252 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:15.342252 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:15.342252 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:15.342252 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:15.342252 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:15.342252 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:15.342252 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:15.343171 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:15.343171 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:15.343171 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 10:03:15.343171 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 10:03:15.343171 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 10:03:15.343171 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 10:03:15.343171 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 10:03:15.343171 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 10:03:15.343171 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 22 10:03:15.343171 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:03:15.343171 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 297/587] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Jun 22 10:03:15 2022] GET /identity/v3/users/cinder => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:03:15.343743 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a68f478-0240-43a5-9245-07f453440727 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:15.378579 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:15.397719 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:15.407723 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec807cd-dc8c-4c8a-9764-e6bc494e8f84 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:15.443271 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff41e98-65c3-49c6-a59f-c1a94aa616bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:15.443931 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff41e98-65c3-49c6-a59f-c1a94aa616bc None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:15.444214 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff41e98-65c3-49c6-a59f-c1a94aa616bc None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:15.444497 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff41e98-65c3-49c6-a59f-c1a94aa616bc None admin] PATH_INFO: `/v3/projects` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:15.445291 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff41e98-65c3-49c6-a59f-c1a94aa616bc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:15.445600 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff41e98-65c3-49c6-a59f-c1a94aa616bc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:15.447061 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff41e98-65c3-49c6-a59f-c1a94aa616bc None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:15.453830 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a68f478-0240-43a5-9245-07f453440727 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:15.459067 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 291/588] 10.222.0.43 () {56 vars in 1148 bytes} [Wed Jun 22 10:03:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:15.459861 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff41e98-65c3-49c6-a59f-c1a94aa616bc None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:15.492304 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8e74f1-f200-4c7a-9f3b-68b1bf4f55f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:15.492976 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8e74f1-f200-4c7a-9f3b-68b1bf4f55f5 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:15.493261 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8e74f1-f200-4c7a-9f3b-68b1bf4f55f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:15.493538 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8e74f1-f200-4c7a-9f3b-68b1bf4f55f5 None admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:15.494294 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8e74f1-f200-4c7a-9f3b-68b1bf4f55f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:15.494604 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8e74f1-f200-4c7a-9f3b-68b1bf4f55f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:15.495978 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8e74f1-f200-4c7a-9f3b-68b1bf4f55f5 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:15.508497 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 298/589] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Jun 22 10:03:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:15.509305 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8e74f1-f200-4c7a-9f3b-68b1bf4f55f5 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:15.572236 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff41e98-65c3-49c6-a59f-c1a94aa616bc None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:15.602469 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:15.608087 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d70904-2ef5-4b8c-99e0-7abf3b191535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:15.608964 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d70904-2ef5-4b8c-99e0-7abf3b191535 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:15.609428 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d70904-2ef5-4b8c-99e0-7abf3b191535 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:15.609949 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d70904-2ef5-4b8c-99e0-7abf3b191535 None admin] PATH_INFO: `/v3/domains` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:15.610751 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d70904-2ef5-4b8c-99e0-7abf3b191535 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:15.611133 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d70904-2ef5-4b8c-99e0-7abf3b191535 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:15.612523 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d70904-2ef5-4b8c-99e0-7abf3b191535 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:15.613547 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8e74f1-f200-4c7a-9f3b-68b1bf4f55f5 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:15.625917 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 292/590] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Jun 22 10:03:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:15.626706 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d70904-2ef5-4b8c-99e0-7abf3b191535 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:15.642973 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:15.655547 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b748d9-3614-47b6-a20e-68c73586cea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:15.656221 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b748d9-3614-47b6-a20e-68c73586cea6 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:15.656506 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b748d9-3614-47b6-a20e-68c73586cea6 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:15.656788 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b748d9-3614-47b6-a20e-68c73586cea6 None admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:15.657621 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b748d9-3614-47b6-a20e-68c73586cea6 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:15.657978 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b748d9-3614-47b6-a20e-68c73586cea6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:15.659403 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b748d9-3614-47b6-a20e-68c73586cea6 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:15.686681 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 299/591] 10.222.0.43 () {56 vars in 1137 bytes} [Wed Jun 22 10:03:15 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:15.686681 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b748d9-3614-47b6-a20e-68c73586cea6 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:15.734869 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d70904-2ef5-4b8c-99e0-7abf3b191535 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:15.769905 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcc9857-c025-4d8b-a502-9dfbf59814cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:15.770833 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcc9857-c025-4d8b-a502-9dfbf59814cd None admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:15.771118 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcc9857-c025-4d8b-a502-9dfbf59814cd None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:15.771406 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcc9857-c025-4d8b-a502-9dfbf59814cd None admin] PATH_INFO: `/v3/projects/e03f1c17e0884f188231d2949dc6f956/users/a2418acec46b4db48346129004827853/roles/18493ce78e7c480c9202245b6d93cb4c` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:15.785470 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcc9857-c025-4d8b-a502-9dfbf59814cd None admin] RBAC: Authorizing `identity:create_grant(project_id=e03f1c17e0884f188231d2949dc6f956, user_id=a2418acec46b4db48346129004827853, role_id=18493ce78e7c480c9202245b6d93cb4c)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:15.787637 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcc9857-c025-4d8b-a502-9dfbf59814cd None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:15.797054 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b748d9-3614-47b6-a20e-68c73586cea6 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:15.801150 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 293/592] 10.222.0.43 () {58 vars in 1439 bytes} [Wed Jun 22 10:03:15 2022] PUT /identity/v3/projects/e03f1c17e0884f188231d2949dc6f956/users/a2418acec46b4db48346129004827853/roles/18493ce78e7c480c9202245b6d93cb4c => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:03:15.802897 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcc9857-c025-4d8b-a502-9dfbf59814cd None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:15.837813 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3978b4-da00-417e-8e05-30bc171fecc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:15.838695 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3978b4-da00-417e-8e05-30bc171fecc6 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:15.838980 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3978b4-da00-417e-8e05-30bc171fecc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:15.839309 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3978b4-da00-417e-8e05-30bc171fecc6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:15.847006 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3978b4-da00-417e-8e05-30bc171fecc6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:15.849112 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3978b4-da00-417e-8e05-30bc171fecc6 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:15.868166 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-3a3978b4-da00-417e-8e05-30bc171fecc6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:03:15.868166 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:15.868166 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:15.868166 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:15.868166 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:15.868166 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:15.868166 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:15.868166 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:15.868166 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:15.868166 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:15.868166 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:15.868166 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:15.868166 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 10:03:15.868166 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 10:03:15.868166 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 10:03:15.869138 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 10:03:15.869138 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:15.869138 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:15.869138 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:15.869138 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:15.869138 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:15.869138 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:15.869138 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:15.869138 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:15.869138 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:15.869138 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:15.869138 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:15.869138 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:15.869138 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:15.869138 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:15.869138 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:15.869138 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:15.870802 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 10:03:15.870802 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 10:03:15.870802 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 10:03:15.870802 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 10:03:15.870802 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 10:03:15.870802 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 10:03:15.870802 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:03:15.870802 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:03:15.870802 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 300/593] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Jun 22 10:03:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:03:15.870802 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3978b4-da00-417e-8e05-30bc171fecc6 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:15.883301 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:15.888581 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:15.933955 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcc9857-c025-4d8b-a502-9dfbf59814cd None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:15.977109 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97c5620-29a1-46ab-a333-6f93b44a0cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:15.977940 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97c5620-29a1-46ab-a333-6f93b44a0cd4 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:15.978226 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97c5620-29a1-46ab-a333-6f93b44a0cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:15.978500 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97c5620-29a1-46ab-a333-6f93b44a0cd4 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:15.985896 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97c5620-29a1-46ab-a333-6f93b44a0cd4 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:15.987358 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97c5620-29a1-46ab-a333-6f93b44a0cd4 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:15.987962 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3978b4-da00-417e-8e05-30bc171fecc6 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:16.002663 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-f97c5620-29a1-46ab-a333-6f93b44a0cd4 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 22 10:03:16.002663 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:16.002663 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:16.002663 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:16.002663 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:16.002663 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:16.002663 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:16.002663 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:16.002663 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:16.002663 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:16.002663 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:16.002663 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:16.002663 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 10:03:16.002663 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 10:03:16.002663 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 10:03:16.002663 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 10:03:16.003715 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:16.003715 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:16.003715 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 10:03:16.003715 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:03:16.003715 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 10:03:16.003715 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:03:16.003715 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:16.003715 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:16.003715 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:16.003715 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:16.003715 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:16.003715 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:16.003715 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:16.003715 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:16.003715 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:16.003715 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:16.003715 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:16.003715 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:16.004730 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:16.004730 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:16.004730 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 10:03:16.004730 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 10:03:16.004730 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 10:03:16.004730 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 10:03:16.004730 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 10:03:16.004730 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 10:03:16.004730 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 22 10:03:16.004730 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:03:16.004730 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 294/594] 10.222.0.43 () {56 vars in 1102 bytes} [Wed Jun 22 10:03:15 2022] GET /identity/v3/users/neutron => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:03:16.005561 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e52415-d63e-45b7-9f8c-bea0eb93d516 None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:16.005865 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e52415-d63e-45b7-9f8c-bea0eb93d516 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:16.006142 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e52415-d63e-45b7-9f8c-bea0eb93d516 None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:16.007569 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 295/595] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:03:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:03:16.008089 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e52415-d63e-45b7-9f8c-bea0eb93d516 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:16.033596 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd46501b-b46d-474b-ba02-8c454071d3fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:16.034591 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd46501b-b46d-474b-ba02-8c454071d3fc None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:16.034944 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd46501b-b46d-474b-ba02-8c454071d3fc None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:16.035284 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd46501b-b46d-474b-ba02-8c454071d3fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:16.048737 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd46501b-b46d-474b-ba02-8c454071d3fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:16.050414 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd46501b-b46d-474b-ba02-8c454071d3fc None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:16.070582 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-bd46501b-b46d-474b-ba02-8c454071d3fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:03:16.070582 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:16.070582 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:16.070582 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:16.070582 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:16.070582 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:16.070582 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:16.070582 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:16.070582 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:16.070582 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:16.070582 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:16.070582 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:16.070582 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:03:16.070582 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:03:16.070582 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:03:16.071672 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:03:16.071672 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:16.071672 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:16.071672 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:16.071672 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:16.071672 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:16.071672 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:16.071672 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:16.071672 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:16.071672 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:16.071672 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:16.071672 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:16.071672 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:16.071672 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:16.071672 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:16.071672 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:16.071672 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:16.072617 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:03:16.072617 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:03:16.072617 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:03:16.072617 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:03:16.072617 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 301/596] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jun 22 10:03:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:03:16.072886 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd46501b-b46d-474b-ba02-8c454071d3fc None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:16.123072 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e52415-d63e-45b7-9f8c-bea0eb93d516 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:16.143820 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:16.149316 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:16.162812 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534b6913-ea2d-4ba5-9726-98840cc9fd62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:16.163476 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534b6913-ea2d-4ba5-9726-98840cc9fd62 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:16.163758 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534b6913-ea2d-4ba5-9726-98840cc9fd62 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:16.164034 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534b6913-ea2d-4ba5-9726-98840cc9fd62 None admin] PATH_INFO: `/v3/projects` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:16.164826 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534b6913-ea2d-4ba5-9726-98840cc9fd62 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:16.165134 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534b6913-ea2d-4ba5-9726-98840cc9fd62 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:16.166604 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534b6913-ea2d-4ba5-9726-98840cc9fd62 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:16.179835 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 296/597] 10.222.0.43 () {56 vars in 1148 bytes} [Wed Jun 22 10:03:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:16.181076 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02574e36-1068-46ba-b6d6-6b2062067e33 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:16.181364 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02574e36-1068-46ba-b6d6-6b2062067e33 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:16.181642 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02574e36-1068-46ba-b6d6-6b2062067e33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:16.195981 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd46501b-b46d-474b-ba02-8c454071d3fc None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:16.199103 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-02574e36-1068-46ba-b6d6-6b2062067e33 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:03:16.200279 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-02574e36-1068-46ba-b6d6-6b2062067e33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:03:16.232084 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f09373a-e4fc-4dd2-8fc4-89299226c8b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:16.232775 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f09373a-e4fc-4dd2-8fc4-89299226c8b4 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:16.233058 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f09373a-e4fc-4dd2-8fc4-89299226c8b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:16.233335 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f09373a-e4fc-4dd2-8fc4-89299226c8b4 None admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:16.234200 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f09373a-e4fc-4dd2-8fc4-89299226c8b4 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:16.234505 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f09373a-e4fc-4dd2-8fc4-89299226c8b4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:16.235923 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f09373a-e4fc-4dd2-8fc4-89299226c8b4 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:16.256205 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 302/598] 10.222.0.43 () {56 vars in 1139 bytes} [Wed Jun 22 10:03:16 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:16.257046 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f09373a-e4fc-4dd2-8fc4-89299226c8b4 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:16.282323 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 297/599] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:03:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 10:03:16.283141 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02574e36-1068-46ba-b6d6-6b2062067e33 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:16.377487 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f09373a-e4fc-4dd2-8fc4-89299226c8b4 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:16.397598 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:16.400416 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02574e36-1068-46ba-b6d6-6b2062067e33 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:16.416199 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:16.419363 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367aeda4-e0a8-4cca-9064-0470f3754406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:16.420035 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367aeda4-e0a8-4cca-9064-0470f3754406 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:16.420323 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367aeda4-e0a8-4cca-9064-0470f3754406 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:16.420604 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367aeda4-e0a8-4cca-9064-0470f3754406 None admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:16.421331 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367aeda4-e0a8-4cca-9064-0470f3754406 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:16.421641 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367aeda4-e0a8-4cca-9064-0470f3754406 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:16.423107 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367aeda4-e0a8-4cca-9064-0470f3754406 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:16.435161 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 303/600] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Jun 22 10:03:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:16.435989 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367aeda4-e0a8-4cca-9064-0470f3754406 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:16.443722 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182bce19-cef1-42c7-9bfd-1d55b79827c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:16.444834 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182bce19-cef1-42c7-9bfd-1d55b79827c2 None admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:16.445273 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182bce19-cef1-42c7-9bfd-1d55b79827c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:16.445718 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182bce19-cef1-42c7-9bfd-1d55b79827c2 None admin] PATH_INFO: `/v3/projects/e03f1c17e0884f188231d2949dc6f956/users/158a49aa3750478a84bf71b9aad24397/roles/18493ce78e7c480c9202245b6d93cb4c` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:16.461775 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182bce19-cef1-42c7-9bfd-1d55b79827c2 None admin] RBAC: Authorizing `identity:create_grant(project_id=e03f1c17e0884f188231d2949dc6f956, user_id=158a49aa3750478a84bf71b9aad24397, role_id=18493ce78e7c480c9202245b6d93cb4c)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:16.463433 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182bce19-cef1-42c7-9bfd-1d55b79827c2 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:16.489728 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 298/601] 10.222.0.43 () {58 vars in 1439 bytes} [Wed Jun 22 10:03:16 2022] PUT /identity/v3/projects/e03f1c17e0884f188231d2949dc6f956/users/158a49aa3750478a84bf71b9aad24397/roles/18493ce78e7c480c9202245b6d93cb4c => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:03:16.489728 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182bce19-cef1-42c7-9bfd-1d55b79827c2 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:16.590172 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367aeda4-e0a8-4cca-9064-0470f3754406 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:16.598302 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182bce19-cef1-42c7-9bfd-1d55b79827c2 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:16.638293 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587b7354-758c-445a-914a-06ce89768426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:16.639213 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587b7354-758c-445a-914a-06ce89768426 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:16.639662 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587b7354-758c-445a-914a-06ce89768426 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:16.640113 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587b7354-758c-445a-914a-06ce89768426 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:16.641128 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e676048-d4af-417d-93fe-c65a510189d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:16.642042 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e676048-d4af-417d-93fe-c65a510189d5 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:16.642501 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e676048-d4af-417d-93fe-c65a510189d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:16.642850 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e676048-d4af-417d-93fe-c65a510189d5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:16.655436 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587b7354-758c-445a-914a-06ce89768426 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:16.655700 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e676048-d4af-417d-93fe-c65a510189d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:03:16.657046 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587b7354-758c-445a-914a-06ce89768426 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:16.666933 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-2e676048-d4af-417d-93fe-c65a510189d5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 10:03:16.666933 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:16.666933 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:16.666933 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:16.666933 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:16.666933 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:16.666933 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:16.666933 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:16.666933 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:16.666933 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:16.666933 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:16.666933 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:16.666933 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:03:16.666933 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:03:16.666933 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:03:16.666933 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:03:16.667880 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:03:16.667880 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:03:16.667880 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:03:16.667880 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:03:16.667880 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:16.667880 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:16.667880 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:16.667880 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:16.667880 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:16.667880 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:16.667880 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:16.667880 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:16.667880 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:16.667880 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:16.667880 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:16.667880 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:16.668738 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:16.668738 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:16.668738 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:16.668738 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:16.668738 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:03:16.668738 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:03:16.668738 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:03:16.668738 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:03:16.668738 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:03:16.668738 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:03:16.668738 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 10:03:16.668738 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:03:16.669374 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 299/602] 10.222.0.43 () {56 vars in 1102 bytes} [Wed Jun 22 10:03:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:03:16.673712 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e676048-d4af-417d-93fe-c65a510189d5 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:16.676939 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-587b7354-758c-445a-914a-06ce89768426 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:03:16.676939 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:16.676939 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:16.676939 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:16.676939 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:16.676939 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:16.676939 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:16.676939 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:16.676939 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:16.676939 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:16.676939 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:16.676939 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:16.676939 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:03:16.676939 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:03:16.676939 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:03:16.679118 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:03:16.679118 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:16.679118 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:16.679118 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:16.679118 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:16.679118 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:16.679118 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:16.679118 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:16.679118 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:16.679118 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:16.679118 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:16.679118 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:16.679118 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:16.679118 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:16.679118 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:16.679118 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:16.679118 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:16.680621 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:03:16.680621 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:03:16.680621 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:03:16.680621 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:03:16.680621 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 304/603] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jun 22 10:03:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:03:16.680621 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587b7354-758c-445a-914a-06ce89768426 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:16.702284 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:16.718023 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:16.801168 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587b7354-758c-445a-914a-06ce89768426 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:16.810354 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e676048-d4af-417d-93fe-c65a510189d5 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:16.838758 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f0ea76-a01b-4b42-a3a3-e0a4e728ce8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:16.839439 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f0ea76-a01b-4b42-a3a3-e0a4e728ce8d None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:16.839725 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f0ea76-a01b-4b42-a3a3-e0a4e728ce8d None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:16.840005 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f0ea76-a01b-4b42-a3a3-e0a4e728ce8d None admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:16.840859 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f0ea76-a01b-4b42-a3a3-e0a4e728ce8d None admin] RBAC: Adding query filter params (name=service) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:16.841171 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f0ea76-a01b-4b42-a3a3-e0a4e728ce8d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:16.842719 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f0ea76-a01b-4b42-a3a3-e0a4e728ce8d None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:16.856616 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 305/604] 10.222.0.43 () {56 vars in 1103 bytes} [Wed Jun 22 10:03:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:16.856616 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f0ea76-a01b-4b42-a3a3-e0a4e728ce8d None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:16.860062 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f403e949-d196-4d97-8b70-64a94facffba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:16.861111 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f403e949-d196-4d97-8b70-64a94facffba None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:16.861580 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f403e949-d196-4d97-8b70-64a94facffba None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:16.862068 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f403e949-d196-4d97-8b70-64a94facffba None admin] PATH_INFO: `/v3/projects/service` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:16.872180 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f403e949-d196-4d97-8b70-64a94facffba None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:16.874369 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f403e949-d196-4d97-8b70-64a94facffba None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:16.894045 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-f403e949-d196-4d97-8b70-64a94facffba None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:03:16.894045 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:16.894045 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:16.894045 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:16.894045 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:16.894045 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:16.894045 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:16.894045 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:16.894045 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:16.894045 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:16.894045 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:16.894045 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:16.894045 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 10:03:16.894045 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 10:03:16.894045 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 10:03:16.894967 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 10:03:16.894967 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:16.894967 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:16.894967 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:16.894967 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:16.894967 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:16.894967 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:16.894967 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:16.894967 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:16.894967 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:16.894967 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:16.894967 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:16.894967 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:16.894967 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:16.894967 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:16.894967 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:16.894967 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:16.895865 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 10:03:16.895865 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 10:03:16.895865 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 10:03:16.895865 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 10:03:16.895865 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 10:03:16.895865 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 10:03:16.895865 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:03:16.895865 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:03:16.898626 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 300/605] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Jun 22 10:03:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:03:16.899625 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f403e949-d196-4d97-8b70-64a94facffba None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:16.979216 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:16.991125 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f0ea76-a01b-4b42-a3a3-e0a4e728ce8d None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:17.000021 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:17.022393 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f403e949-d196-4d97-8b70-64a94facffba None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:17.044500 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dbe762-6168-4a31-be26-da49bc36b598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:17.045966 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dbe762-6168-4a31-be26-da49bc36b598 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:17.046411 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dbe762-6168-4a31-be26-da49bc36b598 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:17.047011 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dbe762-6168-4a31-be26-da49bc36b598 None admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:17.048009 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dbe762-6168-4a31-be26-da49bc36b598 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:17.048723 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dbe762-6168-4a31-be26-da49bc36b598 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:17.051018 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dbe762-6168-4a31-be26-da49bc36b598 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:17.060842 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed41f1cc-8cf2-47ac-ab4b-4a99ab132b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:17.061759 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed41f1cc-8cf2-47ac-ab4b-4a99ab132b42 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:17.062124 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed41f1cc-8cf2-47ac-ab4b-4a99ab132b42 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:17.062476 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed41f1cc-8cf2-47ac-ab4b-4a99ab132b42 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:17.067409 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 306/606] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Jun 22 10:03:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:17.068429 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dbe762-6168-4a31-be26-da49bc36b598 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:17.078034 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed41f1cc-8cf2-47ac-ab4b-4a99ab132b42 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:17.079514 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed41f1cc-8cf2-47ac-ab4b-4a99ab132b42 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:17.109952 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-ed41f1cc-8cf2-47ac-ab4b-4a99ab132b42 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:03:17.109952 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:17.109952 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:17.109952 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:17.109952 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:17.109952 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:17.109952 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:17.109952 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:17.109952 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:17.109952 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:17.109952 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:17.109952 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:17.109952 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:03:17.109952 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:03:17.109952 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:03:17.111030 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:03:17.111030 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:17.111030 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:17.111030 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:17.111030 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:17.111030 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:17.111030 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:17.111030 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:17.111030 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:17.111030 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:17.111030 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:17.111030 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:17.111030 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:17.111030 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:17.111030 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:17.111030 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:17.111030 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:17.111988 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:03:17.111988 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:03:17.111988 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:03:17.111988 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:03:17.117463 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 301/607] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jun 22 10:03:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:03:17.118350 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed41f1cc-8cf2-47ac-ab4b-4a99ab132b42 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:17.211043 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dbe762-6168-4a31-be26-da49bc36b598 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:17.230099 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed41f1cc-8cf2-47ac-ab4b-4a99ab132b42 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:17.259461 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ff1f4f-9504-4372-8243-fc1954692195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:17.260155 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ff1f4f-9504-4372-8243-fc1954692195 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:17.260442 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ff1f4f-9504-4372-8243-fc1954692195 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:17.260723 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ff1f4f-9504-4372-8243-fc1954692195 None admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:17.261518 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ff1f4f-9504-4372-8243-fc1954692195 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:17.261858 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ff1f4f-9504-4372-8243-fc1954692195 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:17.263306 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ff1f4f-9504-4372-8243-fc1954692195 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:17.275952 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 307/608] 10.222.0.43 () {56 vars in 1148 bytes} [Wed Jun 22 10:03:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:17.276813 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9890be-c9c9-4ee5-a3ed-f6528fdc2f2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:17.276979 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ff1f4f-9504-4372-8243-fc1954692195 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:17.278001 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9890be-c9c9-4ee5-a3ed-f6528fdc2f2a None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:17.278496 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9890be-c9c9-4ee5-a3ed-f6528fdc2f2a None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:17.278932 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9890be-c9c9-4ee5-a3ed-f6528fdc2f2a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:17.282432 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:17.291430 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9890be-c9c9-4ee5-a3ed-f6528fdc2f2a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:17.293489 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9890be-c9c9-4ee5-a3ed-f6528fdc2f2a None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:17.294096 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:17.314282 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-af9890be-c9c9-4ee5-a3ed-f6528fdc2f2a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:03:17.314282 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:17.314282 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:17.314282 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:17.314282 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:17.314282 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:17.314282 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:17.314282 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:17.314282 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:17.314282 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:17.314282 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:17.314282 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:17.314282 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 10:03:17.314282 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 10:03:17.314282 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 10:03:17.315466 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 10:03:17.315466 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:17.315466 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:17.315466 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:17.315466 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:17.315466 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:17.315466 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:17.315466 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:17.315466 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:17.315466 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:17.315466 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:17.315466 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:17.315466 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:17.315466 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:17.315466 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:17.315466 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:17.315466 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:17.316612 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 10:03:17.316612 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 10:03:17.316612 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 10:03:17.316612 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 10:03:17.316612 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 10:03:17.316612 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 10:03:17.316612 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:03:17.316612 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:03:17.319594 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 302/609] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Jun 22 10:03:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:03:17.320549 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9890be-c9c9-4ee5-a3ed-f6528fdc2f2a None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:17.420093 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ff1f4f-9504-4372-8243-fc1954692195 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:17.435964 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9890be-c9c9-4ee5-a3ed-f6528fdc2f2a None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:17.467223 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb44dfc-9edf-41b5-b65e-91775360447a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:17.468795 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb44dfc-9edf-41b5-b65e-91775360447a None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:17.469247 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb44dfc-9edf-41b5-b65e-91775360447a None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:17.469966 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb44dfc-9edf-41b5-b65e-91775360447a None admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:17.470727 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb44dfc-9edf-41b5-b65e-91775360447a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:17.471043 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb44dfc-9edf-41b5-b65e-91775360447a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:17.472433 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb44dfc-9edf-41b5-b65e-91775360447a None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:17.478769 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc766c0-d0bf-4147-bcc9-af1f970396fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:17.479942 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc766c0-d0bf-4147-bcc9-af1f970396fb None admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:17.481041 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc766c0-d0bf-4147-bcc9-af1f970396fb None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:17.481502 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc766c0-d0bf-4147-bcc9-af1f970396fb None admin] PATH_INFO: `/v3/projects/e03f1c17e0884f188231d2949dc6f956/users/9bbcb3d4dc704dfdb0097abc594ca855/roles/18493ce78e7c480c9202245b6d93cb4c` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:17.491862 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 308/610] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Jun 22 10:03:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:17.492864 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb44dfc-9edf-41b5-b65e-91775360447a None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:17.500607 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc766c0-d0bf-4147-bcc9-af1f970396fb None admin] RBAC: Authorizing `identity:create_grant(project_id=e03f1c17e0884f188231d2949dc6f956, user_id=9bbcb3d4dc704dfdb0097abc594ca855, role_id=18493ce78e7c480c9202245b6d93cb4c)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:17.502833 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc766c0-d0bf-4147-bcc9-af1f970396fb None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:17.523504 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 303/611] 10.222.0.43 () {58 vars in 1439 bytes} [Wed Jun 22 10:03:17 2022] PUT /identity/v3/projects/e03f1c17e0884f188231d2949dc6f956/users/9bbcb3d4dc704dfdb0097abc594ca855/roles/18493ce78e7c480c9202245b6d93cb4c => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:03:17.525361 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc766c0-d0bf-4147-bcc9-af1f970396fb None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:17.574139 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:17.604755 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:17.621007 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb44dfc-9edf-41b5-b65e-91775360447a None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:17.692822 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73286ec2-a343-4cfe-b30b-5ec3e8cea4e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:17.693582 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73286ec2-a343-4cfe-b30b-5ec3e8cea4e8 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:17.694051 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73286ec2-a343-4cfe-b30b-5ec3e8cea4e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:17.695806 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73286ec2-a343-4cfe-b30b-5ec3e8cea4e8 None admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:17.696644 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73286ec2-a343-4cfe-b30b-5ec3e8cea4e8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:17.696958 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73286ec2-a343-4cfe-b30b-5ec3e8cea4e8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:17.699354 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73286ec2-a343-4cfe-b30b-5ec3e8cea4e8 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:17.718366 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc766c0-d0bf-4147-bcc9-af1f970396fb None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:17.731761 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 309/612] 10.222.0.43 () {56 vars in 1148 bytes} [Wed Jun 22 10:03:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:17.741337 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73286ec2-a343-4cfe-b30b-5ec3e8cea4e8 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:17.774659 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0eafb35-4f8a-434e-b994-17dab3d80855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:17.775273 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eafb35-4f8a-434e-b994-17dab3d80855 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:17.775558 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eafb35-4f8a-434e-b994-17dab3d80855 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:17.775883 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eafb35-4f8a-434e-b994-17dab3d80855 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:17.786852 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0eafb35-4f8a-434e-b994-17dab3d80855 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:17.788424 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0eafb35-4f8a-434e-b994-17dab3d80855 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:17.805164 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-b0eafb35-4f8a-434e-b994-17dab3d80855 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 22 10:03:17.805164 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:17.805164 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:17.805164 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:17.805164 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:17.805164 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:17.805164 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:17.805164 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:17.805164 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:17.805164 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:17.805164 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:17.805164 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:17.805164 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 10:03:17.805164 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 10:03:17.805164 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 10:03:17.805164 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 10:03:17.806202 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:17.806202 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:17.806202 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 10:03:17.806202 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:03:17.806202 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 10:03:17.806202 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:03:17.806202 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:17.806202 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:17.806202 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:17.806202 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:17.806202 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:17.806202 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:17.806202 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:17.806202 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:17.806202 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:17.806202 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:17.806202 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:17.806202 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:17.807130 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:17.807130 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:17.807130 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 10:03:17.807130 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 10:03:17.807130 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 10:03:17.807130 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 10:03:17.807130 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 10:03:17.807130 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 10:03:17.807130 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 22 10:03:17.807130 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:03:17.807130 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 304/613] 10.222.0.43 () {56 vars in 1096 bytes} [Wed Jun 22 10:03:17 2022] GET /identity/v3/users/swift => generated 83 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:03:17.812232 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0eafb35-4f8a-434e-b994-17dab3d80855 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:17.860873 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73286ec2-a343-4cfe-b30b-5ec3e8cea4e8 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:17.893152 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:17.903052 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce06fbc-da7e-460c-bdd8-c564e456c3f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:17.904264 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce06fbc-da7e-460c-bdd8-c564e456c3f4 None admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:17.904893 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce06fbc-da7e-460c-bdd8-c564e456c3f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:17.906068 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce06fbc-da7e-460c-bdd8-c564e456c3f4 None admin] PATH_INFO: `/v3/projects/e03f1c17e0884f188231d2949dc6f956/users/fe93d4c0737249fd8623bb5ce188e34e/roles/18493ce78e7c480c9202245b6d93cb4c` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:17.941158 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce06fbc-da7e-460c-bdd8-c564e456c3f4 None admin] RBAC: Authorizing `identity:create_grant(project_id=e03f1c17e0884f188231d2949dc6f956, user_id=fe93d4c0737249fd8623bb5ce188e34e, role_id=18493ce78e7c480c9202245b6d93cb4c)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:17.943536 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce06fbc-da7e-460c-bdd8-c564e456c3f4 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:17.971801 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 310/614] 10.222.0.43 () {58 vars in 1439 bytes} [Wed Jun 22 10:03:17 2022] PUT /identity/v3/projects/e03f1c17e0884f188231d2949dc6f956/users/fe93d4c0737249fd8623bb5ce188e34e/roles/18493ce78e7c480c9202245b6d93cb4c => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:03:17.981090 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253fa015-c451-4b91-910b-0e546a828f30 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:17.981441 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253fa015-c451-4b91-910b-0e546a828f30 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:17.981649 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253fa015-c451-4b91-910b-0e546a828f30 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:17.983241 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 311/615] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:03:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 10:03:17.987235 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0eafb35-4f8a-434e-b994-17dab3d80855 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:17.989288 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa7e686-5f76-42d6-a31f-bd2f9ffc457b None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:17.989566 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa7e686-5f76-42d6-a31f-bd2f9ffc457b None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:17.989873 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa7e686-5f76-42d6-a31f-bd2f9ffc457b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:17.998021 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:18.018833 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-4fa7e686-5f76-42d6-a31f-bd2f9ffc457b None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:03:18.020769 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-4fa7e686-5f76-42d6-a31f-bd2f9ffc457b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:03:18.058929 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd161a4-2ade-4d31-8820-0aec00ac2174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:18.060094 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd161a4-2ade-4d31-8820-0aec00ac2174 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:18.060558 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd161a4-2ade-4d31-8820-0aec00ac2174 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:18.061020 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd161a4-2ade-4d31-8820-0aec00ac2174 None admin] PATH_INFO: `/v3/users` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:18.062189 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd161a4-2ade-4d31-8820-0aec00ac2174 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:18.062756 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd161a4-2ade-4d31-8820-0aec00ac2174 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:18.064384 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd161a4-2ade-4d31-8820-0aec00ac2174 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:18.098297 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 305/616] 10.222.0.43 () {56 vars in 1135 bytes} [Wed Jun 22 10:03:17 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:03:18.109340 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd161a4-2ade-4d31-8820-0aec00ac2174 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:18.126514 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 312/617] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:03:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 10:03:18.164647 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa7e686-5f76-42d6-a31f-bd2f9ffc457b None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:18.272552 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd161a4-2ade-4d31-8820-0aec00ac2174 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:18.283256 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa7e686-5f76-42d6-a31f-bd2f9ffc457b None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:18.299302 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:18.313747 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a98e967-cc2b-4904-bdf0-378d955627b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:18.314923 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a98e967-cc2b-4904-bdf0-378d955627b3 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:18.315325 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a98e967-cc2b-4904-bdf0-378d955627b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:18.315830 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a98e967-cc2b-4904-bdf0-378d955627b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:18.322794 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973d8548-f0ca-4608-a1b9-ade56c611ed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:18.323614 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973d8548-f0ca-4608-a1b9-ade56c611ed1 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:18.323909 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973d8548-f0ca-4608-a1b9-ade56c611ed1 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:18.324196 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973d8548-f0ca-4608-a1b9-ade56c611ed1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:18.331109 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a98e967-cc2b-4904-bdf0-378d955627b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:18.333139 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a98e967-cc2b-4904-bdf0-378d955627b3 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:18.337904 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973d8548-f0ca-4608-a1b9-ade56c611ed1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:03:18.346875 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-973d8548-f0ca-4608-a1b9-ade56c611ed1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 10:03:18.346875 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:18.346875 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:18.346875 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:18.346875 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:18.346875 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:18.346875 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:18.346875 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:18.346875 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:18.346875 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:18.346875 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:18.346875 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:18.346875 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:03:18.346875 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:03:18.346875 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:03:18.346875 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:03:18.347926 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:03:18.347926 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:03:18.347926 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:03:18.347926 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:03:18.347926 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:18.347926 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:18.347926 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:18.347926 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:18.347926 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:18.347926 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:18.347926 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:18.347926 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:18.347926 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:18.347926 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:18.347926 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:18.347926 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:18.348968 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:18.348968 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:18.348968 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:18.348968 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:18.348968 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:03:18.348968 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:03:18.348968 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:03:18.348968 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:03:18.348968 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:03:18.348968 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:03:18.348968 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 10:03:18.348968 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:03:18.355413 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 313/618] 10.222.0.43 () {56 vars in 1102 bytes} [Wed Jun 22 10:03:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 10:03:18.359089 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-8a98e967-cc2b-4904-bdf0-378d955627b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:03:18.359089 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:18.359089 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:18.359089 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:18.359089 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:18.359089 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:18.359089 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:18.359089 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:18.359089 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:18.359089 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:18.359089 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:18.359089 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:18.359089 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:03:18.359089 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:03:18.359089 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:03:18.360087 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:03:18.360087 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:18.360087 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:18.360087 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:18.360087 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:18.360087 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:18.360087 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:18.360087 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:18.360087 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:18.360087 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:18.360087 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:18.360087 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:18.360087 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:18.360087 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:18.360087 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:18.360087 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:18.360087 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:18.361291 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:03:18.361291 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:03:18.361291 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:03:18.361291 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:03:18.361539 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973d8548-f0ca-4608-a1b9-ade56c611ed1 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:18.362898 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 306/619] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jun 22 10:03:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 10:03:18.369243 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a98e967-cc2b-4904-bdf0-378d955627b3 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:18.394085 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:18.518648 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a98e967-cc2b-4904-bdf0-378d955627b3 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:18.540995 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973d8548-f0ca-4608-a1b9-ade56c611ed1 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:18.581541 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7c8a2e-9d36-4d69-b2ea-f9a99a19a280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:18.583024 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7c8a2e-9d36-4d69-b2ea-f9a99a19a280 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:18.583597 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7c8a2e-9d36-4d69-b2ea-f9a99a19a280 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:18.584151 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7c8a2e-9d36-4d69-b2ea-f9a99a19a280 None admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:18.585333 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7c8a2e-9d36-4d69-b2ea-f9a99a19a280 None admin] RBAC: Adding query filter params (name=service) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:18.585855 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7c8a2e-9d36-4d69-b2ea-f9a99a19a280 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:18.587406 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7c8a2e-9d36-4d69-b2ea-f9a99a19a280 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:18.597257 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 314/620] 10.222.0.43 () {56 vars in 1103 bytes} [Wed Jun 22 10:03:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:03:18.599741 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602c5f3c-60e0-43b5-b32f-49a02602811e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:18.600868 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602c5f3c-60e0-43b5-b32f-49a02602811e None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:18.601312 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602c5f3c-60e0-43b5-b32f-49a02602811e None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:18.601779 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602c5f3c-60e0-43b5-b32f-49a02602811e None admin] PATH_INFO: `/v3/domains` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:18.602734 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602c5f3c-60e0-43b5-b32f-49a02602811e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:18.603727 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7c8a2e-9d36-4d69-b2ea-f9a99a19a280 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:18.604570 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602c5f3c-60e0-43b5-b32f-49a02602811e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:18.608293 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602c5f3c-60e0-43b5-b32f-49a02602811e None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:18.632550 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 307/621] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Jun 22 10:03:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:03:18.637784 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602c5f3c-60e0-43b5-b32f-49a02602811e None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:18.673795 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:18.763714 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:18.801714 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602c5f3c-60e0-43b5-b32f-49a02602811e None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:18.819824 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7c8a2e-9d36-4d69-b2ea-f9a99a19a280 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:18.843668 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f516e0e-cf77-49b9-988a-7682cb07e805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:18.844805 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f516e0e-cf77-49b9-988a-7682cb07e805 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:18.845956 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f516e0e-cf77-49b9-988a-7682cb07e805 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:18.846551 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f516e0e-cf77-49b9-988a-7682cb07e805 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:18.862452 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f516e0e-cf77-49b9-988a-7682cb07e805 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:18.864441 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f516e0e-cf77-49b9-988a-7682cb07e805 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:18.893537 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59845e7-a5ce-435a-889d-a5c7037dd93b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:18.894631 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59845e7-a5ce-435a-889d-a5c7037dd93b None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:18.895067 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59845e7-a5ce-435a-889d-a5c7037dd93b None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:18.896281 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59845e7-a5ce-435a-889d-a5c7037dd93b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:18.897720 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-5f516e0e-cf77-49b9-988a-7682cb07e805 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:03:18.897720 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:18.897720 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:18.897720 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:18.897720 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:18.897720 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:18.897720 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:18.897720 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:18.897720 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:18.897720 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:18.897720 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:18.897720 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:18.897720 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 10:03:18.897720 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 10:03:18.897720 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 10:03:18.898819 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 10:03:18.898819 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:18.898819 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:18.898819 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:18.898819 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:18.898819 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:18.898819 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:18.898819 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:18.898819 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:18.898819 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:18.898819 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:18.898819 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:18.898819 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:18.898819 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:18.898819 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:18.898819 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:18.898819 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:18.899966 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 10:03:18.899966 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 10:03:18.899966 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 10:03:18.899966 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 10:03:18.899966 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 10:03:18.899966 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 10:03:18.899966 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:03:18.899966 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:03:18.902062 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 308/622] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Jun 22 10:03:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:03:18.912174 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb0011a-bb56-4737-aed2-7a42d7978c47 None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:18.912705 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb0011a-bb56-4737-aed2-7a42d7978c47 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:18.913193 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb0011a-bb56-4737-aed2-7a42d7978c47 None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:18.916095 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 309/623] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:03:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 10:03:18.916237 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59845e7-a5ce-435a-889d-a5c7037dd93b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:18.917666 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59845e7-a5ce-435a-889d-a5c7037dd93b None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:18.920163 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb0011a-bb56-4737-aed2-7a42d7978c47 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:18.938173 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-a59845e7-a5ce-435a-889d-a5c7037dd93b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:03:18.938173 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:18.938173 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:18.938173 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:18.938173 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:18.938173 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:18.938173 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:18.938173 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:18.938173 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:18.938173 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:18.938173 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:18.938173 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:18.938173 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:03:18.938173 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:03:18.938173 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:03:18.939327 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:03:18.939327 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:18.939327 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:18.939327 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:18.939327 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:18.939327 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:18.939327 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:18.939327 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:18.939327 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:18.939327 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:18.939327 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:18.939327 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:18.939327 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:18.939327 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:18.939327 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:18.939327 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:18.939327 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:18.940605 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:03:18.940605 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:03:18.940605 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:03:18.940605 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:03:18.940605 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 315/624] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jun 22 10:03:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:03:18.940964 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29c6f54-d02f-42db-9db3-a38445fa2478 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:18.941273 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29c6f54-d02f-42db-9db3-a38445fa2478 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:18.941503 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29c6f54-d02f-42db-9db3-a38445fa2478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:18.958729 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-a29c6f54-d02f-42db-9db3-a38445fa2478 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:03:18.959870 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-a29c6f54-d02f-42db-9db3-a38445fa2478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:03:19.033735 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 316/625] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:03:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 10:03:19.034047 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29c6f54-d02f-42db-9db3-a38445fa2478 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:19.052179 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:19.052332 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb0011a-bb56-4737-aed2-7a42d7978c47 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:19.104278 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae818d8-e610-4f8c-96e7-e2618c1627a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:19.104943 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae818d8-e610-4f8c-96e7-e2618c1627a6 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:19.105232 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae818d8-e610-4f8c-96e7-e2618c1627a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:19.105568 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae818d8-e610-4f8c-96e7-e2618c1627a6 None admin] PATH_INFO: `/v3/projects` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:19.106336 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae818d8-e610-4f8c-96e7-e2618c1627a6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:19.106654 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae818d8-e610-4f8c-96e7-e2618c1627a6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:19.108463 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae818d8-e610-4f8c-96e7-e2618c1627a6 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:19.110018 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:19.123048 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 310/626] 10.222.0.43 () {56 vars in 1148 bytes} [Wed Jun 22 10:03:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:19.128305 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae818d8-e610-4f8c-96e7-e2618c1627a6 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:19.157830 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29c6f54-d02f-42db-9db3-a38445fa2478 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:19.194257 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670a97c2-c519-438a-acd8-2bdab477ff1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:19.195262 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670a97c2-c519-438a-acd8-2bdab477ff1d None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:19.195786 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670a97c2-c519-438a-acd8-2bdab477ff1d None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:19.196215 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670a97c2-c519-438a-acd8-2bdab477ff1d None admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:19.197096 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670a97c2-c519-438a-acd8-2bdab477ff1d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:19.197561 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670a97c2-c519-438a-acd8-2bdab477ff1d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:19.199211 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670a97c2-c519-438a-acd8-2bdab477ff1d None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:19.212350 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 317/627] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Jun 22 10:03:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:19.213413 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670a97c2-c519-438a-acd8-2bdab477ff1d None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:19.232595 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae818d8-e610-4f8c-96e7-e2618c1627a6 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:19.269833 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b983ca-a62d-44d8-b3fe-715e1d8d3b1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:19.271165 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b983ca-a62d-44d8-b3fe-715e1d8d3b1b None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:19.271456 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b983ca-a62d-44d8-b3fe-715e1d8d3b1b None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:19.271736 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b983ca-a62d-44d8-b3fe-715e1d8d3b1b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:19.282930 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b983ca-a62d-44d8-b3fe-715e1d8d3b1b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:03:19.291784 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-98b983ca-a62d-44d8-b3fe-715e1d8d3b1b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 10:03:19.291784 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:19.291784 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:19.291784 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:19.291784 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:19.291784 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:19.291784 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:19.291784 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:19.291784 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:19.291784 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:19.291784 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:19.291784 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:19.291784 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:03:19.291784 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:03:19.291784 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:03:19.291784 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:03:19.295869 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:03:19.295869 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:03:19.295869 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:03:19.295869 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:03:19.295869 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:19.295869 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:19.295869 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:19.295869 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:19.295869 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:19.295869 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:19.295869 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:19.295869 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:19.295869 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:19.295869 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:19.295869 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:19.295869 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:19.296813 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:19.296813 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:19.296813 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:19.296813 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:19.296813 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:03:19.296813 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:03:19.296813 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:03:19.296813 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:03:19.296813 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:03:19.296813 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:03:19.296813 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 10:03:19.296813 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:03:19.297924 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 311/628] 10.222.0.43 () {56 vars in 1102 bytes} [Wed Jun 22 10:03:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:03:19.298777 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b983ca-a62d-44d8-b3fe-715e1d8d3b1b None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:19.305941 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:19.332585 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670a97c2-c519-438a-acd8-2bdab477ff1d None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:19.365880 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:19.372949 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc978bb7-c612-4a9a-b32f-4e1209dab5de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:19.375306 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc978bb7-c612-4a9a-b32f-4e1209dab5de None admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:19.376096 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc978bb7-c612-4a9a-b32f-4e1209dab5de None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:19.376567 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc978bb7-c612-4a9a-b32f-4e1209dab5de None admin] PATH_INFO: `/v3/projects/e03f1c17e0884f188231d2949dc6f956/users/9566f8cca2574f4cb5edcbf384f368a7/roles/18493ce78e7c480c9202245b6d93cb4c` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:19.397882 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc978bb7-c612-4a9a-b32f-4e1209dab5de None admin] RBAC: Authorizing `identity:create_grant(project_id=e03f1c17e0884f188231d2949dc6f956, user_id=9566f8cca2574f4cb5edcbf384f368a7, role_id=18493ce78e7c480c9202245b6d93cb4c)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:19.400670 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc978bb7-c612-4a9a-b32f-4e1209dab5de None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:19.428658 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b983ca-a62d-44d8-b3fe-715e1d8d3b1b None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:19.428860 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 318/629] 10.222.0.43 () {58 vars in 1439 bytes} [Wed Jun 22 10:03:19 2022] PUT /identity/v3/projects/e03f1c17e0884f188231d2949dc6f956/users/9566f8cca2574f4cb5edcbf384f368a7/roles/18493ce78e7c480c9202245b6d93cb4c => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:03:19.428860 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc978bb7-c612-4a9a-b32f-4e1209dab5de None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:19.505434 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a85b3c-3aa4-4bbf-9acc-5a047c1646eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:19.508660 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a85b3c-3aa4-4bbf-9acc-5a047c1646eb None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:19.509395 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a85b3c-3aa4-4bbf-9acc-5a047c1646eb None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:19.509726 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a85b3c-3aa4-4bbf-9acc-5a047c1646eb None admin] PATH_INFO: `/v3/users/glance` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:19.531921 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a85b3c-3aa4-4bbf-9acc-5a047c1646eb None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:19.533538 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a85b3c-3aa4-4bbf-9acc-5a047c1646eb None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:19.571973 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-22a85b3c-3aa4-4bbf-9acc-5a047c1646eb None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 22 10:03:19.571973 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:19.571973 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:19.571973 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:19.571973 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:19.571973 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:19.571973 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:19.571973 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:19.571973 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:19.571973 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:19.571973 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:19.571973 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:19.571973 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 10:03:19.571973 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 10:03:19.571973 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 10:03:19.571973 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 10:03:19.572967 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:19.572967 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:19.572967 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 10:03:19.572967 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:03:19.572967 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 10:03:19.572967 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:03:19.572967 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:19.572967 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:19.572967 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:19.572967 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:19.572967 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:19.572967 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:19.572967 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:19.572967 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:19.572967 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:19.572967 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:19.572967 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:19.572967 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:19.573964 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:19.573964 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:19.573964 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 10:03:19.573964 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 10:03:19.573964 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 10:03:19.573964 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 10:03:19.573964 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 10:03:19.573964 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 10:03:19.573964 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 22 10:03:19.573964 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:03:19.573964 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 312/630] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Jun 22 10:03:19 2022] GET /identity/v3/users/glance => generated 84 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:03:19.580718 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a85b3c-3aa4-4bbf-9acc-5a047c1646eb None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:19.638750 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc978bb7-c612-4a9a-b32f-4e1209dab5de None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:19.675880 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:19.688855 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cf5a70-8e46-44ee-a973-85cc406644cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:19.689857 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cf5a70-8e46-44ee-a973-85cc406644cc None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:19.690309 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cf5a70-8e46-44ee-a973-85cc406644cc None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:19.690793 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cf5a70-8e46-44ee-a973-85cc406644cc None admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:19.693214 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cf5a70-8e46-44ee-a973-85cc406644cc None admin] RBAC: Adding query filter params (name=service) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:19.693759 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cf5a70-8e46-44ee-a973-85cc406644cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:19.695407 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cf5a70-8e46-44ee-a973-85cc406644cc None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:19.706333 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 319/631] 10.222.0.43 () {56 vars in 1103 bytes} [Wed Jun 22 10:03:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:19.712260 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cf5a70-8e46-44ee-a973-85cc406644cc None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:19.750293 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a85b3c-3aa4-4bbf-9acc-5a047c1646eb None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:19.772270 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:19.798562 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108c0cde-d465-41cf-8626-ac5b2bdc6b32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:19.799638 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108c0cde-d465-41cf-8626-ac5b2bdc6b32 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:19.800144 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108c0cde-d465-41cf-8626-ac5b2bdc6b32 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:19.800638 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108c0cde-d465-41cf-8626-ac5b2bdc6b32 None admin] PATH_INFO: `/v3/users` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:19.803930 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108c0cde-d465-41cf-8626-ac5b2bdc6b32 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:19.804540 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108c0cde-d465-41cf-8626-ac5b2bdc6b32 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:19.806268 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108c0cde-d465-41cf-8626-ac5b2bdc6b32 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:19.828724 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 313/632] 10.222.0.43 () {56 vars in 1137 bytes} [Wed Jun 22 10:03:19 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:03:19.834451 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108c0cde-d465-41cf-8626-ac5b2bdc6b32 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:19.924972 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cf5a70-8e46-44ee-a973-85cc406644cc None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:19.964406 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a022e70-6647-4952-baab-22694cf41023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:19.965575 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a022e70-6647-4952-baab-22694cf41023 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:19.966121 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a022e70-6647-4952-baab-22694cf41023 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:19.966404 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a022e70-6647-4952-baab-22694cf41023 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:19.981075 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a022e70-6647-4952-baab-22694cf41023 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:19.982560 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a022e70-6647-4952-baab-22694cf41023 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:19.993348 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108c0cde-d465-41cf-8626-ac5b2bdc6b32 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:20.001010 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-1a022e70-6647-4952-baab-22694cf41023 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:03:20.001010 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:20.001010 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:20.001010 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:20.001010 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:20.001010 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:20.001010 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:20.001010 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:20.001010 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:20.001010 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:20.001010 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:20.001010 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:20.001010 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:03:20.001010 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:03:20.001010 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:03:20.001930 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:03:20.001930 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:20.001930 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:20.001930 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:20.001930 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:20.001930 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:20.001930 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:20.001930 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:20.001930 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:20.001930 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:20.001930 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:20.001930 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:20.001930 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:20.001930 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:20.001930 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:20.001930 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:20.001930 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:20.002834 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:03:20.002834 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:03:20.002834 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:03:20.002834 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:03:20.002834 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 320/633] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jun 22 10:03:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:03:20.009737 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfed05f-6f4c-40f2-9aea-02a801969007 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:20.009737 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfed05f-6f4c-40f2-9aea-02a801969007 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:20.009737 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfed05f-6f4c-40f2-9aea-02a801969007 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:20.009737 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 321/634] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:03:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:03:20.009737 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfed05f-6f4c-40f2-9aea-02a801969007 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:20.040111 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7f09b8-552a-434a-8c27-2c4b6bb9cea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:20.040789 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7f09b8-552a-434a-8c27-2c4b6bb9cea9 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:20.041132 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7f09b8-552a-434a-8c27-2c4b6bb9cea9 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:20.041412 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7f09b8-552a-434a-8c27-2c4b6bb9cea9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:20.060970 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:20.087485 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:20.117477 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7f09b8-552a-434a-8c27-2c4b6bb9cea9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:20.119036 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7f09b8-552a-434a-8c27-2c4b6bb9cea9 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:20.144532 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfed05f-6f4c-40f2-9aea-02a801969007 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:20.180948 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e6f502-7b57-43b1-8b47-2f88a84fdc30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:20.181512 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e6f502-7b57-43b1-8b47-2f88a84fdc30 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:20.181828 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e6f502-7b57-43b1-8b47-2f88a84fdc30 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:20.182109 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e6f502-7b57-43b1-8b47-2f88a84fdc30 None admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:20.182832 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e6f502-7b57-43b1-8b47-2f88a84fdc30 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:20.183139 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e6f502-7b57-43b1-8b47-2f88a84fdc30 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:20.184500 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e6f502-7b57-43b1-8b47-2f88a84fdc30 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:20.196981 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 322/635] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Jun 22 10:03:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:20.198419 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5a4793-fe0a-4d2d-b5f3-108b1da39b65 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:20.198648 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5a4793-fe0a-4d2d-b5f3-108b1da39b65 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:20.198928 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5a4793-fe0a-4d2d-b5f3-108b1da39b65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:20.215954 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-4d5a4793-fe0a-4d2d-b5f3-108b1da39b65 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:03:20.217128 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-4d5a4793-fe0a-4d2d-b5f3-108b1da39b65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:03:20.251128 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 314/636] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Jun 22 10:03:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 10:03:20.252053 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7f09b8-552a-434a-8c27-2c4b6bb9cea9 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:20.302088 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 323/637] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:03:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 10:03:20.302088 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5a4793-fe0a-4d2d-b5f3-108b1da39b65 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:20.341158 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:20.360434 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:20.398524 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7f09b8-552a-434a-8c27-2c4b6bb9cea9 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:20.421038 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5a4793-fe0a-4d2d-b5f3-108b1da39b65 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:20.441628 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8124d9-f04c-4805-90c0-c530a981dc93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:20.443635 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8124d9-f04c-4805-90c0-c530a981dc93 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:20.444354 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8124d9-f04c-4805-90c0-c530a981dc93 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:20.445241 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8124d9-f04c-4805-90c0-c530a981dc93 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:20.454705 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8124d9-f04c-4805-90c0-c530a981dc93 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:20.455428 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d79674-c21f-4dab-baf2-2b7d94aa58ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:20.456296 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d79674-c21f-4dab-baf2-2b7d94aa58ff None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:20.456585 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d79674-c21f-4dab-baf2-2b7d94aa58ff None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:20.456863 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d79674-c21f-4dab-baf2-2b7d94aa58ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:20.457057 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8124d9-f04c-4805-90c0-c530a981dc93 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:20.467745 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d79674-c21f-4dab-baf2-2b7d94aa58ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:20.469186 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d79674-c21f-4dab-baf2-2b7d94aa58ff None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:20.475253 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-7d8124d9-f04c-4805-90c0-c530a981dc93 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 22 10:03:20.475253 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:20.475253 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:20.475253 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:20.475253 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:20.475253 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:20.475253 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:20.475253 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:20.475253 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:20.475253 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:20.475253 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:20.475253 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:20.475253 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 10:03:20.475253 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 10:03:20.475253 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 10:03:20.475253 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 10:03:20.476482 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:20.476482 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:20.476482 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 10:03:20.476482 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:03:20.476482 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 10:03:20.476482 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:03:20.476482 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:20.476482 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:20.476482 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:20.476482 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:20.476482 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:20.476482 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:20.476482 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:20.476482 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:20.476482 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:20.476482 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:20.476482 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:20.476482 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:20.477389 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:20.477389 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:20.477389 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 10:03:20.477389 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 10:03:20.477389 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 10:03:20.477389 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 10:03:20.477389 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 10:03:20.477389 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 10:03:20.477389 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 22 10:03:20.477389 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:03:20.477389 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 315/638] 10.222.0.43 () {56 vars in 1093 bytes} [Wed Jun 22 10:03:20 2022] GET /identity/v3/users/nova => generated 82 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:03:20.478087 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8124d9-f04c-4805-90c0-c530a981dc93 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:20.492930 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-b6d79674-c21f-4dab-baf2-2b7d94aa58ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:03:20.492930 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:20.492930 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:20.492930 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:20.492930 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:20.492930 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:20.492930 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:20.492930 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:20.492930 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:20.492930 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:20.492930 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:20.492930 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:20.492930 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:03:20.492930 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:03:20.492930 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:03:20.493849 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:03:20.493849 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:20.493849 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:20.493849 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:20.493849 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:20.493849 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:20.493849 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:20.493849 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:20.493849 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:20.493849 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:20.493849 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:20.493849 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:20.493849 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:20.493849 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:20.493849 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:20.493849 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:20.493849 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:20.494746 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:03:20.494746 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:03:20.494746 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:03:20.494746 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:03:20.494746 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 324/639] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jun 22 10:03:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:03:20.495547 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ee2031-22dd-4f95-8d03-25ff8a5b1271 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:20.495656 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ee2031-22dd-4f95-8d03-25ff8a5b1271 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:20.495887 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ee2031-22dd-4f95-8d03-25ff8a5b1271 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:20.497252 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 325/640] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:03:20 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:03:20.497878 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ee2031-22dd-4f95-8d03-25ff8a5b1271 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:20.586520 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8124d9-f04c-4805-90c0-c530a981dc93 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:20.592824 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:20.615903 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ee2031-22dd-4f95-8d03-25ff8a5b1271 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:20.616736 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:20.621822 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d848429b-c695-4281-be21-90d36525ed3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:20.622617 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d848429b-c695-4281-be21-90d36525ed3f None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:20.622901 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d848429b-c695-4281-be21-90d36525ed3f None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:20.623176 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d848429b-c695-4281-be21-90d36525ed3f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:20.633829 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d848429b-c695-4281-be21-90d36525ed3f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:03:20.641505 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-d848429b-c695-4281-be21-90d36525ed3f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 10:03:20.641505 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:20.641505 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:20.641505 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:20.641505 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:20.641505 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:20.641505 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:20.641505 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:20.641505 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:20.641505 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:20.641505 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:20.641505 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:20.641505 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:03:20.641505 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:03:20.641505 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:03:20.641505 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:03:20.642644 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:03:20.642644 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:03:20.642644 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:03:20.642644 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:03:20.642644 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:20.642644 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:20.642644 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:20.642644 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:20.642644 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:20.642644 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:20.642644 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:20.642644 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:20.642644 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:20.642644 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:20.642644 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:20.642644 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:20.643523 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:20.643523 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:20.643523 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:20.643523 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:20.643523 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:03:20.643523 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:03:20.643523 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:03:20.643523 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:03:20.643523 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:03:20.643523 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:03:20.643523 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 10:03:20.643523 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:03:20.643523 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 316/641] 10.222.0.43 () {56 vars in 1102 bytes} [Wed Jun 22 10:03:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:03:20.644212 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d848429b-c695-4281-be21-90d36525ed3f None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:20.659726 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be9cf2b-4a1b-4a58-973c-2e90c4ec08d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:20.660750 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be9cf2b-4a1b-4a58-973c-2e90c4ec08d7 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:20.661396 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be9cf2b-4a1b-4a58-973c-2e90c4ec08d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:20.661955 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be9cf2b-4a1b-4a58-973c-2e90c4ec08d7 None admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:20.662860 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be9cf2b-4a1b-4a58-973c-2e90c4ec08d7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:20.663207 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be9cf2b-4a1b-4a58-973c-2e90c4ec08d7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:20.664695 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be9cf2b-4a1b-4a58-973c-2e90c4ec08d7 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:20.683786 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 326/642] 10.222.0.43 () {56 vars in 1133 bytes} [Wed Jun 22 10:03:20 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:20.685180 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673553a8-84c9-4d29-a363-607a439a4038 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:20.685473 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673553a8-84c9-4d29-a363-607a439a4038 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:20.685777 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673553a8-84c9-4d29-a363-607a439a4038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:20.703819 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-673553a8-84c9-4d29-a363-607a439a4038 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:03:20.705020 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-673553a8-84c9-4d29-a363-607a439a4038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:03:20.766188 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d848429b-c695-4281-be21-90d36525ed3f None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:20.785914 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 327/643] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:03:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 10:03:20.785914 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673553a8-84c9-4d29-a363-607a439a4038 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:20.808861 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bb5417-5bd0-4621-89a7-9cd30c735fa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:20.809642 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bb5417-5bd0-4621-89a7-9cd30c735fa0 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:20.809954 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bb5417-5bd0-4621-89a7-9cd30c735fa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:20.810229 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bb5417-5bd0-4621-89a7-9cd30c735fa0 None admin] PATH_INFO: `/v3/domains` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:20.810980 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bb5417-5bd0-4621-89a7-9cd30c735fa0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:20.811283 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bb5417-5bd0-4621-89a7-9cd30c735fa0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:20.812663 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bb5417-5bd0-4621-89a7-9cd30c735fa0 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:20.825487 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 317/644] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Jun 22 10:03:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:20.826321 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bb5417-5bd0-4621-89a7-9cd30c735fa0 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:20.868032 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:20.883002 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:20.899601 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673553a8-84c9-4d29-a363-607a439a4038 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:20.933962 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bb5417-5bd0-4621-89a7-9cd30c735fa0 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:20.935387 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27673648-ac53-4065-8ad5-ed2792045106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:20.936053 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27673648-ac53-4065-8ad5-ed2792045106 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:20.936338 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27673648-ac53-4065-8ad5-ed2792045106 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:20.936620 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27673648-ac53-4065-8ad5-ed2792045106 None admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:20.937364 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27673648-ac53-4065-8ad5-ed2792045106 None admin] RBAC: Adding query filter params (name=service) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:20.937675 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27673648-ac53-4065-8ad5-ed2792045106 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:20.939070 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27673648-ac53-4065-8ad5-ed2792045106 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:20.948813 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 328/645] 10.222.0.43 () {56 vars in 1103 bytes} [Wed Jun 22 10:03:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:20.949509 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27673648-ac53-4065-8ad5-ed2792045106 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:20.978521 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e974337-4aba-4840-8e55-add0bf0c9031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:20.979205 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e974337-4aba-4840-8e55-add0bf0c9031 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:20.979491 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e974337-4aba-4840-8e55-add0bf0c9031 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:20.979958 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e974337-4aba-4840-8e55-add0bf0c9031 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:21.055302 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e974337-4aba-4840-8e55-add0bf0c9031 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:21.056930 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e974337-4aba-4840-8e55-add0bf0c9031 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:21.074482 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27673648-ac53-4065-8ad5-ed2792045106 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:21.105131 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:21.112510 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469dc0bd-a5f7-4cf3-99c7-a23768d04bbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:21.113494 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469dc0bd-a5f7-4cf3-99c7-a23768d04bbe None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:21.113897 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469dc0bd-a5f7-4cf3-99c7-a23768d04bbe None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:21.114882 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469dc0bd-a5f7-4cf3-99c7-a23768d04bbe None admin] PATH_INFO: `/v3/roles/service` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:21.121019 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:21.125319 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469dc0bd-a5f7-4cf3-99c7-a23768d04bbe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:03:21.133162 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-469dc0bd-a5f7-4cf3-99c7-a23768d04bbe None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 10:03:21.133162 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:21.133162 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:21.133162 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:21.133162 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:21.133162 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:21.133162 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:21.133162 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:21.133162 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:21.133162 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:21.133162 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:21.133162 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:21.133162 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:03:21.133162 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:03:21.133162 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:03:21.133162 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:03:21.134208 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:03:21.134208 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:03:21.134208 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:03:21.134208 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:03:21.134208 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:21.134208 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:21.134208 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:21.134208 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:21.134208 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:21.134208 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:21.134208 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:21.134208 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:21.134208 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:21.134208 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:21.134208 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:21.134208 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:21.135193 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:21.135193 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:21.135193 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:21.135193 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:21.135193 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:03:21.135193 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:03:21.135193 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:03:21.135193 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:03:21.135193 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:03:21.135193 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:03:21.135193 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 10:03:21.135193 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:03:21.135193 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 329/646] 10.222.0.43 () {56 vars in 1102 bytes} [Wed Jun 22 10:03:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:03:21.135193 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469dc0bd-a5f7-4cf3-99c7-a23768d04bbe None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:21.178733 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 318/647] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Jun 22 10:03:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 10:03:21.179864 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e974337-4aba-4840-8e55-add0bf0c9031 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:21.250663 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469dc0bd-a5f7-4cf3-99c7-a23768d04bbe None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:21.287970 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c66b0a-5372-4a3a-ae0c-919b1b2a4c0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:21.289210 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c66b0a-5372-4a3a-ae0c-919b1b2a4c0c None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:21.289637 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c66b0a-5372-4a3a-ae0c-919b1b2a4c0c None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:21.290111 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c66b0a-5372-4a3a-ae0c-919b1b2a4c0c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:21.291767 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e974337-4aba-4840-8e55-add0bf0c9031 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:21.297603 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c66b0a-5372-4a3a-ae0c-919b1b2a4c0c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:21.299446 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c66b0a-5372-4a3a-ae0c-919b1b2a4c0c None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:21.315832 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-52c66b0a-5372-4a3a-ae0c-919b1b2a4c0c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:03:21.315832 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:21.315832 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:21.315832 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:21.315832 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:21.315832 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:21.315832 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:21.315832 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:21.315832 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:21.315832 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:21.315832 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:21.315832 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:21.315832 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 10:03:21.315832 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 10:03:21.315832 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 10:03:21.316803 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 10:03:21.316803 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:21.316803 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:21.316803 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:21.316803 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:21.316803 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:21.316803 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:21.316803 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:21.316803 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:21.316803 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:21.316803 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:21.316803 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:21.316803 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:21.316803 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:21.316803 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:21.316803 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:21.316803 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:21.317900 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 10:03:21.317900 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 10:03:21.317900 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 10:03:21.317900 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 10:03:21.317900 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 10:03:21.317900 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 10:03:21.317900 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:03:21.317900 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:03:21.317900 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 330/648] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Jun 22 10:03:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:03:21.318386 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c66b0a-5372-4a3a-ae0c-919b1b2a4c0c None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:21.331809 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a962b348-4da0-4922-8582-79ec6b43815d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:21.332642 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a962b348-4da0-4922-8582-79ec6b43815d None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:21.333427 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a962b348-4da0-4922-8582-79ec6b43815d None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:21.333806 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a962b348-4da0-4922-8582-79ec6b43815d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:21.346997 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a962b348-4da0-4922-8582-79ec6b43815d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:21.349660 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a962b348-4da0-4922-8582-79ec6b43815d None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:21.369672 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-a962b348-4da0-4922-8582-79ec6b43815d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:03:21.369672 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:21.369672 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:21.369672 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:21.369672 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:21.369672 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:21.369672 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:21.369672 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:21.369672 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:21.369672 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:21.369672 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:21.369672 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:21.369672 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:03:21.369672 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:03:21.369672 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:03:21.372880 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:03:21.372880 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:21.372880 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:21.372880 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:21.372880 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:21.372880 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:21.372880 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:21.372880 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:21.372880 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:21.372880 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:21.372880 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:21.372880 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:21.372880 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:21.372880 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:21.372880 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:21.372880 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:21.372880 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:21.373963 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:03:21.373963 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:03:21.373963 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:03:21.373963 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:03:21.373963 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 319/649] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jun 22 10:03:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:03:21.373963 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a962b348-4da0-4922-8582-79ec6b43815d None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:21.379417 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:21.389069 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:21.450158 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c66b0a-5372-4a3a-ae0c-919b1b2a4c0c None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:21.487831 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a962b348-4da0-4922-8582-79ec6b43815d None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:21.488062 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2404747-34fe-4524-8561-24dc47e01450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:21.488509 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2404747-34fe-4524-8561-24dc47e01450 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:21.488796 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2404747-34fe-4524-8561-24dc47e01450 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:21.489174 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2404747-34fe-4524-8561-24dc47e01450 None admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:21.490446 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2404747-34fe-4524-8561-24dc47e01450 None admin] RBAC: Adding query filter params (name=service) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:21.491474 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2404747-34fe-4524-8561-24dc47e01450 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:21.492157 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2404747-34fe-4524-8561-24dc47e01450 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:21.500682 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 331/650] 10.222.0.43 () {56 vars in 1103 bytes} [Wed Jun 22 10:03:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:21.501319 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2404747-34fe-4524-8561-24dc47e01450 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:21.534445 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed2d997-f778-454c-a800-284cea7cf881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:21.535245 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed2d997-f778-454c-a800-284cea7cf881 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:21.535535 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed2d997-f778-454c-a800-284cea7cf881 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:21.535840 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed2d997-f778-454c-a800-284cea7cf881 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:21.546847 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed2d997-f778-454c-a800-284cea7cf881 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:21.548311 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed2d997-f778-454c-a800-284cea7cf881 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:21.566514 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-9ed2d997-f778-454c-a800-284cea7cf881 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:03:21.566514 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:21.566514 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:21.566514 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:21.566514 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:21.566514 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:21.566514 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:21.566514 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:21.566514 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:21.566514 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:21.566514 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:21.566514 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:21.566514 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:03:21.566514 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:03:21.566514 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:03:21.568075 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:03:21.568075 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:21.568075 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:21.568075 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:21.568075 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:21.568075 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:21.568075 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:21.568075 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:21.568075 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:21.568075 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:21.568075 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:21.568075 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:21.568075 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:21.568075 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:21.568075 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:21.568075 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:21.568075 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:21.568997 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:03:21.568997 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:03:21.568997 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:03:21.568997 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:03:21.568997 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 320/651] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jun 22 10:03:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:03:21.568997 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed2d997-f778-454c-a800-284cea7cf881 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:21.622024 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2404747-34fe-4524-8561-24dc47e01450 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:21.629550 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:21.637290 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:21.658697 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a71204c-e3ea-4ec1-9e4b-c5cac7c8849d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:21.659384 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a71204c-e3ea-4ec1-9e4b-c5cac7c8849d None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:21.659674 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a71204c-e3ea-4ec1-9e4b-c5cac7c8849d None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:21.659947 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a71204c-e3ea-4ec1-9e4b-c5cac7c8849d None admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:21.660731 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a71204c-e3ea-4ec1-9e4b-c5cac7c8849d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:21.661560 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a71204c-e3ea-4ec1-9e4b-c5cac7c8849d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:21.663031 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a71204c-e3ea-4ec1-9e4b-c5cac7c8849d None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:21.675261 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 332/652] 10.222.0.43 () {56 vars in 1148 bytes} [Wed Jun 22 10:03:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:21.676247 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a71204c-e3ea-4ec1-9e4b-c5cac7c8849d None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:21.684409 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed2d997-f778-454c-a800-284cea7cf881 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:21.717425 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f866bd30-01d0-49ef-9f46-18add2904986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:21.718115 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f866bd30-01d0-49ef-9f46-18add2904986 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:21.718403 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f866bd30-01d0-49ef-9f46-18add2904986 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:21.718679 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f866bd30-01d0-49ef-9f46-18add2904986 None admin] PATH_INFO: `/v3/domains` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:21.719395 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f866bd30-01d0-49ef-9f46-18add2904986 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:21.719700 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f866bd30-01d0-49ef-9f46-18add2904986 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:21.721075 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f866bd30-01d0-49ef-9f46-18add2904986 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:21.733637 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 321/653] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Jun 22 10:03:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:21.734454 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f866bd30-01d0-49ef-9f46-18add2904986 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:21.787255 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a71204c-e3ea-4ec1-9e4b-c5cac7c8849d None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:21.824029 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59304a2-4e36-47dc-a870-8e391a1551c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:21.824817 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59304a2-4e36-47dc-a870-8e391a1551c4 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:21.825099 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59304a2-4e36-47dc-a870-8e391a1551c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:21.825373 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59304a2-4e36-47dc-a870-8e391a1551c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:21.835246 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59304a2-4e36-47dc-a870-8e391a1551c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:21.836682 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59304a2-4e36-47dc-a870-8e391a1551c4 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:21.842720 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f866bd30-01d0-49ef-9f46-18add2904986 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:21.854836 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-e59304a2-4e36-47dc-a870-8e391a1551c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:03:21.854836 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:21.854836 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:21.854836 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:21.854836 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:21.854836 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:21.854836 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:21.854836 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:21.854836 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:21.854836 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:21.854836 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:21.854836 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:21.854836 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:03:21.854836 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:03:21.854836 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:03:21.855901 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:03:21.855901 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:21.855901 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:21.855901 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:21.855901 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:21.855901 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:21.855901 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:21.855901 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:21.855901 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:21.855901 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:21.855901 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:21.855901 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:21.855901 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:21.855901 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:21.855901 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:21.855901 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:21.855901 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:21.857008 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:03:21.857008 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:03:21.857008 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:03:21.857008 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:03:21.857008 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 333/654] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jun 22 10:03:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:03:21.857352 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ffa741-7f93-433c-b0b6-ba4b11d47a99 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:21.857596 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ffa741-7f93-433c-b0b6-ba4b11d47a99 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:21.857907 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ffa741-7f93-433c-b0b6-ba4b11d47a99 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:21.859170 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 334/655] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:03:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:03:21.859862 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ffa741-7f93-433c-b0b6-ba4b11d47a99 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:21.864980 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:21.882690 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ff19c0-896f-4145-9dfe-8fbf1f0e76c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:21.883287 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ff19c0-896f-4145-9dfe-8fbf1f0e76c3 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:21.883570 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ff19c0-896f-4145-9dfe-8fbf1f0e76c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:21.883848 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ff19c0-896f-4145-9dfe-8fbf1f0e76c3 None admin] PATH_INFO: `/v3/domains` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:21.884568 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ff19c0-896f-4145-9dfe-8fbf1f0e76c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:21.884872 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ff19c0-896f-4145-9dfe-8fbf1f0e76c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:21.886276 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ff19c0-896f-4145-9dfe-8fbf1f0e76c3 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:21.887328 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:21.898552 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 322/656] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Jun 22 10:03:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:21.899354 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ff19c0-896f-4145-9dfe-8fbf1f0e76c3 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:21.964081 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ffa741-7f93-433c-b0b6-ba4b11d47a99 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:21.999012 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ef5fdd-1140-4533-8dc2-a664f8042d8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:21.999673 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ef5fdd-1140-4533-8dc2-a664f8042d8b None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:21.999963 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ef5fdd-1140-4533-8dc2-a664f8042d8b None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:22.000248 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ef5fdd-1140-4533-8dc2-a664f8042d8b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:22.001100 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ef5fdd-1140-4533-8dc2-a664f8042d8b None admin] RBAC: Adding query filter params (role.id=18493ce78e7c480c9202245b6d93cb4c, scope.project.id=e03f1c17e0884f188231d2949dc6f956, user.id=a2418acec46b4db48346129004827853) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:22.001319 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ff19c0-896f-4145-9dfe-8fbf1f0e76c3 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:22.001427 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ef5fdd-1140-4533-8dc2-a664f8042d8b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:22.002886 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ef5fdd-1140-4533-8dc2-a664f8042d8b None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:22.008822 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 335/657] 10.222.0.43 () {56 vars in 1374 bytes} [Wed Jun 22 10:03:21 2022] GET /identity/v3/role_assignments?user.id=a2418acec46b4db48346129004827853&scope.project.id=e03f1c17e0884f188231d2949dc6f956&role.id=18493ce78e7c480c9202245b6d93cb4c => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:22.009603 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ef5fdd-1140-4533-8dc2-a664f8042d8b None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:22.043678 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e8f8c4-7c75-4526-be9e-eb888b315b0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:22.045104 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e8f8c4-7c75-4526-be9e-eb888b315b0f None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:22.045400 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e8f8c4-7c75-4526-be9e-eb888b315b0f None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:22.045683 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e8f8c4-7c75-4526-be9e-eb888b315b0f None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:22.056001 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e8f8c4-7c75-4526-be9e-eb888b315b0f None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:22.058180 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e8f8c4-7c75-4526-be9e-eb888b315b0f None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:22.079725 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-19e8f8c4-7c75-4526-be9e-eb888b315b0f None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 22 10:03:22.079725 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:22.079725 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:22.079725 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:22.079725 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:22.079725 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:22.079725 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:22.079725 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:22.079725 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:22.079725 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:22.079725 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:22.079725 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:22.079725 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 10:03:22.079725 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 10:03:22.079725 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 10:03:22.079725 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 10:03:22.080759 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:22.080759 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:22.080759 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 10:03:22.080759 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:03:22.080759 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 10:03:22.080759 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:03:22.080759 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:22.080759 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:22.080759 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:22.080759 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:22.080759 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:22.080759 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:22.080759 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:22.080759 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:22.080759 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:22.080759 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:22.080759 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:22.080759 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:22.081713 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:22.081713 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:22.081713 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 10:03:22.081713 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 10:03:22.081713 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 10:03:22.081713 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 10:03:22.081713 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 10:03:22.081713 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 10:03:22.081713 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 22 10:03:22.081713 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:03:22.083882 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 323/658] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Jun 22 10:03:21 2022] GET /identity/v3/users/cinder => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:03:22.086142 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2dc677-556c-45b9-8eba-3f053bbb3c4e None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:22.086510 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2dc677-556c-45b9-8eba-3f053bbb3c4e None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:22.088258 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2dc677-556c-45b9-8eba-3f053bbb3c4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:22.111866 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-8b2dc677-556c-45b9-8eba-3f053bbb3c4e None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:03:22.113774 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-8b2dc677-556c-45b9-8eba-3f053bbb3c4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:03:22.120210 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:22.130732 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ef5fdd-1140-4533-8dc2-a664f8042d8b None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:22.158854 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:22.171066 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c47d87-9b7a-4ccf-ab71-bb37f50c0afa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:22.171744 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c47d87-9b7a-4ccf-ab71-bb37f50c0afa None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:22.172030 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c47d87-9b7a-4ccf-ab71-bb37f50c0afa None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:22.172310 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c47d87-9b7a-4ccf-ab71-bb37f50c0afa None admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:22.173050 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c47d87-9b7a-4ccf-ab71-bb37f50c0afa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:22.173358 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c47d87-9b7a-4ccf-ab71-bb37f50c0afa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:22.174810 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c47d87-9b7a-4ccf-ab71-bb37f50c0afa None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:22.191829 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 336/659] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Jun 22 10:03:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:22.191829 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c47d87-9b7a-4ccf-ab71-bb37f50c0afa None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:22.210416 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 324/660] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:03:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 10:03:22.211486 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2dc677-556c-45b9-8eba-3f053bbb3c4e None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:22.314566 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c47d87-9b7a-4ccf-ab71-bb37f50c0afa None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:22.327166 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2dc677-556c-45b9-8eba-3f053bbb3c4e None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:22.351483 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515092e3-e04c-4f57-8e91-49e2ee94f36a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:22.352279 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515092e3-e04c-4f57-8e91-49e2ee94f36a None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:22.352562 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515092e3-e04c-4f57-8e91-49e2ee94f36a None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:22.352833 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515092e3-e04c-4f57-8e91-49e2ee94f36a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:22.359835 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515092e3-e04c-4f57-8e91-49e2ee94f36a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:22.361280 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515092e3-e04c-4f57-8e91-49e2ee94f36a None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:22.366968 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd5def4-bd74-43b5-8582-075462a3b4b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:22.367664 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd5def4-bd74-43b5-8582-075462a3b4b4 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:22.367986 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd5def4-bd74-43b5-8582-075462a3b4b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:22.368294 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd5def4-bd74-43b5-8582-075462a3b4b4 None admin] PATH_INFO: `/v3/users` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:22.369176 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd5def4-bd74-43b5-8582-075462a3b4b4 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:22.369493 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd5def4-bd74-43b5-8582-075462a3b4b4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:22.370948 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd5def4-bd74-43b5-8582-075462a3b4b4 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:22.377017 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-515092e3-e04c-4f57-8e91-49e2ee94f36a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:03:22.377017 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:22.377017 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:22.377017 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:22.377017 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:22.377017 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:22.377017 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:22.377017 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:22.377017 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:22.377017 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:22.377017 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:22.377017 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:22.377017 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 10:03:22.377017 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 10:03:22.377017 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 10:03:22.378093 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 10:03:22.378093 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:22.378093 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:22.378093 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:22.378093 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:22.378093 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:22.378093 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:22.378093 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:22.378093 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:22.378093 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:22.378093 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:22.378093 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:22.378093 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:22.378093 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:22.378093 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:22.378093 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:22.378093 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:22.379172 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 10:03:22.379172 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 10:03:22.379172 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 10:03:22.379172 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 10:03:22.379172 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 10:03:22.379172 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 10:03:22.379172 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:03:22.379172 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:03:22.381018 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 337/661] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Jun 22 10:03:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:03:22.382100 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515092e3-e04c-4f57-8e91-49e2ee94f36a None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:22.394006 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 325/662] 10.222.0.43 () {56 vars in 1137 bytes} [Wed Jun 22 10:03:22 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:22.395623 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:22.401319 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd5def4-bd74-43b5-8582-075462a3b4b4 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:22.443094 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:22.508364 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515092e3-e04c-4f57-8e91-49e2ee94f36a None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:22.548682 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a9f5b5-029c-42e4-97df-43e86fcaedf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:22.549781 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a9f5b5-029c-42e4-97df-43e86fcaedf7 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:22.550067 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a9f5b5-029c-42e4-97df-43e86fcaedf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:22.550347 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a9f5b5-029c-42e4-97df-43e86fcaedf7 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:22.556421 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd5def4-bd74-43b5-8582-075462a3b4b4 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:22.558996 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a9f5b5-029c-42e4-97df-43e86fcaedf7 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:22.560471 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a9f5b5-029c-42e4-97df-43e86fcaedf7 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:22.577389 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-f5a9f5b5-029c-42e4-97df-43e86fcaedf7 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 22 10:03:22.577389 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:22.577389 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:22.577389 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:22.577389 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:22.577389 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:22.577389 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:22.577389 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:22.577389 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:22.577389 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:22.577389 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:22.577389 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:22.577389 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 10:03:22.577389 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 10:03:22.577389 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 10:03:22.577389 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 10:03:22.578429 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:22.578429 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:22.578429 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 10:03:22.578429 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:03:22.578429 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 10:03:22.578429 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:03:22.578429 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:22.578429 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:22.578429 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:22.578429 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:22.578429 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:22.578429 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:22.578429 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:22.578429 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:22.578429 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:22.578429 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:22.578429 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:22.578429 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:22.579450 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:22.579450 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:22.579450 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 10:03:22.579450 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 10:03:22.579450 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 10:03:22.579450 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 10:03:22.579450 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 10:03:22.579450 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 10:03:22.579450 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 22 10:03:22.579450 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:03:22.582013 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 338/663] 10.222.0.43 () {56 vars in 1102 bytes} [Wed Jun 22 10:03:22 2022] GET /identity/v3/users/neutron => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:03:22.584389 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a9f5b5-029c-42e4-97df-43e86fcaedf7 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:22.605486 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065d4257-b3ee-4966-8b31-147975bad9a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:22.606465 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065d4257-b3ee-4966-8b31-147975bad9a7 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:22.607042 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065d4257-b3ee-4966-8b31-147975bad9a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:22.607353 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065d4257-b3ee-4966-8b31-147975bad9a7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:22.619259 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065d4257-b3ee-4966-8b31-147975bad9a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:03:22.627739 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-065d4257-b3ee-4966-8b31-147975bad9a7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 10:03:22.627739 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:22.627739 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:22.627739 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:22.627739 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:22.627739 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:22.627739 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:22.627739 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:22.627739 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:22.627739 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:22.627739 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:22.627739 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:22.627739 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:03:22.627739 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:03:22.627739 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:03:22.627739 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:03:22.628741 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:03:22.628741 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:03:22.628741 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:03:22.628741 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:03:22.628741 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:22.628741 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:22.628741 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:22.628741 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:22.628741 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:22.628741 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:22.628741 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:22.628741 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:22.628741 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:22.628741 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:22.628741 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:22.628741 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:22.630822 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:22.630822 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:22.630822 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:22.630822 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:22.630822 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:03:22.630822 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:03:22.630822 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:03:22.630822 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:03:22.630822 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:03:22.630822 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:03:22.630822 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 10:03:22.630822 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:03:22.630822 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 326/664] 10.222.0.43 () {56 vars in 1102 bytes} [Wed Jun 22 10:03:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:03:22.631631 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065d4257-b3ee-4966-8b31-147975bad9a7 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:22.670877 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:22.721213 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a9f5b5-029c-42e4-97df-43e86fcaedf7 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:22.738414 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:22.758795 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065d4257-b3ee-4966-8b31-147975bad9a7 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:22.767207 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a39225-458e-4fd6-a39e-e81348469349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:22.767885 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a39225-458e-4fd6-a39e-e81348469349 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:22.768174 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a39225-458e-4fd6-a39e-e81348469349 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:22.768451 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a39225-458e-4fd6-a39e-e81348469349 None admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:22.769706 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a39225-458e-4fd6-a39e-e81348469349 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:22.770905 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a39225-458e-4fd6-a39e-e81348469349 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:22.772560 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a39225-458e-4fd6-a39e-e81348469349 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:22.792122 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 339/665] 10.222.0.43 () {56 vars in 1148 bytes} [Wed Jun 22 10:03:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:22.792122 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a39225-458e-4fd6-a39e-e81348469349 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:22.811792 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edb9fe9-340f-4dd5-8396-f85667b0ffb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:22.812478 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edb9fe9-340f-4dd5-8396-f85667b0ffb3 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:22.812811 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edb9fe9-340f-4dd5-8396-f85667b0ffb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:22.813127 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edb9fe9-340f-4dd5-8396-f85667b0ffb3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:22.915933 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edb9fe9-340f-4dd5-8396-f85667b0ffb3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:22.918735 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a39225-458e-4fd6-a39e-e81348469349 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:22.919933 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edb9fe9-340f-4dd5-8396-f85667b0ffb3 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:22.960588 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:22.966016 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f636fe76-a6bd-468d-90a1-f9c5b9b282df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:22.968576 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f636fe76-a6bd-468d-90a1-f9c5b9b282df None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:22.969323 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f636fe76-a6bd-468d-90a1-f9c5b9b282df None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:22.969763 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f636fe76-a6bd-468d-90a1-f9c5b9b282df None admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:22.971419 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f636fe76-a6bd-468d-90a1-f9c5b9b282df None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:22.971851 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f636fe76-a6bd-468d-90a1-f9c5b9b282df None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:22.974406 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f636fe76-a6bd-468d-90a1-f9c5b9b282df None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:22.999245 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 340/666] 10.222.0.43 () {56 vars in 1139 bytes} [Wed Jun 22 10:03:22 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:22.999245 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f636fe76-a6bd-468d-90a1-f9c5b9b282df None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:23.036701 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:23.059743 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 327/667] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Jun 22 10:03:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 10:03:23.064975 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edb9fe9-340f-4dd5-8396-f85667b0ffb3 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:23.118102 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f636fe76-a6bd-468d-90a1-f9c5b9b282df None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:23.157595 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f4e2e6-6ad7-42aa-8321-e6b8b7496894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:23.158315 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f4e2e6-6ad7-42aa-8321-e6b8b7496894 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:23.158605 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f4e2e6-6ad7-42aa-8321-e6b8b7496894 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:23.158877 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f4e2e6-6ad7-42aa-8321-e6b8b7496894 None admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:23.159635 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f4e2e6-6ad7-42aa-8321-e6b8b7496894 None admin] RBAC: Adding query filter params (name=service) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:23.159953 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f4e2e6-6ad7-42aa-8321-e6b8b7496894 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:23.162870 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f4e2e6-6ad7-42aa-8321-e6b8b7496894 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:23.172230 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 341/668] 10.222.0.43 () {56 vars in 1103 bytes} [Wed Jun 22 10:03:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:23.173085 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f4e2e6-6ad7-42aa-8321-e6b8b7496894 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:23.199933 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edb9fe9-340f-4dd5-8396-f85667b0ffb3 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:23.235510 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:23.245779 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c348da2-b655-4148-9d73-a91eb136c231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:23.246831 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c348da2-b655-4148-9d73-a91eb136c231 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:23.247275 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c348da2-b655-4148-9d73-a91eb136c231 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:23.247500 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c348da2-b655-4148-9d73-a91eb136c231 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:23.248323 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c348da2-b655-4148-9d73-a91eb136c231 None admin] RBAC: Adding query filter params (role.id=18493ce78e7c480c9202245b6d93cb4c, scope.project.id=e03f1c17e0884f188231d2949dc6f956, user.id=158a49aa3750478a84bf71b9aad24397) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:23.248634 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c348da2-b655-4148-9d73-a91eb136c231 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:23.250304 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c348da2-b655-4148-9d73-a91eb136c231 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:23.265732 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 328/669] 10.222.0.43 () {56 vars in 1374 bytes} [Wed Jun 22 10:03:23 2022] GET /identity/v3/role_assignments?user.id=158a49aa3750478a84bf71b9aad24397&scope.project.id=e03f1c17e0884f188231d2949dc6f956&role.id=18493ce78e7c480c9202245b6d93cb4c => generated 608 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:23.265732 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c348da2-b655-4148-9d73-a91eb136c231 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:23.307760 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f4e2e6-6ad7-42aa-8321-e6b8b7496894 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:23.340441 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:23.351686 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625a960c-440a-43ab-8e4b-c006daa6795a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:23.353389 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625a960c-440a-43ab-8e4b-c006daa6795a None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:23.353979 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625a960c-440a-43ab-8e4b-c006daa6795a None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:23.354428 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625a960c-440a-43ab-8e4b-c006daa6795a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:23.404932 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c348da2-b655-4148-9d73-a91eb136c231 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:23.449680 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10076607-a395-4974-ad99-8bd37f4fe39b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:23.450746 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10076607-a395-4974-ad99-8bd37f4fe39b None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:23.451206 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10076607-a395-4974-ad99-8bd37f4fe39b None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:23.451489 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10076607-a395-4974-ad99-8bd37f4fe39b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:23.460479 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625a960c-440a-43ab-8e4b-c006daa6795a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:23.463073 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625a960c-440a-43ab-8e4b-c006daa6795a None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:23.466351 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10076607-a395-4974-ad99-8bd37f4fe39b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:23.467821 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10076607-a395-4974-ad99-8bd37f4fe39b None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:23.494659 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-10076607-a395-4974-ad99-8bd37f4fe39b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:03:23.494659 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:23.494659 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:23.494659 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:23.494659 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:23.494659 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:23.494659 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:23.494659 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:23.494659 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:23.494659 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:23.494659 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:23.494659 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:23.494659 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:03:23.494659 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:03:23.494659 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:03:23.495572 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:03:23.495572 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:23.495572 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:23.495572 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:23.495572 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:23.495572 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:23.495572 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:23.495572 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:23.495572 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:23.495572 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:23.495572 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:23.495572 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:23.495572 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:23.495572 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:23.495572 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:23.495572 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:23.495572 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:23.496459 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:03:23.496459 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:03:23.496459 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:03:23.496459 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:03:23.496459 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 329/670] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jun 22 10:03:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:03:23.496725 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10076607-a395-4974-ad99-8bd37f4fe39b None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:23.527435 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:23.599367 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 342/671] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Jun 22 10:03:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 10:03:23.600361 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625a960c-440a-43ab-8e4b-c006daa6795a None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:23.624890 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:23.628319 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10076607-a395-4974-ad99-8bd37f4fe39b None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:23.669965 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11ccf9d-b344-49ff-ba0e-e254bc1f6c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:23.670894 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11ccf9d-b344-49ff-ba0e-e254bc1f6c18 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:23.671243 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11ccf9d-b344-49ff-ba0e-e254bc1f6c18 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:23.671588 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11ccf9d-b344-49ff-ba0e-e254bc1f6c18 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:23.686005 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11ccf9d-b344-49ff-ba0e-e254bc1f6c18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:23.688189 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11ccf9d-b344-49ff-ba0e-e254bc1f6c18 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:23.711697 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-f11ccf9d-b344-49ff-ba0e-e254bc1f6c18 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:03:23.711697 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:23.711697 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:23.711697 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:23.711697 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:23.711697 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:23.711697 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:23.711697 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:23.711697 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:23.711697 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:23.711697 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:23.711697 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:23.711697 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:03:23.711697 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:03:23.711697 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:03:23.712806 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:03:23.712806 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:23.712806 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:23.712806 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:23.712806 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:23.712806 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:23.712806 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:23.712806 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:23.712806 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:23.712806 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:23.712806 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:23.712806 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:23.712806 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:23.712806 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:23.712806 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:23.712806 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:23.712806 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:23.713825 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:03:23.713825 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:03:23.713825 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:03:23.713825 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:03:23.713825 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 330/672] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jun 22 10:03:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:03:23.714091 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11ccf9d-b344-49ff-ba0e-e254bc1f6c18 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:23.727872 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625a960c-440a-43ab-8e4b-c006daa6795a None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:23.770617 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a8b491-aa73-43e1-a025-5a606bab8fae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:23.771627 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a8b491-aa73-43e1-a025-5a606bab8fae None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:23.772134 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a8b491-aa73-43e1-a025-5a606bab8fae None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:23.772542 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a8b491-aa73-43e1-a025-5a606bab8fae None admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:23.773445 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a8b491-aa73-43e1-a025-5a606bab8fae None admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:23.773899 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a8b491-aa73-43e1-a025-5a606bab8fae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:23.775503 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a8b491-aa73-43e1-a025-5a606bab8fae None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:23.789255 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 343/673] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Jun 22 10:03:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:23.790335 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a8b491-aa73-43e1-a025-5a606bab8fae None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:23.805140 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:23.848831 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11ccf9d-b344-49ff-ba0e-e254bc1f6c18 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:23.894431 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fc44dd-ab8a-4598-8195-89eaf0371232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:23.895897 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fc44dd-ab8a-4598-8195-89eaf0371232 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:23.896741 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fc44dd-ab8a-4598-8195-89eaf0371232 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:23.897458 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fc44dd-ab8a-4598-8195-89eaf0371232 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:23.905821 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a8b491-aa73-43e1-a025-5a606bab8fae None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:23.912337 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fc44dd-ab8a-4598-8195-89eaf0371232 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:23.914059 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fc44dd-ab8a-4598-8195-89eaf0371232 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:23.942724 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-14fc44dd-ab8a-4598-8195-89eaf0371232 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:03:23.942724 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:23.942724 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:23.942724 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:23.942724 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:23.942724 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:23.942724 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:23.942724 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:23.942724 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:23.942724 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:23.942724 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:23.942724 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:23.942724 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:03:23.942724 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:03:23.942724 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:03:23.944372 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:03:23.944372 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:23.944372 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:23.944372 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:23.944372 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:23.944372 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:23.944372 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:23.944372 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:23.944372 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:23.944372 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:23.944372 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:23.944372 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:23.944372 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:23.944372 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:23.944372 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:23.944372 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:23.944372 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:23.945374 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:03:23.945374 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:03:23.945374 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:03:23.945374 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:03:23.945374 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 331/674] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jun 22 10:03:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:03:23.946122 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fc44dd-ab8a-4598-8195-89eaf0371232 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:23.948310 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234f67f0-347e-4de1-b27c-313133c36e0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:23.949277 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234f67f0-347e-4de1-b27c-313133c36e0a None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:23.949836 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234f67f0-347e-4de1-b27c-313133c36e0a None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:23.950338 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234f67f0-347e-4de1-b27c-313133c36e0a None admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:23.951275 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234f67f0-347e-4de1-b27c-313133c36e0a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:23.951866 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234f67f0-347e-4de1-b27c-313133c36e0a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:23.952626 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:23.954308 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234f67f0-347e-4de1-b27c-313133c36e0a None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:23.975931 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 344/675] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Jun 22 10:03:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:23.977724 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234f67f0-347e-4de1-b27c-313133c36e0a None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:24.057728 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fc44dd-ab8a-4598-8195-89eaf0371232 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:24.062800 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:24.105574 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142183fe-6d59-4867-8873-cc635aacc74e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:24.106015 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142183fe-6d59-4867-8873-cc635aacc74e None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:24.106306 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142183fe-6d59-4867-8873-cc635aacc74e None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:24.106581 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142183fe-6d59-4867-8873-cc635aacc74e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:24.116601 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142183fe-6d59-4867-8873-cc635aacc74e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:24.117221 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234f67f0-347e-4de1-b27c-313133c36e0a None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:24.118116 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142183fe-6d59-4867-8873-cc635aacc74e None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:24.134719 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-142183fe-6d59-4867-8873-cc635aacc74e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:03:24.134719 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:24.134719 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:24.134719 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:24.134719 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:24.134719 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:24.134719 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:24.134719 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:24.134719 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:24.134719 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:24.134719 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:24.134719 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:24.134719 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 10:03:24.134719 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 10:03:24.134719 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 10:03:24.135651 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 10:03:24.135651 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:24.135651 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:24.135651 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:24.135651 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:24.135651 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:24.135651 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:24.135651 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:24.135651 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:24.135651 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:24.135651 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:24.135651 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:24.135651 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:24.135651 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:24.135651 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:24.135651 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:24.135651 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:24.136550 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 10:03:24.136550 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 10:03:24.136550 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 10:03:24.136550 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 10:03:24.136550 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 10:03:24.136550 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 10:03:24.136550 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:03:24.136550 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:03:24.136550 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 332/676] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Jun 22 10:03:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:03:24.137030 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142183fe-6d59-4867-8873-cc635aacc74e None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:24.166287 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce11e5f6-b990-4b4b-bc44-b680e80a0664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:24.167932 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce11e5f6-b990-4b4b-bc44-b680e80a0664 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:24.168532 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce11e5f6-b990-4b4b-bc44-b680e80a0664 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:24.169102 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce11e5f6-b990-4b4b-bc44-b680e80a0664 None admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:24.170284 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce11e5f6-b990-4b4b-bc44-b680e80a0664 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:24.171171 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce11e5f6-b990-4b4b-bc44-b680e80a0664 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:24.173067 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce11e5f6-b990-4b4b-bc44-b680e80a0664 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:24.194387 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 345/677] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Jun 22 10:03:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:24.194944 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce11e5f6-b990-4b4b-bc44-b680e80a0664 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:24.210955 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:24.256431 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142183fe-6d59-4867-8873-cc635aacc74e None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:24.293320 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d9d676-8866-4299-92c8-89a205b57e5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:24.294177 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d9d676-8866-4299-92c8-89a205b57e5a None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:24.294466 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d9d676-8866-4299-92c8-89a205b57e5a None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:24.294747 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d9d676-8866-4299-92c8-89a205b57e5a None admin] PATH_INFO: `/v3/users/swift` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:24.304006 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d9d676-8866-4299-92c8-89a205b57e5a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:24.305659 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d9d676-8866-4299-92c8-89a205b57e5a None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:24.322163 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-11d9d676-8866-4299-92c8-89a205b57e5a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 22 10:03:24.322163 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:24.322163 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:24.322163 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:24.322163 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:24.322163 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:24.322163 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:24.322163 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:24.322163 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:24.322163 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:24.322163 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:24.322163 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:24.322163 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 10:03:24.322163 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 10:03:24.322163 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 10:03:24.322163 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 10:03:24.323113 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:24.323113 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:24.323113 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 10:03:24.323113 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:03:24.323113 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 10:03:24.323113 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:03:24.323113 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:24.323113 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:24.323113 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:24.323113 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:24.323113 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:24.323113 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:24.323113 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:24.323113 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:24.323113 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:24.323113 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:24.323113 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:24.323113 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:24.324054 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:24.324054 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:24.324054 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 10:03:24.324054 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 10:03:24.324054 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 10:03:24.324054 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 10:03:24.324054 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 10:03:24.324054 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 10:03:24.324054 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 22 10:03:24.324054 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:03:24.327935 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 333/678] 10.222.0.43 () {56 vars in 1096 bytes} [Wed Jun 22 10:03:24 2022] GET /identity/v3/users/swift => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:03:24.328803 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d9d676-8866-4299-92c8-89a205b57e5a None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:24.337566 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce11e5f6-b990-4b4b-bc44-b680e80a0664 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:24.370295 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:24.376586 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be75cb06-6b0b-48cc-9859-4c41ac303d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:24.377255 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be75cb06-6b0b-48cc-9859-4c41ac303d91 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:24.377543 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be75cb06-6b0b-48cc-9859-4c41ac303d91 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:24.377932 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be75cb06-6b0b-48cc-9859-4c41ac303d91 None admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:24.378731 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be75cb06-6b0b-48cc-9859-4c41ac303d91 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:24.379046 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be75cb06-6b0b-48cc-9859-4c41ac303d91 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:24.380547 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be75cb06-6b0b-48cc-9859-4c41ac303d91 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:24.392738 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 346/679] 10.222.0.43 () {56 vars in 1148 bytes} [Wed Jun 22 10:03:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:24.393533 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be75cb06-6b0b-48cc-9859-4c41ac303d91 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:24.453120 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d9d676-8866-4299-92c8-89a205b57e5a None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:24.483389 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:24.497731 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be75cb06-6b0b-48cc-9859-4c41ac303d91 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:24.504030 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56acb9a-ac28-4711-ba83-8c8e5f55be6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:24.505467 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56acb9a-ac28-4711-ba83-8c8e5f55be6f None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:24.505776 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56acb9a-ac28-4711-ba83-8c8e5f55be6f None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:24.506054 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56acb9a-ac28-4711-ba83-8c8e5f55be6f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:24.514191 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56acb9a-ac28-4711-ba83-8c8e5f55be6f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:24.515659 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56acb9a-ac28-4711-ba83-8c8e5f55be6f None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:24.529608 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-c56acb9a-ac28-4711-ba83-8c8e5f55be6f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:03:24.529608 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:24.529608 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:24.529608 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:24.529608 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:24.529608 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:24.529608 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:24.529608 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:24.529608 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:24.529608 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:24.529608 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:24.529608 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:24.529608 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 10:03:24.529608 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 10:03:24.529608 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 10:03:24.530711 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 10:03:24.530711 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:24.530711 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:24.530711 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:24.530711 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:24.530711 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:24.530711 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:24.530711 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:24.530711 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:24.530711 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:24.530711 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:24.530711 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:24.530711 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:24.530711 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:24.530711 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:24.530711 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:24.530711 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:24.531930 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 10:03:24.531930 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 10:03:24.531930 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 10:03:24.531930 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 10:03:24.531930 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 10:03:24.531930 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 10:03:24.531930 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:03:24.531930 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:03:24.531930 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 334/680] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Jun 22 10:03:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:03:24.532585 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770b9c8d-fe0b-470f-93dc-ca133d1aaf05 None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:24.532662 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770b9c8d-fe0b-470f-93dc-ca133d1aaf05 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:24.533024 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770b9c8d-fe0b-470f-93dc-ca133d1aaf05 None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:24.534578 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 335/681] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:03:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:03:24.535058 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770b9c8d-fe0b-470f-93dc-ca133d1aaf05 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:24.545971 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b71f8d-b6cf-42f7-aa95-73516a108cf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:24.546741 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b71f8d-b6cf-42f7-aa95-73516a108cf4 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:24.547092 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b71f8d-b6cf-42f7-aa95-73516a108cf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:24.547439 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b71f8d-b6cf-42f7-aa95-73516a108cf4 None admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:24.548352 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b71f8d-b6cf-42f7-aa95-73516a108cf4 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:24.548729 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b71f8d-b6cf-42f7-aa95-73516a108cf4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:24.550320 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b71f8d-b6cf-42f7-aa95-73516a108cf4 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:24.580632 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 347/682] 10.222.0.43 () {56 vars in 1135 bytes} [Wed Jun 22 10:03:24 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:24.580632 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b71f8d-b6cf-42f7-aa95-73516a108cf4 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:24.638652 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:24.659143 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770b9c8d-fe0b-470f-93dc-ca133d1aaf05 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:24.693753 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b71f8d-b6cf-42f7-aa95-73516a108cf4 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:24.694068 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d70381-8c48-4def-87e7-d748f67b33fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:24.694726 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d70381-8c48-4def-87e7-d748f67b33fd None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:24.695009 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d70381-8c48-4def-87e7-d748f67b33fd None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:24.695358 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d70381-8c48-4def-87e7-d748f67b33fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:24.696710 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d70381-8c48-4def-87e7-d748f67b33fd None admin] RBAC: Adding query filter params (role.id=18493ce78e7c480c9202245b6d93cb4c, scope.project.id=e03f1c17e0884f188231d2949dc6f956, user.id=9bbcb3d4dc704dfdb0097abc594ca855) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:24.696710 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d70381-8c48-4def-87e7-d748f67b33fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:24.697860 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d70381-8c48-4def-87e7-d748f67b33fd None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:24.703824 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 336/683] 10.222.0.43 () {56 vars in 1374 bytes} [Wed Jun 22 10:03:24 2022] GET /identity/v3/role_assignments?user.id=9bbcb3d4dc704dfdb0097abc594ca855&scope.project.id=e03f1c17e0884f188231d2949dc6f956&role.id=18493ce78e7c480c9202245b6d93cb4c => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:24.710065 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1297ce5e-544d-4e90-8a99-125d7a888384 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:24.710065 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1297ce5e-544d-4e90-8a99-125d7a888384 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:24.710065 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1297ce5e-544d-4e90-8a99-125d7a888384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:24.727116 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-1297ce5e-544d-4e90-8a99-125d7a888384 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:03:24.728624 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-1297ce5e-544d-4e90-8a99-125d7a888384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:03:24.738960 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1208ea7-69bd-4df4-b3b0-44baf54fd343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:24.739727 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1208ea7-69bd-4df4-b3b0-44baf54fd343 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:24.740009 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1208ea7-69bd-4df4-b3b0-44baf54fd343 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:24.740408 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1208ea7-69bd-4df4-b3b0-44baf54fd343 None admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:24.741380 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1208ea7-69bd-4df4-b3b0-44baf54fd343 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:24.741804 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1208ea7-69bd-4df4-b3b0-44baf54fd343 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:24.743352 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1208ea7-69bd-4df4-b3b0-44baf54fd343 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:24.758181 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 348/684] 10.222.0.43 () {56 vars in 1148 bytes} [Wed Jun 22 10:03:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:24.759229 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1208ea7-69bd-4df4-b3b0-44baf54fd343 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:24.781669 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:24.814214 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 337/685] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:03:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 10:03:24.815706 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1297ce5e-544d-4e90-8a99-125d7a888384 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:24.874668 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1208ea7-69bd-4df4-b3b0-44baf54fd343 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:24.885302 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:24.918647 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea5b6c4-dba2-474c-82d1-0f57bd375077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:24.919929 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea5b6c4-dba2-474c-82d1-0f57bd375077 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:24.920564 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea5b6c4-dba2-474c-82d1-0f57bd375077 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:24.920855 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea5b6c4-dba2-474c-82d1-0f57bd375077 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:24.969081 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1297ce5e-544d-4e90-8a99-125d7a888384 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:25.002527 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea5b6c4-dba2-474c-82d1-0f57bd375077 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:25.004101 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea5b6c4-dba2-474c-82d1-0f57bd375077 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:25.009054 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2fb60b-0fab-45e8-84d5-f3cdbbf38500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:25.009735 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2fb60b-0fab-45e8-84d5-f3cdbbf38500 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:25.010346 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2fb60b-0fab-45e8-84d5-f3cdbbf38500 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:25.010346 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2fb60b-0fab-45e8-84d5-f3cdbbf38500 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:25.011119 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2fb60b-0fab-45e8-84d5-f3cdbbf38500 None admin] RBAC: Adding query filter params (role.id=18493ce78e7c480c9202245b6d93cb4c, scope.project.id=e03f1c17e0884f188231d2949dc6f956, user.id=fe93d4c0737249fd8623bb5ce188e34e) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:25.011425 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2fb60b-0fab-45e8-84d5-f3cdbbf38500 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:25.012856 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2fb60b-0fab-45e8-84d5-f3cdbbf38500 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:25.020933 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 338/686] 10.222.0.43 () {56 vars in 1374 bytes} [Wed Jun 22 10:03:24 2022] GET /identity/v3/role_assignments?user.id=fe93d4c0737249fd8623bb5ce188e34e&scope.project.id=e03f1c17e0884f188231d2949dc6f956&role.id=18493ce78e7c480c9202245b6d93cb4c => generated 608 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:25.020933 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2fb60b-0fab-45e8-84d5-f3cdbbf38500 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:25.075181 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:25.205982 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2fb60b-0fab-45e8-84d5-f3cdbbf38500 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:25.228301 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 349/687] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Jun 22 10:03:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 10:03:25.232314 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea5b6c4-dba2-474c-82d1-0f57bd375077 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:25.245042 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:25.269167 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9995b5a2-3812-43d0-989f-ceaa65b4ce82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:25.270357 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9995b5a2-3812-43d0-989f-ceaa65b4ce82 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:25.270824 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9995b5a2-3812-43d0-989f-ceaa65b4ce82 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:25.271320 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9995b5a2-3812-43d0-989f-ceaa65b4ce82 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:25.289422 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9995b5a2-3812-43d0-989f-ceaa65b4ce82 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:25.290381 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9995b5a2-3812-43d0-989f-ceaa65b4ce82 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:25.314263 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-9995b5a2-3812-43d0-989f-ceaa65b4ce82 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:03:25.314263 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:25.314263 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:25.314263 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:25.314263 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:25.314263 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:25.314263 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:25.314263 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:25.314263 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:25.314263 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:25.314263 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:25.314263 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:25.314263 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:03:25.314263 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:03:25.314263 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:03:25.315247 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:03:25.315247 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:25.315247 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:25.315247 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:25.315247 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:25.315247 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:25.315247 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:25.315247 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:25.315247 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:25.315247 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:25.315247 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:25.315247 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:25.315247 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:25.315247 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:25.315247 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:25.315247 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:25.315247 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:25.316146 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:03:25.316146 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:03:25.316146 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:03:25.316146 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:03:25.317803 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 339/688] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jun 22 10:03:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:03:25.326965 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9995b5a2-3812-43d0-989f-ceaa65b4ce82 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:25.381037 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea5b6c4-dba2-474c-82d1-0f57bd375077 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:25.428000 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd99b17-d4f5-4f3d-ac7b-d2f8e4c46920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:25.429206 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd99b17-d4f5-4f3d-ac7b-d2f8e4c46920 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:25.429810 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd99b17-d4f5-4f3d-ac7b-d2f8e4c46920 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:25.430296 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd99b17-d4f5-4f3d-ac7b-d2f8e4c46920 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:25.446489 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd99b17-d4f5-4f3d-ac7b-d2f8e4c46920 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:25.448978 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd99b17-d4f5-4f3d-ac7b-d2f8e4c46920 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:25.449792 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:25.458758 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9995b5a2-3812-43d0-989f-ceaa65b4ce82 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:25.472417 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-1fd99b17-d4f5-4f3d-ac7b-d2f8e4c46920 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:03:25.472417 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:25.472417 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:25.472417 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:25.472417 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:25.472417 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:25.472417 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:25.472417 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:25.472417 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:25.472417 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:25.472417 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:25.472417 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:25.472417 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:03:25.472417 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:03:25.472417 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:03:25.474084 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:03:25.474084 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:25.474084 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:25.474084 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:25.474084 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:25.474084 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:25.474084 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:25.474084 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:25.474084 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:25.474084 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:25.474084 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:25.474084 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:25.474084 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:25.474084 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:25.474084 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:25.474084 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:25.474084 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:25.475328 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:03:25.475328 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:03:25.475328 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:03:25.475328 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:03:25.475328 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 350/689] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jun 22 10:03:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 10:03:25.479801 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd99b17-d4f5-4f3d-ac7b-d2f8e4c46920 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:25.506756 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cf8891-68f2-44c5-a76d-2a7bbf9b7398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:25.507874 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cf8891-68f2-44c5-a76d-2a7bbf9b7398 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:25.509298 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cf8891-68f2-44c5-a76d-2a7bbf9b7398 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:25.510676 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cf8891-68f2-44c5-a76d-2a7bbf9b7398 None admin] PATH_INFO: `/v3/domains` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:25.511822 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cf8891-68f2-44c5-a76d-2a7bbf9b7398 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:25.513510 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cf8891-68f2-44c5-a76d-2a7bbf9b7398 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:25.515137 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cf8891-68f2-44c5-a76d-2a7bbf9b7398 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:25.540609 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 340/690] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Jun 22 10:03:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:03:25.546238 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cf8891-68f2-44c5-a76d-2a7bbf9b7398 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:25.608226 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:25.653763 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd99b17-d4f5-4f3d-ac7b-d2f8e4c46920 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:25.687466 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cf8891-68f2-44c5-a76d-2a7bbf9b7398 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:25.698646 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5929733b-e76c-45aa-af4a-7cd764fa3ee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:25.700055 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5929733b-e76c-45aa-af4a-7cd764fa3ee6 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:25.700582 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5929733b-e76c-45aa-af4a-7cd764fa3ee6 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:25.701271 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5929733b-e76c-45aa-af4a-7cd764fa3ee6 None admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:25.702262 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5929733b-e76c-45aa-af4a-7cd764fa3ee6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:25.702979 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5929733b-e76c-45aa-af4a-7cd764fa3ee6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:25.705292 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5929733b-e76c-45aa-af4a-7cd764fa3ee6 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:25.723016 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 351/691] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Jun 22 10:03:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:03:25.725070 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c315131a-584c-4626-9b4f-7b035fb950f2 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:25.725554 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c315131a-584c-4626-9b4f-7b035fb950f2 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:25.726231 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c315131a-584c-4626-9b4f-7b035fb950f2 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:25.727895 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 352/692] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:03:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:03:25.729113 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c315131a-584c-4626-9b4f-7b035fb950f2 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:25.735980 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfdd194-c7ef-4558-bc6e-b52441c53a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:25.736784 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfdd194-c7ef-4558-bc6e-b52441c53a09 None admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:25.737175 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfdd194-c7ef-4558-bc6e-b52441c53a09 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:25.737555 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfdd194-c7ef-4558-bc6e-b52441c53a09 None admin] PATH_INFO: `/v3/users` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:25.738417 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfdd194-c7ef-4558-bc6e-b52441c53a09 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:25.741187 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfdd194-c7ef-4558-bc6e-b52441c53a09 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:25.764051 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 341/693] 10.222.0.43 () {60 vars in 1132 bytes} [Wed Jun 22 10:03:25 2022] POST /identity/v3/users => generated 254 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:03:25.765526 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a23053f-fb69-40f2-9979-40ff18947663 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:25.765961 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a23053f-fb69-40f2-9979-40ff18947663 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:25.766380 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a23053f-fb69-40f2-9979-40ff18947663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:25.788728 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-5a23053f-fb69-40f2-9979-40ff18947663 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:03:25.790223 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-5a23053f-fb69-40f2-9979-40ff18947663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:03:25.793574 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:25.860282 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c315131a-584c-4626-9b4f-7b035fb950f2 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:25.876985 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 342/694] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:03:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 10:03:25.884518 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:25.900891 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f612468-134a-4970-80e9-95ef4dfc4eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:25.901789 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f612468-134a-4970-80e9-95ef4dfc4eac None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:25.902140 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f612468-134a-4970-80e9-95ef4dfc4eac None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:25.902423 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f612468-134a-4970-80e9-95ef4dfc4eac None admin] PATH_INFO: `/v3/projects/service` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:25.906760 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a23053f-fb69-40f2-9979-40ff18947663 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:25.911625 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f612468-134a-4970-80e9-95ef4dfc4eac None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:25.912586 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f612468-134a-4970-80e9-95ef4dfc4eac None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:25.929191 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-7f612468-134a-4970-80e9-95ef4dfc4eac None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:03:25.929191 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:25.929191 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:25.929191 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:25.929191 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:25.929191 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:25.929191 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:25.929191 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:25.929191 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:25.929191 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:25.929191 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:25.929191 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:25.929191 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 10:03:25.929191 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 10:03:25.929191 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 10:03:25.930210 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 10:03:25.930210 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:25.930210 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:25.930210 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:25.930210 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:25.930210 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:25.930210 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:25.930210 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:25.930210 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:25.930210 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:25.930210 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:25.930210 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:25.930210 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:25.930210 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:25.930210 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:25.930210 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:25.930210 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:25.931088 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 10:03:25.931088 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 10:03:25.931088 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 10:03:25.931088 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 10:03:25.931088 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 10:03:25.931088 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 10:03:25.931088 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:03:25.931088 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:03:25.931088 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 353/695] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Jun 22 10:03:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:03:25.936525 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f612468-134a-4970-80e9-95ef4dfc4eac None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:26.032459 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a23053f-fb69-40f2-9979-40ff18947663 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:26.044016 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f612468-134a-4970-80e9-95ef4dfc4eac None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:26.074446 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ed63cc-e90f-4c20-8aa1-6a1caf04ecd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:26.075664 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ed63cc-e90f-4c20-8aa1-6a1caf04ecd0 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:26.076131 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ed63cc-e90f-4c20-8aa1-6a1caf04ecd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:26.076641 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ed63cc-e90f-4c20-8aa1-6a1caf04ecd0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:26.081144 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1a9c41-7219-4a32-906c-9af4a686b5fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:26.081848 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1a9c41-7219-4a32-906c-9af4a686b5fa None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:26.082144 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1a9c41-7219-4a32-906c-9af4a686b5fa None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:26.082430 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1a9c41-7219-4a32-906c-9af4a686b5fa None admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:26.083882 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1a9c41-7219-4a32-906c-9af4a686b5fa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:26.084179 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1a9c41-7219-4a32-906c-9af4a686b5fa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:26.087715 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:26.091137 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1a9c41-7219-4a32-906c-9af4a686b5fa None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:26.091644 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ed63cc-e90f-4c20-8aa1-6a1caf04ecd0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:03:26.101329 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-12ed63cc-e90f-4c20-8aa1-6a1caf04ecd0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 10:03:26.101329 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:26.101329 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:26.101329 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:26.101329 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:26.101329 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:26.101329 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:26.101329 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:26.101329 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:26.101329 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:26.101329 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:26.101329 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:26.101329 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:03:26.101329 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:03:26.101329 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:03:26.101329 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:03:26.102291 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:03:26.102291 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:03:26.102291 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:03:26.102291 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:03:26.102291 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:26.102291 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:26.102291 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:26.102291 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:26.102291 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:26.102291 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:26.102291 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:26.102291 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:26.102291 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:26.102291 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:26.102291 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:26.102291 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:26.103122 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:26.103122 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:26.103122 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:26.103122 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:26.103122 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:03:26.103122 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:03:26.103122 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:03:26.103122 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:03:26.103122 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:03:26.103122 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:03:26.103122 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 10:03:26.103122 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:03:26.105176 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 354/696] 10.222.0.43 () {56 vars in 1148 bytes} [Wed Jun 22 10:03:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:03:26.107687 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 343/697] 10.222.0.43 () {56 vars in 1096 bytes} [Wed Jun 22 10:03:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:03:26.111923 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1a9c41-7219-4a32-906c-9af4a686b5fa None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:26.114489 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ed63cc-e90f-4c20-8aa1-6a1caf04ecd0 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:26.156480 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:26.218302 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1a9c41-7219-4a32-906c-9af4a686b5fa None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:26.233525 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ed63cc-e90f-4c20-8aa1-6a1caf04ecd0 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:26.256777 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5472087f-c102-41ac-a406-51d712eb1039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:26.257496 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5472087f-c102-41ac-a406-51d712eb1039 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:26.257834 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5472087f-c102-41ac-a406-51d712eb1039 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:26.258122 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5472087f-c102-41ac-a406-51d712eb1039 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:26.258985 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5472087f-c102-41ac-a406-51d712eb1039 None admin] RBAC: Adding query filter params (role.id=18493ce78e7c480c9202245b6d93cb4c, scope.project.id=e03f1c17e0884f188231d2949dc6f956, user.id=9566f8cca2574f4cb5edcbf384f368a7) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:26.259305 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5472087f-c102-41ac-a406-51d712eb1039 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:26.261084 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5472087f-c102-41ac-a406-51d712eb1039 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:26.267537 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 355/698] 10.222.0.43 () {56 vars in 1374 bytes} [Wed Jun 22 10:03:26 2022] GET /identity/v3/role_assignments?user.id=9566f8cca2574f4cb5edcbf384f368a7&scope.project.id=e03f1c17e0884f188231d2949dc6f956&role.id=18493ce78e7c480c9202245b6d93cb4c => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:26.277405 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bba8fa2-1c6c-42d1-959d-6a94d386b6fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:26.278510 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bba8fa2-1c6c-42d1-959d-6a94d386b6fa None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:26.279001 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bba8fa2-1c6c-42d1-959d-6a94d386b6fa None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:26.279505 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bba8fa2-1c6c-42d1-959d-6a94d386b6fa None admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:26.280502 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bba8fa2-1c6c-42d1-959d-6a94d386b6fa None admin] RBAC: Adding query filter params (name=admin) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:26.281029 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bba8fa2-1c6c-42d1-959d-6a94d386b6fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:26.282816 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bba8fa2-1c6c-42d1-959d-6a94d386b6fa None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:26.295036 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 344/699] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Jun 22 10:03:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:03:26.301065 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5472087f-c102-41ac-a406-51d712eb1039 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:26.464991 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5472087f-c102-41ac-a406-51d712eb1039 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:26.470549 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:26.514521 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e70430-67cc-42ab-a234-b3b539bc4afd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:26.515333 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e70430-67cc-42ab-a234-b3b539bc4afd None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:26.515621 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e70430-67cc-42ab-a234-b3b539bc4afd None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:26.515904 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e70430-67cc-42ab-a234-b3b539bc4afd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:26.529393 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e70430-67cc-42ab-a234-b3b539bc4afd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:26.530938 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e70430-67cc-42ab-a234-b3b539bc4afd None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:26.553565 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-78e70430-67cc-42ab-a234-b3b539bc4afd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:03:26.553565 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:26.553565 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:26.553565 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:26.553565 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:26.553565 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:26.553565 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:26.553565 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:26.553565 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:26.553565 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:26.553565 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:26.553565 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:26.553565 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:03:26.553565 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:03:26.553565 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:03:26.554538 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:03:26.554538 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:26.554538 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:26.554538 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:26.554538 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:26.554538 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:26.554538 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:26.554538 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:26.554538 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:26.554538 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:26.554538 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:26.554538 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:26.554538 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:26.554538 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:26.554538 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:26.554538 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:26.554538 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:26.555424 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:03:26.555424 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:03:26.555424 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:03:26.555424 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:03:26.555424 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 356/700] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jun 22 10:03:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:03:26.561896 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bba8fa2-1c6c-42d1-959d-6a94d386b6fa None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:26.649498 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:26.703712 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bba8fa2-1c6c-42d1-959d-6a94d386b6fa None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:26.752729 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2ea692-9229-4caa-bd77-e8b6cbae03d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:26.753809 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2ea692-9229-4caa-bd77-e8b6cbae03d8 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:26.754298 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2ea692-9229-4caa-bd77-e8b6cbae03d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:26.755374 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2ea692-9229-4caa-bd77-e8b6cbae03d8 None admin] PATH_INFO: `/v3/domains` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:26.756312 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2ea692-9229-4caa-bd77-e8b6cbae03d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:26.756844 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2ea692-9229-4caa-bd77-e8b6cbae03d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:26.758485 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2ea692-9229-4caa-bd77-e8b6cbae03d8 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:26.775711 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 345/701] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Jun 22 10:03:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:26.781283 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e70430-67cc-42ab-a234-b3b539bc4afd None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:26.937110 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e70430-67cc-42ab-a234-b3b539bc4afd None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:26.973668 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9241f303-45b7-4429-b6a6-998f64a2f6cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:26.974610 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9241f303-45b7-4429-b6a6-998f64a2f6cf None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:26.974993 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9241f303-45b7-4429-b6a6-998f64a2f6cf None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:26.975280 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9241f303-45b7-4429-b6a6-998f64a2f6cf None admin] PATH_INFO: `/v3/users/nova` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:26.983100 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9241f303-45b7-4429-b6a6-998f64a2f6cf None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:26.984559 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9241f303-45b7-4429-b6a6-998f64a2f6cf None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:27.000307 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-9241f303-45b7-4429-b6a6-998f64a2f6cf None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 22 10:03:27.000307 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:27.000307 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:27.000307 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:27.000307 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:27.000307 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:27.000307 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:27.000307 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:27.000307 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:27.000307 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:27.000307 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:27.000307 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:27.000307 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 10:03:27.000307 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 10:03:27.000307 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 10:03:27.000307 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 10:03:27.001282 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:27.001282 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:27.001282 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 10:03:27.001282 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:03:27.001282 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 10:03:27.001282 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:03:27.001282 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:27.001282 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:27.001282 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:27.001282 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:27.001282 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:27.001282 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:27.001282 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:27.001282 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:27.001282 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:27.001282 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:27.001282 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:27.001282 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:27.002232 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:27.002232 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:27.002232 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 10:03:27.002232 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 10:03:27.002232 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 10:03:27.002232 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 10:03:27.002232 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 10:03:27.002232 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 10:03:27.002232 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 22 10:03:27.002232 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:03:27.002232 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 357/702] 10.222.0.43 () {56 vars in 1093 bytes} [Wed Jun 22 10:03:26 2022] GET /identity/v3/users/nova => generated 82 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:03:27.009012 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2ea692-9229-4caa-bd77-e8b6cbae03d8 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:27.155905 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2ea692-9229-4caa-bd77-e8b6cbae03d8 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:27.180473 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:27.201537 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb416c1-5c7f-41be-828e-6e62f9158853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:27.202161 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb416c1-5c7f-41be-828e-6e62f9158853 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:27.202443 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb416c1-5c7f-41be-828e-6e62f9158853 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:27.202721 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb416c1-5c7f-41be-828e-6e62f9158853 None admin] PATH_INFO: `/v3/users` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:27.203562 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb416c1-5c7f-41be-828e-6e62f9158853 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:27.203870 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb416c1-5c7f-41be-828e-6e62f9158853 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:27.205304 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb416c1-5c7f-41be-828e-6e62f9158853 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:27.224216 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 346/703] 10.222.0.43 () {56 vars in 1133 bytes} [Wed Jun 22 10:03:27 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:27.229872 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9241f303-45b7-4429-b6a6-998f64a2f6cf None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:27.252987 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:27.373410 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9241f303-45b7-4429-b6a6-998f64a2f6cf None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:27.422832 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a172a2d-3643-411d-844f-98d74764bfda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:27.423498 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a172a2d-3643-411d-844f-98d74764bfda None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:27.423785 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a172a2d-3643-411d-844f-98d74764bfda None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:27.424070 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a172a2d-3643-411d-844f-98d74764bfda None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:27.485294 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c640b41a-0153-460d-ab13-7e7284237ff3 None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:27.485605 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c640b41a-0153-460d-ab13-7e7284237ff3 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:27.485801 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c640b41a-0153-460d-ab13-7e7284237ff3 None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:27.487285 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 347/704] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:03:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:03:27.495701 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ea4914-b3d9-48fa-bdc7-7272fd21b6ca None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:27.495701 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ea4914-b3d9-48fa-bdc7-7272fd21b6ca None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:27.495701 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ea4914-b3d9-48fa-bdc7-7272fd21b6ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:27.520610 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a172a2d-3643-411d-844f-98d74764bfda None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:27.522662 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a172a2d-3643-411d-844f-98d74764bfda None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:27.530764 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-84ea4914-b3d9-48fa-bdc7-7272fd21b6ca None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:03:27.532256 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-84ea4914-b3d9-48fa-bdc7-7272fd21b6ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:03:27.542247 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:27.633945 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 358/705] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Jun 22 10:03:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 10:03:27.641588 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a172a2d-3643-411d-844f-98d74764bfda None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:27.699381 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 348/706] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:03:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 10:03:27.700808 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3ae9ed-e151-411b-8365-45e1eef30d42 None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:27.701206 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3ae9ed-e151-411b-8365-45e1eef30d42 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:27.701491 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3ae9ed-e151-411b-8365-45e1eef30d42 None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:27.703015 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 349/707] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:03:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:03:27.709189 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90e951b-5063-4c9a-9109-5cbe41db1454 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:27.709480 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90e951b-5063-4c9a-9109-5cbe41db1454 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:27.709792 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90e951b-5063-4c9a-9109-5cbe41db1454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:27.736463 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-b90e951b-5063-4c9a-9109-5cbe41db1454 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:03:27.737848 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-b90e951b-5063-4c9a-9109-5cbe41db1454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:03:27.770069 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a172a2d-3643-411d-844f-98d74764bfda None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:27.788882 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:27.810013 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c562ce68-e21e-4a4c-8644-e3065736c3b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:27.810822 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c562ce68-e21e-4a4c-8644-e3065736c3b7 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:27.811113 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c562ce68-e21e-4a4c-8644-e3065736c3b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:27.811456 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c562ce68-e21e-4a4c-8644-e3065736c3b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:27.812569 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 350/708] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:03:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 10:03:27.813730 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90e951b-5063-4c9a-9109-5cbe41db1454 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:27.823564 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c562ce68-e21e-4a4c-8644-e3065736c3b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:27.825032 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c562ce68-e21e-4a4c-8644-e3065736c3b7 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:27.844422 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-c562ce68-e21e-4a4c-8644-e3065736c3b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:03:27.844422 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:27.844422 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:27.844422 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:27.844422 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:27.844422 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:27.844422 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:27.844422 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:27.844422 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:27.844422 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:27.844422 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:27.844422 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:27.844422 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:03:27.844422 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:03:27.844422 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:03:27.845330 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:03:27.845330 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:27.845330 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:27.845330 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:27.845330 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:27.845330 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:27.845330 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:27.845330 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:27.845330 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:27.845330 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:27.845330 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:27.845330 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:27.845330 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:27.845330 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:27.845330 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:27.845330 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:27.845330 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:27.846243 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:03:27.846243 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:03:27.846243 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:03:27.846243 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:03:27.849959 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 359/709] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jun 22 10:03:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:03:27.851065 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c562ce68-e21e-4a4c-8644-e3065736c3b7 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:27.862407 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:27.925860 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90e951b-5063-4c9a-9109-5cbe41db1454 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:27.964029 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c562ce68-e21e-4a4c-8644-e3065736c3b7 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:27.967393 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fb2f5b-cfd8-4ad9-80d6-f4cc36b2b819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:27.968427 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fb2f5b-cfd8-4ad9-80d6-f4cc36b2b819 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:27.968848 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fb2f5b-cfd8-4ad9-80d6-f4cc36b2b819 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:27.969223 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fb2f5b-cfd8-4ad9-80d6-f4cc36b2b819 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:27.970025 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fb2f5b-cfd8-4ad9-80d6-f4cc36b2b819 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:27.971521 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fb2f5b-cfd8-4ad9-80d6-f4cc36b2b819 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:27.987871 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-e5fb2f5b-cfd8-4ad9-80d6-f4cc36b2b819 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 22 10:03:27.987871 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:27.987871 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 10:03:27.987871 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 10:03:27.987871 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 10:03:27.987871 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 10:03:27.987871 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 10:03:27.987871 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 10:03:27.987871 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 22 10:03:27.987871 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:03:27.987871 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 10:03:27.987871 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:03:27.987871 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:27.987871 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:27.987871 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:27.987871 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:27.989086 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:27.989086 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:27.989086 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:27.989086 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:27.989086 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:27.989086 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:27.989086 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:27.989086 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 10:03:27.989086 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 10:03:27.989086 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 10:03:27.989086 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 10:03:27.989086 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:27.989086 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:27.989086 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:27.989086 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:27.989086 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:27.990159 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:27.990159 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:27.990159 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:27.990159 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:27.990159 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:27.990159 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:27.990159 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:27.990159 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:27.990159 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:27.990159 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:27.990159 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:27.990159 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 10:03:27.990159 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 10:03:27.990159 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 22 10:03:27.990159 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:03:27.990159 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 351/710] 10.222.0.43 () {56 vars in 1129 bytes} [Wed Jun 22 10:03:27 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:03:27.991064 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fb2f5b-cfd8-4ad9-80d6-f4cc36b2b819 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:28.006388 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90535877-0bce-42ef-9be5-4b7a17616b17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:28.007541 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90535877-0bce-42ef-9be5-4b7a17616b17 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:28.008101 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90535877-0bce-42ef-9be5-4b7a17616b17 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:28.008597 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90535877-0bce-42ef-9be5-4b7a17616b17 None admin] PATH_INFO: `/v3/services/network` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:28.009464 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90535877-0bce-42ef-9be5-4b7a17616b17 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:28.011210 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90535877-0bce-42ef-9be5-4b7a17616b17 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:28.028573 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-90535877-0bce-42ef-9be5-4b7a17616b17 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 22 10:03:28.028573 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:28.028573 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 10:03:28.028573 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 10:03:28.028573 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 10:03:28.028573 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 10:03:28.028573 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 10:03:28.028573 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 10:03:28.028573 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 22 10:03:28.028573 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:03:28.028573 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 10:03:28.028573 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:03:28.028573 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:28.028573 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:28.028573 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:28.028573 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:28.028573 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:28.029683 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:28.029683 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:28.029683 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:28.029683 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:28.029683 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:28.029683 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:28.029683 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 10:03:28.029683 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 10:03:28.029683 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 10:03:28.029683 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 10:03:28.029683 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:28.029683 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:28.029683 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:28.029683 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:28.029683 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:28.029683 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:28.030598 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:28.030598 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:28.030598 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:28.030598 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:28.030598 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:28.030598 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:28.030598 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:28.030598 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:28.030598 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:28.030598 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:28.030598 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 10:03:28.030598 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 10:03:28.030598 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 22 10:03:28.030598 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:03:28.033618 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 360/711] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Jun 22 10:03:27 2022] GET /identity/v3/services/network => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:03:28.034712 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90535877-0bce-42ef-9be5-4b7a17616b17 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:28.071743 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:28.115453 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fb2f5b-cfd8-4ad9-80d6-f4cc36b2b819 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:28.118178 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:28.152973 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea2ddca-4f27-4d69-8569-bc4bbe111ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:28.153191 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90535877-0bce-42ef-9be5-4b7a17616b17 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:28.154038 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea2ddca-4f27-4d69-8569-bc4bbe111ca7 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:28.154577 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea2ddca-4f27-4d69-8569-bc4bbe111ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:28.154997 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea2ddca-4f27-4d69-8569-bc4bbe111ca7 None admin] PATH_INFO: `/v3/domains` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:28.155949 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea2ddca-4f27-4d69-8569-bc4bbe111ca7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:28.156841 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea2ddca-4f27-4d69-8569-bc4bbe111ca7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:28.158421 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea2ddca-4f27-4d69-8569-bc4bbe111ca7 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:28.171581 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 352/712] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Jun 22 10:03:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:28.172704 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea2ddca-4f27-4d69-8569-bc4bbe111ca7 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:28.197614 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9a52f9-92ab-460b-83f5-011aec8c76ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:28.198470 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9a52f9-92ab-460b-83f5-011aec8c76ed None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:28.198763 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9a52f9-92ab-460b-83f5-011aec8c76ed None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:28.199048 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9a52f9-92ab-460b-83f5-011aec8c76ed None admin] PATH_INFO: `/v3/services` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:28.199764 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9a52f9-92ab-460b-83f5-011aec8c76ed None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:28.200078 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9a52f9-92ab-460b-83f5-011aec8c76ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:28.201609 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9a52f9-92ab-460b-83f5-011aec8c76ed None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:28.207003 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 361/713] 10.222.0.43 () {56 vars in 1124 bytes} [Wed Jun 22 10:03:28 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:28.207896 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9a52f9-92ab-460b-83f5-011aec8c76ed None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:28.307595 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea2ddca-4f27-4d69-8569-bc4bbe111ca7 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:28.333878 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:28.340511 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9a52f9-92ab-460b-83f5-011aec8c76ed None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:28.347931 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ec53bd-9bac-440b-a133-d996a7afa245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:28.349141 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ec53bd-9bac-440b-a133-d996a7afa245 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:28.349427 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ec53bd-9bac-440b-a133-d996a7afa245 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:28.349726 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ec53bd-9bac-440b-a133-d996a7afa245 None admin] PATH_INFO: `/v3/services` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:28.350446 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ec53bd-9bac-440b-a133-d996a7afa245 None admin] RBAC: Adding query filter params (name=network) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:28.351019 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ec53bd-9bac-440b-a133-d996a7afa245 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:28.352416 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ec53bd-9bac-440b-a133-d996a7afa245 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:28.357548 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 353/714] 10.222.0.43 () {56 vars in 1112 bytes} [Wed Jun 22 10:03:28 2022] GET /identity/v3/services?name=network => generated 124 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:28.358396 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ec53bd-9bac-440b-a133-d996a7afa245 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:28.380194 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2908e23a-a8df-48c5-9b39-851d3b59e078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:28.381117 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2908e23a-a8df-48c5-9b39-851d3b59e078 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:28.381409 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2908e23a-a8df-48c5-9b39-851d3b59e078 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:28.381706 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2908e23a-a8df-48c5-9b39-851d3b59e078 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:28.387827 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:28.389143 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2908e23a-a8df-48c5-9b39-851d3b59e078 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:28.390772 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2908e23a-a8df-48c5-9b39-851d3b59e078 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:28.406293 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-2908e23a-a8df-48c5-9b39-851d3b59e078 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:03:28.406293 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:28.406293 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:28.406293 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:28.406293 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:28.406293 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:28.406293 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:28.406293 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:28.406293 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:28.406293 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:28.406293 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:28.406293 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:28.406293 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 10:03:28.406293 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 10:03:28.406293 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 10:03:28.407367 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 10:03:28.407367 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:28.407367 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:28.407367 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:28.407367 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:28.407367 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:28.407367 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:28.407367 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:28.407367 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:28.407367 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:28.407367 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:28.407367 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:28.407367 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:28.407367 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:28.407367 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:28.407367 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:28.407367 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:28.408279 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 10:03:28.408279 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 10:03:28.408279 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 10:03:28.408279 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 10:03:28.408279 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 10:03:28.408279 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 10:03:28.408279 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:03:28.408279 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:03:28.408279 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 362/715] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Jun 22 10:03:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:03:28.408752 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2908e23a-a8df-48c5-9b39-851d3b59e078 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:28.470014 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ec53bd-9bac-440b-a133-d996a7afa245 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:28.508229 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40ab9e7-8777-42d8-923c-cd36a03b0456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:28.509307 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40ab9e7-8777-42d8-923c-cd36a03b0456 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:28.509683 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40ab9e7-8777-42d8-923c-cd36a03b0456 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:28.509957 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40ab9e7-8777-42d8-923c-cd36a03b0456 None admin] PATH_INFO: `/v3/services` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:28.510616 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40ab9e7-8777-42d8-923c-cd36a03b0456 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:28.510918 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40ab9e7-8777-42d8-923c-cd36a03b0456 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:28.512291 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40ab9e7-8777-42d8-923c-cd36a03b0456 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:28.524798 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 354/716] 10.222.0.43 () {56 vars in 1124 bytes} [Wed Jun 22 10:03:28 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:28.524798 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499bfec3-472a-4551-8007-d821a5c598b6 None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:28.524798 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499bfec3-472a-4551-8007-d821a5c598b6 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:28.524798 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499bfec3-472a-4551-8007-d821a5c598b6 None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:28.524798 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 355/717] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:03:28 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:03:28.524798 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499bfec3-472a-4551-8007-d821a5c598b6 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:28.530364 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2908e23a-a8df-48c5-9b39-851d3b59e078 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:28.574815 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd84cb87-1136-4acb-9dde-750c07548ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:28.575454 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd84cb87-1136-4acb-9dde-750c07548ffb None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:28.575742 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd84cb87-1136-4acb-9dde-750c07548ffb None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:28.576155 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd84cb87-1136-4acb-9dde-750c07548ffb None admin] PATH_INFO: `/v3/services` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:28.576884 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd84cb87-1136-4acb-9dde-750c07548ffb None admin] RBAC: Adding query filter params (type=network) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:28.577202 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd84cb87-1136-4acb-9dde-750c07548ffb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:28.578650 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd84cb87-1136-4acb-9dde-750c07548ffb None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:28.594285 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 363/718] 10.222.0.43 () {56 vars in 1112 bytes} [Wed Jun 22 10:03:28 2022] GET /identity/v3/services?type=network => generated 124 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:28.595874 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58444c4-298b-4f4b-8aa5-984eb3017ba4 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:28.596177 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58444c4-298b-4f4b-8aa5-984eb3017ba4 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:28.596464 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58444c4-298b-4f4b-8aa5-984eb3017ba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:28.636533 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-b58444c4-298b-4f4b-8aa5-984eb3017ba4 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:03:28.637958 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-b58444c4-298b-4f4b-8aa5-984eb3017ba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:03:28.667405 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:28.679322 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:28.702567 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499bfec3-472a-4551-8007-d821a5c598b6 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:28.760110 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 364/719] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:03:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 10:03:28.775491 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49996bee-682c-4186-a0db-e810db313852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:28.776226 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49996bee-682c-4186-a0db-e810db313852 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:28.776529 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49996bee-682c-4186-a0db-e810db313852 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:28.776811 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49996bee-682c-4186-a0db-e810db313852 None admin] PATH_INFO: `/v3/projects` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:28.777757 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49996bee-682c-4186-a0db-e810db313852 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:28.778077 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49996bee-682c-4186-a0db-e810db313852 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:28.779549 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49996bee-682c-4186-a0db-e810db313852 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:28.788418 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58444c4-298b-4f4b-8aa5-984eb3017ba4 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:28.795664 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 356/720] 10.222.0.43 () {56 vars in 1148 bytes} [Wed Jun 22 10:03:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:28.802859 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49996bee-682c-4186-a0db-e810db313852 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:28.913505 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58444c4-298b-4f4b-8aa5-984eb3017ba4 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:28.943382 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49996bee-682c-4186-a0db-e810db313852 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:28.953922 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f7d7ed-47a4-41c4-9245-82e2196690c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:28.955140 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f7d7ed-47a4-41c4-9245-82e2196690c1 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:28.955630 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f7d7ed-47a4-41c4-9245-82e2196690c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:28.956126 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f7d7ed-47a4-41c4-9245-82e2196690c1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:28.972943 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f7d7ed-47a4-41c4-9245-82e2196690c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:03:28.983430 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-22f7d7ed-47a4-41c4-9245-82e2196690c1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 10:03:28.983430 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:28.983430 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:28.983430 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:28.983430 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:28.983430 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:28.983430 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:28.983430 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:28.983430 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:28.983430 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:28.983430 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:28.983430 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:28.983430 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:03:28.983430 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:03:28.983430 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:03:28.983430 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:03:28.984419 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:03:28.984419 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:03:28.984419 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:03:28.984419 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:03:28.984419 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:28.984419 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:28.984419 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:28.984419 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:28.984419 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:28.984419 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:28.984419 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:28.984419 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:28.984419 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:28.984419 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:28.984419 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:28.984419 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:28.985258 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:28.985258 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:28.985258 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:28.985258 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:28.985258 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:03:28.985258 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:03:28.985258 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:03:28.985258 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:03:28.985258 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:03:28.985258 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:03:28.985258 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 10:03:28.985258 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:03:28.987861 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a435268-298c-4efa-800d-71560f79986a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:28.988367 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 365/721] 10.222.0.43 () {56 vars in 1102 bytes} [Wed Jun 22 10:03:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 10:03:28.988839 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a435268-298c-4efa-800d-71560f79986a None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:28.989285 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a435268-298c-4efa-800d-71560f79986a None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:28.989810 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a435268-298c-4efa-800d-71560f79986a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:29.000704 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a435268-298c-4efa-800d-71560f79986a None admin] RBAC: Adding query filter params (role.id=26d9c2ab5dfc4e6d9ca80c6014123906, scope.project.id=e03f1c17e0884f188231d2949dc6f956, user.id=158a49aa3750478a84bf71b9aad24397) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:29.000704 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a435268-298c-4efa-800d-71560f79986a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:29.000948 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a435268-298c-4efa-800d-71560f79986a None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:29.011419 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 357/722] 10.222.0.43 () {56 vars in 1374 bytes} [Wed Jun 22 10:03:28 2022] GET /identity/v3/role_assignments?user.id=158a49aa3750478a84bf71b9aad24397&scope.project.id=e03f1c17e0884f188231d2949dc6f956&role.id=26d9c2ab5dfc4e6d9ca80c6014123906 => generated 259 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:29.012301 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f7d7ed-47a4-41c4-9245-82e2196690c1 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:29.044104 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:29.094753 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85ab314-e38d-4d83-9fd5-8523ff9f4ff0 None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:29.095078 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85ab314-e38d-4d83-9fd5-8523ff9f4ff0 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:29.095306 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85ab314-e38d-4d83-9fd5-8523ff9f4ff0 None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:29.097674 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 358/723] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:03:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:03:29.104035 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62673f41-2b26-4101-82de-70b6f48bad4d None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:29.104327 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62673f41-2b26-4101-82de-70b6f48bad4d None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:29.104598 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62673f41-2b26-4101-82de-70b6f48bad4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:29.124581 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-62673f41-2b26-4101-82de-70b6f48bad4d None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:03:29.125890 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-62673f41-2b26-4101-82de-70b6f48bad4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:03:29.141113 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:29.217740 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 359/724] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:03:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 10:03:29.218328 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f7d7ed-47a4-41c4-9245-82e2196690c1 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:29.263614 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7d248e-9d7e-4937-a78f-f6648bbac290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:29.264296 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7d248e-9d7e-4937-a78f-f6648bbac290 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:29.264582 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7d248e-9d7e-4937-a78f-f6648bbac290 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:29.264865 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7d248e-9d7e-4937-a78f-f6648bbac290 None admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:29.265629 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7d248e-9d7e-4937-a78f-f6648bbac290 None admin] RBAC: Adding query filter params (name=service) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:29.265972 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7d248e-9d7e-4937-a78f-f6648bbac290 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:29.267359 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7d248e-9d7e-4937-a78f-f6648bbac290 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:29.275194 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62673f41-2b26-4101-82de-70b6f48bad4d None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:29.276805 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 366/725] 10.222.0.43 () {56 vars in 1103 bytes} [Wed Jun 22 10:03:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:29.283583 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7d248e-9d7e-4937-a78f-f6648bbac290 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:29.378070 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:29.414098 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7d248e-9d7e-4937-a78f-f6648bbac290 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:29.451376 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a829dee3-b3b9-471a-85ae-574598ee4b20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:29.452187 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a829dee3-b3b9-471a-85ae-574598ee4b20 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:29.452481 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a829dee3-b3b9-471a-85ae-574598ee4b20 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:29.452777 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a829dee3-b3b9-471a-85ae-574598ee4b20 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:29.465379 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a829dee3-b3b9-471a-85ae-574598ee4b20 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:29.466802 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a829dee3-b3b9-471a-85ae-574598ee4b20 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:29.485402 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-a829dee3-b3b9-471a-85ae-574598ee4b20 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:03:29.485402 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:29.485402 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:29.485402 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:29.485402 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:29.485402 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:29.485402 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:29.485402 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:29.485402 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:29.485402 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:29.485402 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:29.485402 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:29.485402 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:03:29.485402 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:03:29.485402 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:03:29.486420 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:03:29.486420 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:29.486420 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:29.486420 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:29.486420 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:29.486420 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:29.486420 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:29.486420 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:29.486420 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:29.486420 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:29.486420 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:29.486420 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:29.486420 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:29.486420 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:29.486420 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:29.486420 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:29.486420 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:29.487724 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:03:29.487724 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:03:29.487724 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:03:29.487724 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:03:29.487724 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 367/726] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jun 22 10:03:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:03:29.493024 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a829dee3-b3b9-471a-85ae-574598ee4b20 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:29.534282 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62673f41-2b26-4101-82de-70b6f48bad4d None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:29.609034 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c2dba5-1365-479d-a74a-a6a416e82f09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:29.609867 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c2dba5-1365-479d-a74a-a6a416e82f09 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:29.610159 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c2dba5-1365-479d-a74a-a6a416e82f09 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:29.610438 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c2dba5-1365-479d-a74a-a6a416e82f09 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:29.624522 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c2dba5-1365-479d-a74a-a6a416e82f09 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:03:29.634339 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-10c2dba5-1365-479d-a74a-a6a416e82f09 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 10:03:29.634339 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:29.634339 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:29.634339 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:29.634339 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:29.634339 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:29.634339 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:29.634339 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:29.634339 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:29.634339 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:29.634339 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:29.634339 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:29.634339 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:03:29.634339 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:03:29.634339 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:03:29.634339 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:03:29.635284 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:03:29.635284 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:03:29.635284 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:03:29.635284 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:03:29.635284 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:29.635284 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:29.635284 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:29.635284 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:29.635284 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:29.635284 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:29.635284 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:29.635284 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:29.635284 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:29.635284 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:29.635284 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:29.635284 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:29.636523 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:29.636523 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:29.636523 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:29.636523 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:29.636523 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:03:29.636523 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:03:29.636523 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:03:29.636523 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:03:29.636523 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:03:29.636523 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:03:29.636523 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 10:03:29.636523 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:03:29.636523 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 360/727] 10.222.0.43 () {56 vars in 1096 bytes} [Wed Jun 22 10:03:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 361 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:03:29.643499 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c2dba5-1365-479d-a74a-a6a416e82f09 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:29.662413 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:29.690952 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a829dee3-b3b9-471a-85ae-574598ee4b20 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:29.742538 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:29.770726 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f61c0ea-a490-4716-a43a-479c427b1272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:29.771403 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f61c0ea-a490-4716-a43a-479c427b1272 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:29.771690 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f61c0ea-a490-4716-a43a-479c427b1272 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:29.771972 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f61c0ea-a490-4716-a43a-479c427b1272 None admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:29.772995 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f61c0ea-a490-4716-a43a-479c427b1272 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:29.775593 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f61c0ea-a490-4716-a43a-479c427b1272 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:29.781475 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f61c0ea-a490-4716-a43a-479c427b1272 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:29.805829 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 368/728] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Jun 22 10:03:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:03:29.809921 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f61c0ea-a490-4716-a43a-479c427b1272 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:29.835448 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c2dba5-1365-479d-a74a-a6a416e82f09 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:29.893758 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c68cc7-e290-4b83-9c9e-c7b978abe20a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:29.894436 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c68cc7-e290-4b83-9c9e-c7b978abe20a None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:29.894724 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c68cc7-e290-4b83-9c9e-c7b978abe20a None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:29.895111 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c68cc7-e290-4b83-9c9e-c7b978abe20a None admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:29.895918 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c68cc7-e290-4b83-9c9e-c7b978abe20a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:29.896231 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c68cc7-e290-4b83-9c9e-c7b978abe20a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:29.897613 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c68cc7-e290-4b83-9c9e-c7b978abe20a None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:29.908292 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 361/729] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Jun 22 10:03:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:29.914256 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c68cc7-e290-4b83-9c9e-c7b978abe20a None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:30.011535 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f61c0ea-a490-4716-a43a-479c427b1272 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:30.052593 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:30.083454 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d423ecc0-5d74-4b1f-8ab0-d733bf1dfef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:30.084277 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d423ecc0-5d74-4b1f-8ab0-d733bf1dfef2 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:30.084564 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d423ecc0-5d74-4b1f-8ab0-d733bf1dfef2 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:30.084840 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d423ecc0-5d74-4b1f-8ab0-d733bf1dfef2 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:30.096201 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d423ecc0-5d74-4b1f-8ab0-d733bf1dfef2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:30.097659 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d423ecc0-5d74-4b1f-8ab0-d733bf1dfef2 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:30.123828 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c68cc7-e290-4b83-9c9e-c7b978abe20a None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:30.128426 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-d423ecc0-5d74-4b1f-8ab0-d733bf1dfef2 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 22 10:03:30.128426 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:30.128426 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:30.128426 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:30.128426 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:30.128426 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:30.128426 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:30.128426 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:30.128426 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:30.128426 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:30.128426 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:30.128426 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:30.128426 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 10:03:30.128426 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 10:03:30.128426 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 10:03:30.128426 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 10:03:30.129897 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:30.129897 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:30.129897 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 10:03:30.129897 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:03:30.129897 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 10:03:30.129897 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:03:30.129897 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:30.129897 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:30.129897 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:30.129897 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:30.129897 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:30.129897 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:30.129897 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:30.129897 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:30.129897 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:30.129897 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:30.129897 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:30.129897 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:30.131271 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:30.131271 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:30.131271 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 10:03:30.131271 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 10:03:30.131271 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 10:03:30.131271 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 10:03:30.131271 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 10:03:30.131271 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 10:03:30.131271 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 22 10:03:30.131271 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:03:30.131271 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 369/730] 10.222.0.43 () {56 vars in 1117 bytes} [Wed Jun 22 10:03:29 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:03:30.136945 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d423ecc0-5d74-4b1f-8ab0-d733bf1dfef2 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:30.185776 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57ce962-1fc7-4f6f-8854-fc0d9c038e30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:30.186571 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57ce962-1fc7-4f6f-8854-fc0d9c038e30 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:30.186855 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57ce962-1fc7-4f6f-8854-fc0d9c038e30 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:30.187131 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57ce962-1fc7-4f6f-8854-fc0d9c038e30 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:30.209813 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57ce962-1fc7-4f6f-8854-fc0d9c038e30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:30.211297 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57ce962-1fc7-4f6f-8854-fc0d9c038e30 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:30.217646 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:30.234647 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-e57ce962-1fc7-4f6f-8854-fc0d9c038e30 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:03:30.234647 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:30.234647 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:30.234647 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:30.234647 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:30.234647 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:30.234647 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:30.234647 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:30.234647 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:30.234647 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:30.234647 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:30.234647 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:30.234647 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:03:30.234647 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:03:30.234647 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:03:30.235894 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:03:30.235894 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:30.235894 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:30.235894 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:30.235894 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:30.235894 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:30.235894 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:30.235894 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:30.235894 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:30.235894 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:30.235894 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:30.235894 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:30.235894 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:30.235894 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:30.235894 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:30.235894 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:30.235894 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:30.237119 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:03:30.237119 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:03:30.237119 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:03:30.237119 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:03:30.237119 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 362/731] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jun 22 10:03:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:03:30.246033 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57ce962-1fc7-4f6f-8854-fc0d9c038e30 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:30.317903 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d423ecc0-5d74-4b1f-8ab0-d733bf1dfef2 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:30.383590 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edacf59-76a2-4c88-930f-9287606b95df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:30.384382 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edacf59-76a2-4c88-930f-9287606b95df None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:30.384549 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edacf59-76a2-4c88-930f-9287606b95df None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:30.384819 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edacf59-76a2-4c88-930f-9287606b95df None admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:30.385680 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edacf59-76a2-4c88-930f-9287606b95df None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:30.386211 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edacf59-76a2-4c88-930f-9287606b95df None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:30.388212 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edacf59-76a2-4c88-930f-9287606b95df None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:30.409525 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 370/732] 10.222.0.43 () {56 vars in 1149 bytes} [Wed Jun 22 10:03:30 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:30.415823 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edacf59-76a2-4c88-930f-9287606b95df None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:30.459976 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57ce962-1fc7-4f6f-8854-fc0d9c038e30 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:30.507463 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:30.532523 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a88f9a-0b3a-44ea-a159-27eadf339731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:30.533190 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a88f9a-0b3a-44ea-a159-27eadf339731 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:30.533472 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a88f9a-0b3a-44ea-a159-27eadf339731 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:30.533771 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a88f9a-0b3a-44ea-a159-27eadf339731 None admin] PATH_INFO: `/v3/domains` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:30.534495 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a88f9a-0b3a-44ea-a159-27eadf339731 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:30.534801 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a88f9a-0b3a-44ea-a159-27eadf339731 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:30.536773 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a88f9a-0b3a-44ea-a159-27eadf339731 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:30.566521 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 363/733] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Jun 22 10:03:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:30.572014 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a88f9a-0b3a-44ea-a159-27eadf339731 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:30.617503 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edacf59-76a2-4c88-930f-9287606b95df None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:30.621670 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:30.685568 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d791459-5a3c-41b1-93d4-717f5efe8010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:30.686271 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d791459-5a3c-41b1-93d4-717f5efe8010 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:30.686823 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d791459-5a3c-41b1-93d4-717f5efe8010 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:30.687109 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d791459-5a3c-41b1-93d4-717f5efe8010 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:30.767750 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d791459-5a3c-41b1-93d4-717f5efe8010 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:30.770207 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d791459-5a3c-41b1-93d4-717f5efe8010 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:30.839760 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a88f9a-0b3a-44ea-a159-27eadf339731 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:30.891114 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 371/734] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Jun 22 10:03:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 22 10:03:30.897719 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d791459-5a3c-41b1-93d4-717f5efe8010 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:30.902221 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:30.932746 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a4ad56-4752-4bdc-96a3-73fa239b4d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:30.934781 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a4ad56-4752-4bdc-96a3-73fa239b4d45 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:30.936756 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a4ad56-4752-4bdc-96a3-73fa239b4d45 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:30.937262 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a4ad56-4752-4bdc-96a3-73fa239b4d45 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:30.950270 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a4ad56-4752-4bdc-96a3-73fa239b4d45 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:30.952664 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a4ad56-4752-4bdc-96a3-73fa239b4d45 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:30.981490 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-14a4ad56-4752-4bdc-96a3-73fa239b4d45 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 22 10:03:30.981490 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:30.981490 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:30.981490 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:30.981490 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:30.981490 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:30.981490 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:30.981490 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:30.981490 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:30.981490 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:30.981490 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:30.981490 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:30.981490 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 10:03:30.981490 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 10:03:30.981490 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 10:03:30.981490 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 10:03:30.982523 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:30.982523 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:30.982523 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 10:03:30.982523 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:03:30.982523 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 10:03:30.982523 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:03:30.982523 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:30.982523 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:30.982523 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:30.982523 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:30.982523 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:30.982523 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:30.982523 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:30.982523 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:30.982523 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:30.982523 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:30.982523 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:30.982523 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:30.983871 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:30.983871 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:30.983871 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 10:03:30.983871 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 10:03:30.983871 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 10:03:30.983871 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 10:03:30.983871 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 10:03:30.983871 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 10:03:30.983871 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 22 10:03:30.983871 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:03:30.983871 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 364/735] 10.222.0.43 () {56 vars in 1096 bytes} [Wed Jun 22 10:03:30 2022] GET /identity/v3/users/swift => generated 83 bytes in 411 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:03:30.984704 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237fe7bf-0351-4efc-82c3-54bc2d289a3b None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:30.984805 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237fe7bf-0351-4efc-82c3-54bc2d289a3b None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:30.985893 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237fe7bf-0351-4efc-82c3-54bc2d289a3b None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:30.987066 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 365/736] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:03:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:03:30.991941 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237fe7bf-0351-4efc-82c3-54bc2d289a3b None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:31.039552 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d791459-5a3c-41b1-93d4-717f5efe8010 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:31.042119 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:31.075542 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262ae006-619a-433e-bd7e-05e6afb3b91f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:31.076721 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262ae006-619a-433e-bd7e-05e6afb3b91f None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:31.076721 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262ae006-619a-433e-bd7e-05e6afb3b91f None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:31.076893 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262ae006-619a-433e-bd7e-05e6afb3b91f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:31.088025 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262ae006-619a-433e-bd7e-05e6afb3b91f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:31.089514 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262ae006-619a-433e-bd7e-05e6afb3b91f None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:31.113723 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-262ae006-619a-433e-bd7e-05e6afb3b91f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:03:31.113723 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:31.113723 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:31.113723 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:31.113723 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:31.113723 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:31.113723 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:31.113723 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:31.113723 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:31.113723 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:31.113723 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:31.113723 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:31.113723 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:03:31.113723 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:03:31.113723 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:03:31.115383 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:03:31.115383 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:31.115383 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:31.115383 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:31.115383 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:31.115383 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:31.115383 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:31.115383 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:31.115383 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:31.115383 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:31.115383 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:31.115383 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:31.115383 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:31.115383 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:31.115383 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:31.115383 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:31.115383 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:31.116264 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:03:31.116264 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:03:31.116264 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:03:31.116264 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:03:31.116496 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237fe7bf-0351-4efc-82c3-54bc2d289a3b None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:31.116571 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 372/737] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jun 22 10:03:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:03:31.116571 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f031ac6b-7087-4d98-8004-227c2bb80c0e None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:31.116571 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f031ac6b-7087-4d98-8004-227c2bb80c0e None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:31.116571 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f031ac6b-7087-4d98-8004-227c2bb80c0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:31.133759 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-f031ac6b-7087-4d98-8004-227c2bb80c0e None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:03:31.134957 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-f031ac6b-7087-4d98-8004-227c2bb80c0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:03:31.150938 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646ee2c3-ae85-446a-ae62-6a07b389d803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:31.151725 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646ee2c3-ae85-446a-ae62-6a07b389d803 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:31.152074 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646ee2c3-ae85-446a-ae62-6a07b389d803 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:31.152417 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646ee2c3-ae85-446a-ae62-6a07b389d803 None admin] PATH_INFO: `/v3/users` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:31.153422 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646ee2c3-ae85-446a-ae62-6a07b389d803 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:31.153940 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646ee2c3-ae85-446a-ae62-6a07b389d803 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:31.155455 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646ee2c3-ae85-446a-ae62-6a07b389d803 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:31.180323 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 366/738] 10.222.0.43 () {56 vars in 1135 bytes} [Wed Jun 22 10:03:30 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:31.181448 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646ee2c3-ae85-446a-ae62-6a07b389d803 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:31.187127 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:31.205578 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 373/739] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:03:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 10:03:31.206468 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f031ac6b-7087-4d98-8004-227c2bb80c0e None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:31.299749 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:31.304897 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646ee2c3-ae85-446a-ae62-6a07b389d803 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:31.312079 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f031ac6b-7087-4d98-8004-227c2bb80c0e None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:31.341174 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49ceae8-8d6c-45e6-97d7-eb9f855c66ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:31.341883 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49ceae8-8d6c-45e6-97d7-eb9f855c66ba None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:31.342173 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49ceae8-8d6c-45e6-97d7-eb9f855c66ba None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:31.342452 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49ceae8-8d6c-45e6-97d7-eb9f855c66ba None admin] PATH_INFO: `/v3/domains` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:31.343174 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49ceae8-8d6c-45e6-97d7-eb9f855c66ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:31.343481 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49ceae8-8d6c-45e6-97d7-eb9f855c66ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:31.344863 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49ceae8-8d6c-45e6-97d7-eb9f855c66ba None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:31.346666 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3877b05-1b94-4eb8-a69b-dd1477e382c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:31.347310 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3877b05-1b94-4eb8-a69b-dd1477e382c6 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:31.347593 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3877b05-1b94-4eb8-a69b-dd1477e382c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:31.347867 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3877b05-1b94-4eb8-a69b-dd1477e382c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:31.357973 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 367/740] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Jun 22 10:03:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:31.359601 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a71602-0040-4bb3-ac3b-f86dbb2e3a79 None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:31.360205 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a71602-0040-4bb3-ac3b-f86dbb2e3a79 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:31.360486 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a71602-0040-4bb3-ac3b-f86dbb2e3a79 None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:31.365732 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 368/741] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:03:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:03:31.365732 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a71602-0040-4bb3-ac3b-f86dbb2e3a79 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:31.401059 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:31.417605 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3877b05-1b94-4eb8-a69b-dd1477e382c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:31.419166 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3877b05-1b94-4eb8-a69b-dd1477e382c6 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:31.467199 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a71602-0040-4bb3-ac3b-f86dbb2e3a79 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:31.500325 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ab4676-bd4c-4d21-9561-78a1e6c64c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:31.500975 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ab4676-bd4c-4d21-9561-78a1e6c64c52 None admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:31.501260 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ab4676-bd4c-4d21-9561-78a1e6c64c52 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:31.501539 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ab4676-bd4c-4d21-9561-78a1e6c64c52 None admin] PATH_INFO: `/v3/services` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:31.502285 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ab4676-bd4c-4d21-9561-78a1e6c64c52 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:31.503664 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ab4676-bd4c-4d21-9561-78a1e6c64c52 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:31.532232 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 369/742] 10.222.0.43 () {60 vars in 1141 bytes} [Wed Jun 22 10:03:31 2022] POST /identity/v3/services => generated 251 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:03:31.532484 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 374/743] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Jun 22 10:03:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 10:03:31.532484 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3877b05-1b94-4eb8-a69b-dd1477e382c6 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:31.532668 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2900fa15-1784-49ca-a3ca-03a37ed19796 None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:31.532668 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2900fa15-1784-49ca-a3ca-03a37ed19796 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:31.532668 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2900fa15-1784-49ca-a3ca-03a37ed19796 None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:31.532668 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 370/744] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:03:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:03:31.532668 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe0c951-341c-47cb-81fd-1e9b6059a8e5 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:31.532668 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe0c951-341c-47cb-81fd-1e9b6059a8e5 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:31.533099 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe0c951-341c-47cb-81fd-1e9b6059a8e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:31.542861 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-1fe0c951-341c-47cb-81fd-1e9b6059a8e5 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:03:31.544099 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-1fe0c951-341c-47cb-81fd-1e9b6059a8e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:03:31.561304 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:31.631226 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:31.649718 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 371/745] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:03:31 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 10:03:31.649718 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe0c951-341c-47cb-81fd-1e9b6059a8e5 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:31.664555 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3877b05-1b94-4eb8-a69b-dd1477e382c6 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:31.702124 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e64295f-3de9-43c1-88c6-2c56cf85c5d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:31.702958 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e64295f-3de9-43c1-88c6-2c56cf85c5d8 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:31.703227 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e64295f-3de9-43c1-88c6-2c56cf85c5d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:31.703504 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e64295f-3de9-43c1-88c6-2c56cf85c5d8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:31.711780 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e64295f-3de9-43c1-88c6-2c56cf85c5d8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:31.713244 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e64295f-3de9-43c1-88c6-2c56cf85c5d8 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:31.727195 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-7e64295f-3de9-43c1-88c6-2c56cf85c5d8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:03:31.727195 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:31.727195 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:31.727195 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:31.727195 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:31.727195 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:31.727195 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:31.727195 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:31.727195 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:31.727195 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:31.727195 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:31.727195 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:31.727195 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 10:03:31.727195 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 10:03:31.727195 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 10:03:31.728102 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 10:03:31.728102 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:31.728102 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:31.728102 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:31.728102 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:31.728102 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:31.728102 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:31.728102 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:31.728102 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:31.728102 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:31.728102 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:31.728102 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:31.728102 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:31.728102 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:31.728102 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:31.728102 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:31.728102 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:31.729589 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 10:03:31.729589 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 10:03:31.729589 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 10:03:31.729589 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 10:03:31.729589 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 10:03:31.729589 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 10:03:31.729589 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:03:31.729589 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:03:31.729589 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 375/746] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Jun 22 10:03:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:03:31.729589 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb090837-72c2-4764-b44c-ce030a9f9363 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:31.730189 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb090837-72c2-4764-b44c-ce030a9f9363 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:31.730189 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb090837-72c2-4764-b44c-ce030a9f9363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:31.747369 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-eb090837-72c2-4764-b44c-ce030a9f9363 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:03:31.748552 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-eb090837-72c2-4764-b44c-ce030a9f9363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:03:31.778852 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe0c951-341c-47cb-81fd-1e9b6059a8e5 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:31.829712 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 376/747] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:03:31 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 10:03:31.829712 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb090837-72c2-4764-b44c-ce030a9f9363 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:31.831322 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf6105b-8c78-4b35-9cb0-74d1860eb0db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:31.832129 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf6105b-8c78-4b35-9cb0-74d1860eb0db None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:31.832419 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf6105b-8c78-4b35-9cb0-74d1860eb0db None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:31.833678 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf6105b-8c78-4b35-9cb0-74d1860eb0db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:31.847213 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf6105b-8c78-4b35-9cb0-74d1860eb0db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:31.849625 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf6105b-8c78-4b35-9cb0-74d1860eb0db None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:31.852857 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:31.871312 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-fcf6105b-8c78-4b35-9cb0-74d1860eb0db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:03:31.871312 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:31.871312 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:31.871312 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:31.871312 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:31.871312 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:31.871312 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:31.871312 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:31.871312 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:31.871312 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:31.871312 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:31.871312 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:31.871312 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:03:31.871312 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:03:31.871312 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:03:31.872244 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:03:31.872244 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:31.872244 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:31.872244 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:31.872244 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:31.872244 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:31.872244 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:31.872244 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:31.872244 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:31.872244 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:31.872244 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:31.872244 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:31.872244 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:31.872244 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:31.872244 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:31.872244 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:31.872244 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:31.873132 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:03:31.873132 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:03:31.873132 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:03:31.873132 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:03:31.873845 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 372/748] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jun 22 10:03:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:03:31.874260 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf6105b-8c78-4b35-9cb0-74d1860eb0db None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:31.909967 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:31.939024 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb090837-72c2-4764-b44c-ce030a9f9363 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:31.977232 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170a6e45-ef68-4562-9a1c-7f4ec5f30168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:31.977991 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170a6e45-ef68-4562-9a1c-7f4ec5f30168 None admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:31.978230 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170a6e45-ef68-4562-9a1c-7f4ec5f30168 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:31.978503 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170a6e45-ef68-4562-9a1c-7f4ec5f30168 None admin] PATH_INFO: `/v3/services` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:31.979286 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170a6e45-ef68-4562-9a1c-7f4ec5f30168 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:31.980588 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170a6e45-ef68-4562-9a1c-7f4ec5f30168 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:31.981069 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf6105b-8c78-4b35-9cb0-74d1860eb0db None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:32.004768 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 377/749] 10.222.0.43 () {60 vars in 1141 bytes} [Wed Jun 22 10:03:31 2022] POST /identity/v3/services => generated 240 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:03:32.004768 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170a6e45-ef68-4562-9a1c-7f4ec5f30168 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:32.033295 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5675c04-b81c-4b49-a820-744efe62f34a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:32.034065 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5675c04-b81c-4b49-a820-744efe62f34a None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:32.034362 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5675c04-b81c-4b49-a820-744efe62f34a None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:32.034677 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5675c04-b81c-4b49-a820-744efe62f34a None admin] PATH_INFO: `/v3/projects` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:32.035839 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5675c04-b81c-4b49-a820-744efe62f34a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:32.036604 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5675c04-b81c-4b49-a820-744efe62f34a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:32.038187 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5675c04-b81c-4b49-a820-744efe62f34a None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:32.056564 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 373/750] 10.222.0.43 () {56 vars in 1148 bytes} [Wed Jun 22 10:03:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:32.057482 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5675c04-b81c-4b49-a820-744efe62f34a None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:32.139816 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:32.156350 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170a6e45-ef68-4562-9a1c-7f4ec5f30168 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:32.201683 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5293c224-619f-4695-9938-848d7b09f0f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:32.202519 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5293c224-619f-4695-9938-848d7b09f0f8 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:32.202802 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5293c224-619f-4695-9938-848d7b09f0f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:32.203088 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5293c224-619f-4695-9938-848d7b09f0f8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:32.206685 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:32.208912 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5675c04-b81c-4b49-a820-744efe62f34a None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:32.222107 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5293c224-619f-4695-9938-848d7b09f0f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:03:32.231135 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-5293c224-619f-4695-9938-848d7b09f0f8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 10:03:32.231135 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:32.231135 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:32.231135 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:32.231135 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:32.231135 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:32.231135 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:32.231135 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:32.231135 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:32.231135 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:32.231135 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:32.231135 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:32.231135 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:03:32.231135 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:03:32.231135 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:03:32.231135 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:03:32.232267 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:03:32.232267 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:03:32.232267 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:03:32.232267 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:03:32.232267 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:32.232267 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:32.232267 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:32.232267 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:32.232267 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:32.232267 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:32.232267 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:32.232267 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:32.232267 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:32.232267 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:32.232267 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:32.232267 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:32.233181 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:32.233181 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:32.233181 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:32.233181 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:32.233181 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:03:32.233181 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:03:32.233181 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:03:32.233181 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:03:32.233181 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:03:32.233181 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:03:32.233181 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 10:03:32.233181 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:03:32.235452 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 378/751] 10.222.0.43 () {56 vars in 1096 bytes} [Wed Jun 22 10:03:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:03:32.236388 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5293c224-619f-4695-9938-848d7b09f0f8 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:32.253828 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1c9a23-d0b7-4a57-b9e7-cc3a813e1c36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:32.254552 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1c9a23-d0b7-4a57-b9e7-cc3a813e1c36 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:32.254844 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1c9a23-d0b7-4a57-b9e7-cc3a813e1c36 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:32.256475 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1c9a23-d0b7-4a57-b9e7-cc3a813e1c36 None admin] PATH_INFO: `/v3/domains` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:32.256475 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1c9a23-d0b7-4a57-b9e7-cc3a813e1c36 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:32.256475 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1c9a23-d0b7-4a57-b9e7-cc3a813e1c36 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:32.257722 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1c9a23-d0b7-4a57-b9e7-cc3a813e1c36 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:32.270624 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 374/752] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Jun 22 10:03:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:32.271586 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1c9a23-d0b7-4a57-b9e7-cc3a813e1c36 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:32.370748 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5293c224-619f-4695-9938-848d7b09f0f8 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:32.378701 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1c9a23-d0b7-4a57-b9e7-cc3a813e1c36 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:32.398703 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:32.427517 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf2e9c9-f7c1-4d85-9fbd-bc76e8d67283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:32.428617 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf2e9c9-f7c1-4d85-9fbd-bc76e8d67283 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:32.429126 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf2e9c9-f7c1-4d85-9fbd-bc76e8d67283 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:32.429615 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf2e9c9-f7c1-4d85-9fbd-bc76e8d67283 None admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:32.430645 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf2e9c9-f7c1-4d85-9fbd-bc76e8d67283 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:32.431172 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf2e9c9-f7c1-4d85-9fbd-bc76e8d67283 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:32.432863 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf2e9c9-f7c1-4d85-9fbd-bc76e8d67283 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:32.448097 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 375/753] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Jun 22 10:03:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:32.449494 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf2e9c9-f7c1-4d85-9fbd-bc76e8d67283 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:32.530364 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9063084-eab0-4dba-90d6-1e23c58240e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:32.531037 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9063084-eab0-4dba-90d6-1e23c58240e0 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:32.531214 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9063084-eab0-4dba-90d6-1e23c58240e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:32.531496 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9063084-eab0-4dba-90d6-1e23c58240e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:32.532333 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9063084-eab0-4dba-90d6-1e23c58240e0 None admin] RBAC: Adding query filter params (role.id=18493ce78e7c480c9202245b6d93cb4c, scope.project.id=e03f1c17e0884f188231d2949dc6f956, user.id=317e7e7dd5c741d49d34a1fd949a7c07) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:32.532647 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9063084-eab0-4dba-90d6-1e23c58240e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:32.534509 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9063084-eab0-4dba-90d6-1e23c58240e0 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:32.540837 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 379/754] 10.222.0.43 () {56 vars in 1374 bytes} [Wed Jun 22 10:03:32 2022] GET /identity/v3/role_assignments?user.id=317e7e7dd5c741d49d34a1fd949a7c07&scope.project.id=e03f1c17e0884f188231d2949dc6f956&role.id=18493ce78e7c480c9202245b6d93cb4c => generated 259 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:32.541753 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9063084-eab0-4dba-90d6-1e23c58240e0 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:32.585552 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf2e9c9-f7c1-4d85-9fbd-bc76e8d67283 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:32.630575 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d028fd95-9ca4-48d6-b3a2-5699b700907c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:32.631593 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:32.632643 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d028fd95-9ca4-48d6-b3a2-5699b700907c None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:32.633145 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d028fd95-9ca4-48d6-b3a2-5699b700907c None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:32.634226 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d028fd95-9ca4-48d6-b3a2-5699b700907c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:32.643602 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d028fd95-9ca4-48d6-b3a2-5699b700907c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:32.646431 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d028fd95-9ca4-48d6-b3a2-5699b700907c None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:32.664695 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-d028fd95-9ca4-48d6-b3a2-5699b700907c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:03:32.664695 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:32.664695 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:32.664695 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:32.664695 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:32.664695 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:32.664695 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:32.664695 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:32.664695 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:32.664695 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:32.664695 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:32.664695 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:32.664695 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 10:03:32.664695 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 10:03:32.664695 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 10:03:32.665644 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 10:03:32.665644 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:32.665644 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:32.665644 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:32.665644 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:32.665644 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:32.665644 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:32.665644 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:32.665644 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:32.665644 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:32.665644 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:32.665644 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:32.665644 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:32.665644 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:32.665644 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:32.665644 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:32.665644 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:32.666612 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 10:03:32.666612 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 10:03:32.666612 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 10:03:32.666612 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 10:03:32.666612 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 10:03:32.666612 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 10:03:32.666612 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:03:32.666612 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:03:32.666612 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 376/755] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Jun 22 10:03:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:03:32.672952 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d028fd95-9ca4-48d6-b3a2-5699b700907c None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:32.706669 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9063084-eab0-4dba-90d6-1e23c58240e0 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:32.747267 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31dc8f8-7fa5-47fb-9117-ac308be3b0f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:32.748070 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31dc8f8-7fa5-47fb-9117-ac308be3b0f5 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:32.748355 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31dc8f8-7fa5-47fb-9117-ac308be3b0f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:32.748630 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31dc8f8-7fa5-47fb-9117-ac308be3b0f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:32.750918 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:32.761318 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31dc8f8-7fa5-47fb-9117-ac308be3b0f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:32.762840 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31dc8f8-7fa5-47fb-9117-ac308be3b0f5 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:32.783544 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-c31dc8f8-7fa5-47fb-9117-ac308be3b0f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:03:32.783544 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:32.783544 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:32.783544 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:32.783544 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:32.783544 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:32.783544 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:32.783544 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:32.783544 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:32.783544 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:32.783544 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:32.783544 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:32.783544 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:03:32.783544 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:03:32.783544 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:03:32.784429 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:03:32.784429 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:32.784429 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:32.784429 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:32.784429 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:32.784429 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:32.784429 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:32.784429 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:32.784429 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:32.784429 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:32.784429 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:32.784429 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:32.784429 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:32.784429 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:32.784429 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:32.784429 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:32.784429 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:32.785384 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:03:32.785384 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:03:32.785384 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:03:32.785384 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:03:32.785384 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 380/756] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jun 22 10:03:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:03:32.792024 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31dc8f8-7fa5-47fb-9117-ac308be3b0f5 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:32.852535 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d028fd95-9ca4-48d6-b3a2-5699b700907c None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:32.930508 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7c2d7e-2757-4c5d-877a-2fb6c2d2a139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:32.931178 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7c2d7e-2757-4c5d-877a-2fb6c2d2a139 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:32.931464 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7c2d7e-2757-4c5d-877a-2fb6c2d2a139 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:32.931746 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7c2d7e-2757-4c5d-877a-2fb6c2d2a139 None admin] PATH_INFO: `/v3/projects` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:32.932555 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7c2d7e-2757-4c5d-877a-2fb6c2d2a139 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:32.932873 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7c2d7e-2757-4c5d-877a-2fb6c2d2a139 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:32.934384 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7c2d7e-2757-4c5d-877a-2fb6c2d2a139 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:32.954588 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31dc8f8-7fa5-47fb-9117-ac308be3b0f5 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:32.961408 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 377/757] 10.222.0.43 () {56 vars in 1148 bytes} [Wed Jun 22 10:03:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:32.966317 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:32.967241 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7c2d7e-2757-4c5d-877a-2fb6c2d2a139 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:32.991416 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9311ca3-d1c2-4fb1-b83d-9163f4ae703b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:32.992096 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9311ca3-d1c2-4fb1-b83d-9163f4ae703b None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:32.992397 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9311ca3-d1c2-4fb1-b83d-9163f4ae703b None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:32.992669 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9311ca3-d1c2-4fb1-b83d-9163f4ae703b None admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:32.993399 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9311ca3-d1c2-4fb1-b83d-9163f4ae703b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:32.993742 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9311ca3-d1c2-4fb1-b83d-9163f4ae703b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:32.995127 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9311ca3-d1c2-4fb1-b83d-9163f4ae703b None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:33.007005 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 381/758] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Jun 22 10:03:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:33.012095 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9311ca3-d1c2-4fb1-b83d-9163f4ae703b None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:33.153308 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9311ca3-d1c2-4fb1-b83d-9163f4ae703b None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:33.198082 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:33.200576 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb2f440-e675-4647-85ae-089f28d94a4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:33.201373 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb2f440-e675-4647-85ae-089f28d94a4b None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:33.201655 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb2f440-e675-4647-85ae-089f28d94a4b None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:33.202705 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb2f440-e675-4647-85ae-089f28d94a4b None admin] PATH_INFO: `/v3/users/nova` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:33.205946 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7c2d7e-2757-4c5d-877a-2fb6c2d2a139 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:33.219916 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb2f440-e675-4647-85ae-089f28d94a4b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:33.221377 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb2f440-e675-4647-85ae-089f28d94a4b None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:33.243788 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-3cb2f440-e675-4647-85ae-089f28d94a4b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 22 10:03:33.243788 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:33.243788 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:33.243788 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:33.243788 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:33.243788 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:33.243788 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:33.243788 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:33.243788 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:33.243788 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:33.243788 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:33.243788 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:33.243788 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 10:03:33.243788 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 10:03:33.243788 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 10:03:33.243788 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 10:03:33.244810 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:33.244810 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:33.244810 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 10:03:33.244810 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:03:33.244810 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 10:03:33.244810 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:03:33.244810 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:33.244810 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:33.244810 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:33.244810 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:33.244810 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:33.244810 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:33.244810 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:33.244810 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:33.244810 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:33.244810 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:33.244810 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:33.244810 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:33.245803 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:33.245803 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:33.245803 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 10:03:33.245803 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 10:03:33.245803 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 10:03:33.245803 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 10:03:33.245803 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 10:03:33.245803 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 10:03:33.245803 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 22 10:03:33.245803 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:03:33.245803 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 382/759] 10.222.0.43 () {56 vars in 1093 bytes} [Wed Jun 22 10:03:33 2022] GET /identity/v3/users/nova => generated 82 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:03:33.255144 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb2f440-e675-4647-85ae-089f28d94a4b None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:33.267322 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f4982d-d32c-4c73-b434-8f5756ae0312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:33.268786 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f4982d-d32c-4c73-b434-8f5756ae0312 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:33.269281 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f4982d-d32c-4c73-b434-8f5756ae0312 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:33.269839 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f4982d-d32c-4c73-b434-8f5756ae0312 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:33.271476 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f4982d-d32c-4c73-b434-8f5756ae0312 None admin] RBAC: Adding query filter params (role.id=26d9c2ab5dfc4e6d9ca80c6014123906, scope.project.id=e03f1c17e0884f188231d2949dc6f956, user.id=9566f8cca2574f4cb5edcbf384f368a7) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:33.271998 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f4982d-d32c-4c73-b434-8f5756ae0312 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:33.273661 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f4982d-d32c-4c73-b434-8f5756ae0312 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:33.280959 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 378/760] 10.222.0.43 () {56 vars in 1374 bytes} [Wed Jun 22 10:03:32 2022] GET /identity/v3/role_assignments?user.id=9566f8cca2574f4cb5edcbf384f368a7&scope.project.id=e03f1c17e0884f188231d2949dc6f956&role.id=26d9c2ab5dfc4e6d9ca80c6014123906 => generated 259 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:33.325989 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:33.437643 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb2f440-e675-4647-85ae-089f28d94a4b None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:33.476795 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a93e4b1-110c-4d3c-8891-c1e0a7ffbb41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:33.477474 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a93e4b1-110c-4d3c-8891-c1e0a7ffbb41 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:33.477784 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a93e4b1-110c-4d3c-8891-c1e0a7ffbb41 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:33.478065 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a93e4b1-110c-4d3c-8891-c1e0a7ffbb41 None admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:33.478913 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a93e4b1-110c-4d3c-8891-c1e0a7ffbb41 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:33.479224 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a93e4b1-110c-4d3c-8891-c1e0a7ffbb41 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:33.480669 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a93e4b1-110c-4d3c-8891-c1e0a7ffbb41 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:33.499250 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 383/761] 10.222.0.43 () {56 vars in 1133 bytes} [Wed Jun 22 10:03:33 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:33.504958 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f4982d-d32c-4c73-b434-8f5756ae0312 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:33.632288 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f4982d-d32c-4c73-b434-8f5756ae0312 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:33.671870 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992e5caf-c88b-44b8-b4ea-a9ba3650f6f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:33.672684 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992e5caf-c88b-44b8-b4ea-a9ba3650f6f1 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:33.672976 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992e5caf-c88b-44b8-b4ea-a9ba3650f6f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:33.673260 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992e5caf-c88b-44b8-b4ea-a9ba3650f6f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:33.684915 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992e5caf-c88b-44b8-b4ea-a9ba3650f6f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:33.686415 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992e5caf-c88b-44b8-b4ea-a9ba3650f6f1 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:33.699414 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5656c63-077e-4f59-8baf-0d01a869de92 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:33.700328 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5656c63-077e-4f59-8baf-0d01a869de92 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:33.700805 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5656c63-077e-4f59-8baf-0d01a869de92 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:33.702637 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 384/762] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:03:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 10:03:33.709907 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-992e5caf-c88b-44b8-b4ea-a9ba3650f6f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:03:33.709907 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:33.709907 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:33.709907 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:33.709907 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:33.709907 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:33.709907 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:33.709907 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:33.709907 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:33.709907 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:33.709907 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:33.709907 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:33.709907 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:03:33.709907 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:03:33.709907 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:03:33.710786 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:03:33.710786 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:33.710786 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:33.710786 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:33.710786 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:33.710786 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:33.710786 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:33.710786 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:33.710786 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:33.710786 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:33.710786 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:33.710786 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:33.710786 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:33.710786 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:33.710786 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:33.710786 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:33.710786 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:33.711664 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:03:33.711664 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:03:33.711664 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:03:33.711664 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:03:33.711664 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 379/763] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jun 22 10:03:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:03:33.713354 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b6595c-3768-4717-85d8-be2870ca18bc None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:33.713645 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b6595c-3768-4717-85d8-be2870ca18bc None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:33.713961 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b6595c-3768-4717-85d8-be2870ca18bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:33.716117 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992e5caf-c88b-44b8-b4ea-a9ba3650f6f1 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:33.738436 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:33.750537 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-65b6595c-3768-4717-85d8-be2870ca18bc None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:03:33.751749 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-65b6595c-3768-4717-85d8-be2870ca18bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:03:33.847736 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 385/764] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:03:33 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 10:03:33.896797 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b6595c-3768-4717-85d8-be2870ca18bc None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:33.900921 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992e5caf-c88b-44b8-b4ea-a9ba3650f6f1 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:33.931640 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:33.966396 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1cff8c-5fb1-44d4-803c-97ebd327e440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:33.966994 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1cff8c-5fb1-44d4-803c-97ebd327e440 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:33.967279 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1cff8c-5fb1-44d4-803c-97ebd327e440 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:33.967559 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1cff8c-5fb1-44d4-803c-97ebd327e440 None admin] PATH_INFO: `/v3/domains` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:33.968302 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1cff8c-5fb1-44d4-803c-97ebd327e440 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:33.968610 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1cff8c-5fb1-44d4-803c-97ebd327e440 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:33.970089 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1cff8c-5fb1-44d4-803c-97ebd327e440 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:33.986613 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 380/765] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Jun 22 10:03:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:33.994653 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1cff8c-5fb1-44d4-803c-97ebd327e440 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:34.086747 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b6595c-3768-4717-85d8-be2870ca18bc None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:34.134473 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2afe7a1-7ec7-430d-ab86-d9acd8597fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:34.135297 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2afe7a1-7ec7-430d-ab86-d9acd8597fb5 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:34.135583 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2afe7a1-7ec7-430d-ab86-d9acd8597fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:34.135863 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2afe7a1-7ec7-430d-ab86-d9acd8597fb5 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:34.136523 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2afe7a1-7ec7-430d-ab86-d9acd8597fb5 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:34.137933 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2afe7a1-7ec7-430d-ab86-d9acd8597fb5 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:34.142034 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:34.153276 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-d2afe7a1-7ec7-430d-ab86-d9acd8597fb5 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 22 10:03:34.153276 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:34.153276 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 10:03:34.153276 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 10:03:34.153276 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 10:03:34.153276 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 10:03:34.153276 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 10:03:34.153276 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 10:03:34.153276 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 22 10:03:34.153276 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:03:34.153276 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 10:03:34.153276 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:03:34.153276 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:34.153276 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:34.153276 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:34.153276 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:34.154280 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:34.154280 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:34.154280 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:34.154280 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:34.154280 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:34.154280 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:34.154280 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:34.154280 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 10:03:34.154280 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 10:03:34.154280 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 10:03:34.154280 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 10:03:34.154280 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:34.154280 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:34.154280 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:34.154280 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:34.154280 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:34.155105 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:34.155105 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:34.155105 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:34.155105 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:34.155105 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:34.155105 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:34.155105 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:34.155105 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:34.155105 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:34.155105 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:34.155105 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:34.155105 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 10:03:34.155105 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 10:03:34.155105 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 22 10:03:34.155105 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:03:34.158638 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 386/766] 10.222.0.43 () {56 vars in 1129 bytes} [Wed Jun 22 10:03:33 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:03:34.165339 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2afe7a1-7ec7-430d-ab86-d9acd8597fb5 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:34.217344 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1cff8c-5fb1-44d4-803c-97ebd327e440 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:34.292784 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:34.304099 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7568bb6-392e-48dc-a73a-b853f6496443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:34.304911 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7568bb6-392e-48dc-a73a-b853f6496443 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:34.305198 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7568bb6-392e-48dc-a73a-b853f6496443 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:34.305474 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7568bb6-392e-48dc-a73a-b853f6496443 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:34.322372 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7568bb6-392e-48dc-a73a-b853f6496443 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:34.323871 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7568bb6-392e-48dc-a73a-b853f6496443 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:34.326308 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2afe7a1-7ec7-430d-ab86-d9acd8597fb5 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:34.349705 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-d7568bb6-392e-48dc-a73a-b853f6496443 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:03:34.349705 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:34.349705 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:34.349705 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:34.349705 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:34.349705 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:34.349705 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:34.349705 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:34.349705 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:34.349705 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:34.349705 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:34.349705 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:34.349705 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 10:03:34.349705 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 10:03:34.349705 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 10:03:34.352033 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 10:03:34.352033 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:34.352033 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:34.352033 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:34.352033 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:34.352033 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:34.352033 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:34.352033 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:34.352033 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:34.352033 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:34.352033 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:34.352033 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:34.352033 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:34.352033 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:34.352033 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:34.352033 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:34.352033 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:34.354168 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 10:03:34.354168 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 10:03:34.354168 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 10:03:34.354168 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 10:03:34.354168 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 10:03:34.354168 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 10:03:34.354168 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:03:34.354168 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:03:34.359362 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 381/767] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Jun 22 10:03:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 365 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:03:34.366010 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7568bb6-392e-48dc-a73a-b853f6496443 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:34.371595 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69d001f-1a5f-4d10-9458-208cf7cc54aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:34.372276 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69d001f-1a5f-4d10-9458-208cf7cc54aa None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:34.372564 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69d001f-1a5f-4d10-9458-208cf7cc54aa None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:34.372846 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69d001f-1a5f-4d10-9458-208cf7cc54aa None admin] PATH_INFO: `/v3/services` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:34.373574 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69d001f-1a5f-4d10-9458-208cf7cc54aa None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:34.373912 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69d001f-1a5f-4d10-9458-208cf7cc54aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:34.375297 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69d001f-1a5f-4d10-9458-208cf7cc54aa None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:34.386511 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 387/768] 10.222.0.43 () {56 vars in 1124 bytes} [Wed Jun 22 10:03:34 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:03:34.394617 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69d001f-1a5f-4d10-9458-208cf7cc54aa None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:34.485241 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7568bb6-392e-48dc-a73a-b853f6496443 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:34.517513 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:34.525892 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbd36cd-164f-4c7e-b268-10a035de8506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:34.526575 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbd36cd-164f-4c7e-b268-10a035de8506 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:34.526860 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbd36cd-164f-4c7e-b268-10a035de8506 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:34.527136 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbd36cd-164f-4c7e-b268-10a035de8506 None admin] PATH_INFO: `/v3/projects` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:34.527944 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbd36cd-164f-4c7e-b268-10a035de8506 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:34.528258 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbd36cd-164f-4c7e-b268-10a035de8506 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:34.529721 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbd36cd-164f-4c7e-b268-10a035de8506 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:34.552272 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 382/769] 10.222.0.43 () {56 vars in 1148 bytes} [Wed Jun 22 10:03:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:34.557754 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbd36cd-164f-4c7e-b268-10a035de8506 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:34.658675 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69d001f-1a5f-4d10-9458-208cf7cc54aa None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:34.689515 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbd36cd-164f-4c7e-b268-10a035de8506 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:34.726692 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929361da-bb30-4cb7-8f50-6640f048a7d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:34.727364 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929361da-bb30-4cb7-8f50-6640f048a7d8 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:34.727654 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929361da-bb30-4cb7-8f50-6640f048a7d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:34.727937 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929361da-bb30-4cb7-8f50-6640f048a7d8 None admin] PATH_INFO: `/v3/services` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:34.728713 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929361da-bb30-4cb7-8f50-6640f048a7d8 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:34.729080 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929361da-bb30-4cb7-8f50-6640f048a7d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:34.730478 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929361da-bb30-4cb7-8f50-6640f048a7d8 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:34.731553 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bb4e55-38ee-421c-bae2-50faea85ad7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:34.732942 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bb4e55-38ee-421c-bae2-50faea85ad7b None admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:34.733230 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bb4e55-38ee-421c-bae2-50faea85ad7b None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:34.733650 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bb4e55-38ee-421c-bae2-50faea85ad7b None admin] PATH_INFO: `/v3/projects/e03f1c17e0884f188231d2949dc6f956/users/158a49aa3750478a84bf71b9aad24397/roles/26d9c2ab5dfc4e6d9ca80c6014123906` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:34.735843 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bb4e55-38ee-421c-bae2-50faea85ad7b None admin] RBAC: Authorizing `identity:create_grant(project_id=e03f1c17e0884f188231d2949dc6f956, user_id=158a49aa3750478a84bf71b9aad24397, role_id=26d9c2ab5dfc4e6d9ca80c6014123906)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:34.735981 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 388/770] 10.222.0.43 () {56 vars in 1124 bytes} [Wed Jun 22 10:03:34 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:34.737212 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8156ddf-43e3-4c9e-bc8f-d60321db3ce6 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:34.737339 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bb4e55-38ee-421c-bae2-50faea85ad7b None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:34.737616 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8156ddf-43e3-4c9e-bc8f-d60321db3ce6 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:34.737989 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8156ddf-43e3-4c9e-bc8f-d60321db3ce6 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:34.740045 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 389/771] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:03:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:03:34.745610 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b4c0ab-dba0-436f-a689-88496140848d None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:34.746074 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b4c0ab-dba0-436f-a689-88496140848d None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:34.746427 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b4c0ab-dba0-436f-a689-88496140848d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:34.764064 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 383/772] 10.222.0.43 () {58 vars in 1439 bytes} [Wed Jun 22 10:03:34 2022] PUT /identity/v3/projects/e03f1c17e0884f188231d2949dc6f956/users/158a49aa3750478a84bf71b9aad24397/roles/26d9c2ab5dfc4e6d9ca80c6014123906 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:03:34.765018 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bb4e55-38ee-421c-bae2-50faea85ad7b None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:34.766486 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-b2b4c0ab-dba0-436f-a689-88496140848d None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:03:34.767882 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-b2b4c0ab-dba0-436f-a689-88496140848d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:03:34.772920 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:34.840982 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:34.860865 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 390/773] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:03:34 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 10:03:34.917221 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b4c0ab-dba0-436f-a689-88496140848d None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:34.939120 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bb4e55-38ee-421c-bae2-50faea85ad7b None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:35.012706 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4957e63d-bf76-4294-98f8-c7c9c1a831d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:35.013320 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4957e63d-bf76-4294-98f8-c7c9c1a831d3 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:35.013596 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4957e63d-bf76-4294-98f8-c7c9c1a831d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:35.013907 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4957e63d-bf76-4294-98f8-c7c9c1a831d3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:35.014711 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4957e63d-bf76-4294-98f8-c7c9c1a831d3 None admin] RBAC: Adding query filter params (interface=public, service_id=5346d385c2044131bb64fbd310626bdb, region_id=RegionOne) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:35.015026 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4957e63d-bf76-4294-98f8-c7c9c1a831d3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:35.016415 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4957e63d-bf76-4294-98f8-c7c9c1a831d3 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:35.026415 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 384/774] 10.222.0.43 () {56 vars in 1251 bytes} [Wed Jun 22 10:03:34 2022] GET /identity/v3/endpoints?service_id=5346d385c2044131bb64fbd310626bdb&interface=public®ion_id=RegionOne => generated 194 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:35.027868 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fa2f0b-64dc-498c-b281-589121754887 None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:35.028166 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fa2f0b-64dc-498c-b281-589121754887 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:35.028480 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fa2f0b-64dc-498c-b281-589121754887 None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:35.030132 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 385/775] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:03:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:03:35.031315 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fa2f0b-64dc-498c-b281-589121754887 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:35.059877 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b4c0ab-dba0-436f-a689-88496140848d None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:35.102778 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bc4021-cecc-4285-a69b-ea8b183406d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:35.103629 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bc4021-cecc-4285-a69b-ea8b183406d8 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:35.103913 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bc4021-cecc-4285-a69b-ea8b183406d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:35.104186 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bc4021-cecc-4285-a69b-ea8b183406d8 None admin] PATH_INFO: `/v3/services/network` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:35.104840 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bc4021-cecc-4285-a69b-ea8b183406d8 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:35.106303 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bc4021-cecc-4285-a69b-ea8b183406d8 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:35.118931 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-51bc4021-cecc-4285-a69b-ea8b183406d8 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 22 10:03:35.118931 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:35.118931 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 10:03:35.118931 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 10:03:35.118931 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 10:03:35.118931 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 10:03:35.118931 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 10:03:35.118931 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 10:03:35.118931 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 22 10:03:35.118931 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:03:35.118931 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 10:03:35.118931 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:03:35.118931 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:35.118931 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:35.118931 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:35.118931 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:35.118931 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:35.119939 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:35.119939 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:35.119939 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:35.119939 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:35.119939 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:35.119939 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:35.119939 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 10:03:35.119939 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 10:03:35.119939 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 10:03:35.119939 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 10:03:35.119939 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:35.119939 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:35.119939 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:35.119939 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:35.119939 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:35.119939 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:35.120767 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:35.120767 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:35.120767 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:35.120767 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:35.120767 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:35.120767 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:35.120767 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:35.120767 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:35.120767 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:35.120767 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:35.120767 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 10:03:35.120767 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 10:03:35.120767 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 22 10:03:35.120767 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:03:35.120767 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 391/776] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Jun 22 10:03:34 2022] GET /identity/v3/services/network => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:03:35.121820 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e2ed59-d75a-4900-86e8-368f380cff66 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:35.122119 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e2ed59-d75a-4900-86e8-368f380cff66 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:35.122377 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e2ed59-d75a-4900-86e8-368f380cff66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:35.129921 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:35.143737 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-b8e2ed59-d75a-4900-86e8-368f380cff66 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:03:35.145164 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-b8e2ed59-d75a-4900-86e8-368f380cff66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:03:35.166930 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fa2f0b-64dc-498c-b281-589121754887 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:35.186202 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:35.210968 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6fb070-2011-4974-97df-4945742232cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:35.212248 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6fb070-2011-4974-97df-4945742232cb None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:35.212782 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6fb070-2011-4974-97df-4945742232cb None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:35.213301 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6fb070-2011-4974-97df-4945742232cb None admin] PATH_INFO: `/v3/services` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:35.214236 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6fb070-2011-4974-97df-4945742232cb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:35.216031 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6fb070-2011-4974-97df-4945742232cb None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:35.222318 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 386/777] 10.222.0.43 () {56 vars in 1087 bytes} [Wed Jun 22 10:03:35 2022] GET /identity/v3/services => generated 772 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:03:35.223915 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6fb070-2011-4974-97df-4945742232cb None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:35.237798 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 392/778] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:03:35 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 10:03:35.260464 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e2ed59-d75a-4900-86e8-368f380cff66 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:35.366143 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6fb070-2011-4974-97df-4945742232cb None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:35.384432 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e2ed59-d75a-4900-86e8-368f380cff66 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:35.417073 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577e12a0-eeb1-478d-a72b-f020b37780a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:35.418328 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577e12a0-eeb1-478d-a72b-f020b37780a6 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:35.418824 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577e12a0-eeb1-478d-a72b-f020b37780a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:35.419327 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577e12a0-eeb1-478d-a72b-f020b37780a6 None admin] PATH_INFO: `/v3/services` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:35.420285 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577e12a0-eeb1-478d-a72b-f020b37780a6 None admin] RBAC: Adding query filter params (name=network) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:35.420795 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577e12a0-eeb1-478d-a72b-f020b37780a6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:35.422555 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577e12a0-eeb1-478d-a72b-f020b37780a6 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:35.428836 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 387/779] 10.222.0.43 () {56 vars in 1112 bytes} [Wed Jun 22 10:03:35 2022] GET /identity/v3/services?name=network => generated 124 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:35.434111 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577e12a0-eeb1-478d-a72b-f020b37780a6 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:35.445883 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb85660c-0453-452a-8c6a-0582968eeb91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:35.446696 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb85660c-0453-452a-8c6a-0582968eeb91 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:35.446980 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb85660c-0453-452a-8c6a-0582968eeb91 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:35.447259 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb85660c-0453-452a-8c6a-0582968eeb91 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:35.449625 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:35.466794 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb85660c-0453-452a-8c6a-0582968eeb91 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:03:35.475579 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-eb85660c-0453-452a-8c6a-0582968eeb91 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 10:03:35.475579 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:35.475579 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:35.475579 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:35.475579 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:35.475579 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:35.475579 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:35.475579 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:35.475579 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:35.475579 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:35.475579 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:35.475579 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:35.475579 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:03:35.475579 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:03:35.475579 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:03:35.475579 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:03:35.476780 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:03:35.476780 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:03:35.476780 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:03:35.476780 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:03:35.476780 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:35.476780 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:35.476780 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:35.476780 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:35.476780 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:35.476780 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:35.476780 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:35.476780 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:35.476780 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:35.476780 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:35.476780 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:35.476780 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:35.477640 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:35.477640 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:35.477640 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:35.477640 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:35.477640 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:03:35.477640 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:03:35.477640 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:03:35.477640 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:03:35.477640 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:03:35.477640 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:03:35.477640 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 10:03:35.477640 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:03:35.478294 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 393/780] 10.222.0.43 () {56 vars in 1102 bytes} [Wed Jun 22 10:03:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 10:03:35.486344 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb85660c-0453-452a-8c6a-0582968eeb91 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:35.501920 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:35.579237 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577e12a0-eeb1-478d-a72b-f020b37780a6 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:35.609743 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb85660c-0453-452a-8c6a-0582968eeb91 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:35.634515 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d148d48c-e328-492f-b69b-0c8609eca5ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:35.635206 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d148d48c-e328-492f-b69b-0c8609eca5ae None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:35.635492 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d148d48c-e328-492f-b69b-0c8609eca5ae None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:35.635768 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d148d48c-e328-492f-b69b-0c8609eca5ae None admin] PATH_INFO: `/v3/services` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:35.636485 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d148d48c-e328-492f-b69b-0c8609eca5ae None admin] RBAC: Adding query filter params (type=network) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:35.636796 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d148d48c-e328-492f-b69b-0c8609eca5ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:35.638205 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d148d48c-e328-492f-b69b-0c8609eca5ae None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:35.643279 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce12a83-b5d8-4d1b-afb8-b3757ae6c61e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:35.643944 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce12a83-b5d8-4d1b-afb8-b3757ae6c61e None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:35.644147 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 388/781] 10.222.0.43 () {56 vars in 1112 bytes} [Wed Jun 22 10:03:35 2022] GET /identity/v3/services?type=network => generated 350 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:03:35.644307 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce12a83-b5d8-4d1b-afb8-b3757ae6c61e None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:35.644579 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce12a83-b5d8-4d1b-afb8-b3757ae6c61e None admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:35.646297 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce12a83-b5d8-4d1b-afb8-b3757ae6c61e None admin] RBAC: Adding query filter params (name=service) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:35.646297 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce12a83-b5d8-4d1b-afb8-b3757ae6c61e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:35.647738 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce12a83-b5d8-4d1b-afb8-b3757ae6c61e None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:35.649927 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d148d48c-e328-492f-b69b-0c8609eca5ae None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:35.661959 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 394/782] 10.222.0.43 () {56 vars in 1103 bytes} [Wed Jun 22 10:03:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:35.664251 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce12a83-b5d8-4d1b-afb8-b3757ae6c61e None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:35.725044 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:35.774928 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce12a83-b5d8-4d1b-afb8-b3757ae6c61e None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:35.786967 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d148d48c-e328-492f-b69b-0c8609eca5ae None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:35.793935 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:35.815232 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac532f5-b86a-490c-9ab5-163940473748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:35.816412 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac532f5-b86a-490c-9ab5-163940473748 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:35.817107 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac532f5-b86a-490c-9ab5-163940473748 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:35.818109 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac532f5-b86a-490c-9ab5-163940473748 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:35.824135 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cd549d-3e2c-4de0-8f9e-832b8ba6100b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:35.824795 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cd549d-3e2c-4de0-8f9e-832b8ba6100b None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:35.825080 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cd549d-3e2c-4de0-8f9e-832b8ba6100b None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:35.825359 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cd549d-3e2c-4de0-8f9e-832b8ba6100b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:35.826180 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cd549d-3e2c-4de0-8f9e-832b8ba6100b None admin] RBAC: Adding query filter params (interface=public, service_id=8e9a051c68a2410591ca0299a49b7f47, region_id=RegionOne) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:35.826493 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cd549d-3e2c-4de0-8f9e-832b8ba6100b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:35.827897 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cd549d-3e2c-4de0-8f9e-832b8ba6100b None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:35.832954 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac532f5-b86a-490c-9ab5-163940473748 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:35.834049 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 389/783] 10.222.0.43 () {56 vars in 1251 bytes} [Wed Jun 22 10:03:35 2022] GET /identity/v3/endpoints?service_id=8e9a051c68a2410591ca0299a49b7f47&interface=public®ion_id=RegionOne => generated 194 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:03:35.835033 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac532f5-b86a-490c-9ab5-163940473748 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:35.838989 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cd549d-3e2c-4de0-8f9e-832b8ba6100b None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:35.853469 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-eac532f5-b86a-490c-9ab5-163940473748 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:03:35.853469 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:35.853469 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:35.853469 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:35.853469 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:35.853469 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:35.853469 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:35.853469 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:35.853469 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:35.853469 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:35.853469 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:35.853469 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:35.853469 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:03:35.853469 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:03:35.853469 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:03:35.854438 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:03:35.854438 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:35.854438 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:35.854438 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:35.854438 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:35.854438 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:35.854438 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:35.854438 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:35.854438 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:35.854438 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:35.854438 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:35.854438 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:35.854438 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:35.854438 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:35.854438 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:35.854438 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:35.854438 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:35.855340 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:03:35.855340 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:03:35.855340 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:03:35.855340 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:03:35.859281 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 395/784] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jun 22 10:03:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:03:35.860536 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac532f5-b86a-490c-9ab5-163940473748 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:35.951114 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cd549d-3e2c-4de0-8f9e-832b8ba6100b None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:35.969461 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac532f5-b86a-490c-9ab5-163940473748 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:35.980231 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:35.989831 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8ab02b-cb0f-4621-bdda-33d6553f76a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:35.990916 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8ab02b-cb0f-4621-bdda-33d6553f76a9 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:35.991201 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8ab02b-cb0f-4621-bdda-33d6553f76a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:35.991922 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8ab02b-cb0f-4621-bdda-33d6553f76a9 None admin] PATH_INFO: `/v3/services` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:35.992612 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8ab02b-cb0f-4621-bdda-33d6553f76a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:35.994038 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8ab02b-cb0f-4621-bdda-33d6553f76a9 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:36.000080 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 390/785] 10.222.0.43 () {56 vars in 1087 bytes} [Wed Jun 22 10:03:35 2022] GET /identity/v3/services => generated 772 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:36.001535 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8dae0a-67b4-4d4b-a2e5-f54b962f9693 None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:36.001856 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8dae0a-67b4-4d4b-a2e5-f54b962f9693 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:36.002137 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8dae0a-67b4-4d4b-a2e5-f54b962f9693 None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:36.003801 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 391/786] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:03:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:03:36.010842 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3af04f-a30a-4fbb-bc0b-3ed3c4d5c1a1 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:36.011374 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3af04f-a30a-4fbb-bc0b-3ed3c4d5c1a1 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:36.011661 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3af04f-a30a-4fbb-bc0b-3ed3c4d5c1a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:36.016961 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a18266-201d-47b1-b33f-5dea1977132f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:36.017989 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a18266-201d-47b1-b33f-5dea1977132f None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:36.018564 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a18266-201d-47b1-b33f-5dea1977132f None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:36.018910 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a18266-201d-47b1-b33f-5dea1977132f None admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:36.019730 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a18266-201d-47b1-b33f-5dea1977132f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:36.020786 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a18266-201d-47b1-b33f-5dea1977132f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:36.022296 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a18266-201d-47b1-b33f-5dea1977132f None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:36.032221 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-7c3af04f-a30a-4fbb-bc0b-3ed3c4d5c1a1 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:03:36.033835 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-7c3af04f-a30a-4fbb-bc0b-3ed3c4d5c1a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:03:36.041872 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 396/787] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Jun 22 10:03:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:36.043238 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a18266-201d-47b1-b33f-5dea1977132f None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:36.072294 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:36.135825 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 392/788] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:03:36 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 10:03:36.159616 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3af04f-a30a-4fbb-bc0b-3ed3c4d5c1a1 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:36.173613 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a18266-201d-47b1-b33f-5dea1977132f None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:36.214174 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f8a41a-9eca-41cd-97f3-f6c17ff9a7f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:36.214946 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f8a41a-9eca-41cd-97f3-f6c17ff9a7f8 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:36.215228 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f8a41a-9eca-41cd-97f3-f6c17ff9a7f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:36.215519 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f8a41a-9eca-41cd-97f3-f6c17ff9a7f8 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:36.226221 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f8a41a-9eca-41cd-97f3-f6c17ff9a7f8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:36.228026 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f8a41a-9eca-41cd-97f3-f6c17ff9a7f8 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:36.247766 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-38f8a41a-9eca-41cd-97f3-f6c17ff9a7f8 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 22 10:03:36.247766 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:36.247766 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:36.247766 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:36.247766 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:36.247766 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:36.247766 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:36.247766 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:36.247766 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:36.247766 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:36.247766 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:36.247766 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:36.247766 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 10:03:36.247766 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 10:03:36.247766 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 10:03:36.247766 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 10:03:36.248798 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:36.248798 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:36.248798 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 10:03:36.248798 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:03:36.248798 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 10:03:36.248798 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:03:36.248798 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:36.248798 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:36.248798 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:36.248798 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:36.248798 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:36.248798 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:36.248798 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:36.248798 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:36.248798 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:36.248798 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:36.248798 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:36.248798 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:36.249772 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:36.249772 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:36.249772 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 10:03:36.249772 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 10:03:36.249772 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 10:03:36.249772 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 10:03:36.249772 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 10:03:36.249772 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 10:03:36.249772 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 22 10:03:36.249772 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:03:36.252454 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 397/789] 10.222.0.43 () {56 vars in 1117 bytes} [Wed Jun 22 10:03:36 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:03:36.267277 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f8a41a-9eca-41cd-97f3-f6c17ff9a7f8 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:36.291849 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3af04f-a30a-4fbb-bc0b-3ed3c4d5c1a1 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:36.334409 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:36.341551 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a44841-c33f-4082-85d1-a239027ff8fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:36.342392 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a44841-c33f-4082-85d1-a239027ff8fa None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:36.342676 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a44841-c33f-4082-85d1-a239027ff8fa None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:36.342950 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a44841-c33f-4082-85d1-a239027ff8fa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:36.357753 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a44841-c33f-4082-85d1-a239027ff8fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:03:36.368089 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-a8a44841-c33f-4082-85d1-a239027ff8fa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 10:03:36.368089 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:36.368089 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:36.368089 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:36.368089 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:36.368089 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:36.368089 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:36.368089 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:36.368089 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:36.368089 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:36.368089 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:36.368089 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:36.368089 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:03:36.368089 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:03:36.368089 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:03:36.368089 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:03:36.369138 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:03:36.369138 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:03:36.369138 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:03:36.369138 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:03:36.369138 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:36.369138 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:36.369138 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:36.369138 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:36.369138 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:36.369138 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:36.369138 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:36.369138 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:36.369138 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:36.369138 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:36.369138 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:36.369138 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:36.370004 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:36.370004 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:36.370004 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:36.370004 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:36.370004 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:03:36.370004 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:03:36.370004 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:03:36.370004 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:03:36.370004 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:03:36.370004 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:03:36.370004 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 10:03:36.370004 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:03:36.370004 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 393/790] 10.222.0.43 () {56 vars in 1096 bytes} [Wed Jun 22 10:03:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 10:03:36.374809 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a44841-c33f-4082-85d1-a239027ff8fa None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:36.399936 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f8a41a-9eca-41cd-97f3-f6c17ff9a7f8 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:36.414126 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:36.474644 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b373586-d509-449d-8f7d-e73c04b3373e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:36.475656 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b373586-d509-449d-8f7d-e73c04b3373e None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:36.476454 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b373586-d509-449d-8f7d-e73c04b3373e None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:36.476937 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b373586-d509-449d-8f7d-e73c04b3373e None admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:36.478085 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b373586-d509-449d-8f7d-e73c04b3373e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:36.478608 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b373586-d509-449d-8f7d-e73c04b3373e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:36.480271 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b373586-d509-449d-8f7d-e73c04b3373e None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:36.503835 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 398/791] 10.222.0.43 () {56 vars in 1149 bytes} [Wed Jun 22 10:03:36 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:36.510608 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b373586-d509-449d-8f7d-e73c04b3373e None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:36.529985 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a44841-c33f-4082-85d1-a239027ff8fa None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:36.617215 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd615901-cddb-4f3e-ac7d-738e4ce22c28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:36.618040 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd615901-cddb-4f3e-ac7d-738e4ce22c28 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:36.618252 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd615901-cddb-4f3e-ac7d-738e4ce22c28 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:36.618479 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd615901-cddb-4f3e-ac7d-738e4ce22c28 None admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:36.619240 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd615901-cddb-4f3e-ac7d-738e4ce22c28 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:36.619546 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd615901-cddb-4f3e-ac7d-738e4ce22c28 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:36.620954 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd615901-cddb-4f3e-ac7d-738e4ce22c28 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:36.639117 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 394/792] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Jun 22 10:03:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:03:36.644269 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd615901-cddb-4f3e-ac7d-738e4ce22c28 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:36.652764 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:36.665647 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b373586-d509-449d-8f7d-e73c04b3373e None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:36.703855 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6986a68-e1cc-421f-b54a-73384a4b9361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:36.704651 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6986a68-e1cc-421f-b54a-73384a4b9361 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:36.704929 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6986a68-e1cc-421f-b54a-73384a4b9361 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:36.705202 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6986a68-e1cc-421f-b54a-73384a4b9361 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:36.716300 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6986a68-e1cc-421f-b54a-73384a4b9361 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:36.717793 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6986a68-e1cc-421f-b54a-73384a4b9361 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:36.736070 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-b6986a68-e1cc-421f-b54a-73384a4b9361 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:03:36.736070 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:36.736070 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:36.736070 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:36.736070 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:36.736070 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:36.736070 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:36.736070 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:36.736070 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:36.736070 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:36.736070 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:36.736070 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:36.736070 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:03:36.736070 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:03:36.736070 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:03:36.736993 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:03:36.736993 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:36.736993 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:36.736993 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:36.736993 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:36.736993 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:36.736993 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:36.736993 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:36.736993 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:36.736993 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:36.736993 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:36.736993 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:36.736993 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:36.736993 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:36.736993 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:36.736993 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:36.736993 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:36.737929 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:03:36.737929 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:03:36.737929 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:03:36.737929 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:03:36.741513 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 399/793] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jun 22 10:03:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:03:36.745352 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6986a68-e1cc-421f-b54a-73384a4b9361 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:36.838356 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:36.866548 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd615901-cddb-4f3e-ac7d-738e4ce22c28 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:36.930594 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df4d11a-f489-47f9-b5b9-a441007980a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:36.931397 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df4d11a-f489-47f9-b5b9-a441007980a8 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:36.931682 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df4d11a-f489-47f9-b5b9-a441007980a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:36.931955 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df4d11a-f489-47f9-b5b9-a441007980a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:36.939305 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6986a68-e1cc-421f-b54a-73384a4b9361 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:36.957114 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df4d11a-f489-47f9-b5b9-a441007980a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:36.959323 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df4d11a-f489-47f9-b5b9-a441007980a8 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:36.995453 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-7df4d11a-f489-47f9-b5b9-a441007980a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:03:36.995453 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:36.995453 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:36.995453 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:36.995453 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:36.995453 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:36.995453 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:36.995453 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:36.995453 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:36.995453 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:36.995453 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:36.995453 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:36.995453 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:03:36.995453 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:03:36.995453 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:03:36.996395 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:03:36.996395 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:36.996395 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:36.996395 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:36.996395 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:36.996395 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:36.996395 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:36.996395 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:36.996395 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:36.996395 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:36.996395 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:36.996395 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:36.996395 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:36.996395 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:36.996395 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:36.996395 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:36.996395 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:36.997277 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:03:36.997277 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:03:36.997277 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:03:36.997277 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:03:37.001720 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 395/794] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jun 22 10:03:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 354 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 10:03:37.004616 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df4d11a-f489-47f9-b5b9-a441007980a8 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:37.027337 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b4fe7d-3689-492f-92e3-448743cbd03e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:37.028003 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b4fe7d-3689-492f-92e3-448743cbd03e None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:37.028289 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b4fe7d-3689-492f-92e3-448743cbd03e None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:37.028569 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b4fe7d-3689-492f-92e3-448743cbd03e None admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:37.029301 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b4fe7d-3689-492f-92e3-448743cbd03e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:37.029609 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b4fe7d-3689-492f-92e3-448743cbd03e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:37.031018 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b4fe7d-3689-492f-92e3-448743cbd03e None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:37.040697 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:37.054083 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 400/795] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Jun 22 10:03:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:37.059315 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b4fe7d-3689-492f-92e3-448743cbd03e None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:37.211084 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df4d11a-f489-47f9-b5b9-a441007980a8 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:37.262504 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b4fe7d-3689-492f-92e3-448743cbd03e None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:37.267825 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764ac8f3-4794-4536-9716-ab3867d4a73a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:37.268495 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764ac8f3-4794-4536-9716-ab3867d4a73a None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:37.268776 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764ac8f3-4794-4536-9716-ab3867d4a73a None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:37.269050 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764ac8f3-4794-4536-9716-ab3867d4a73a None admin] PATH_INFO: `/v3/domains` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:37.269818 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764ac8f3-4794-4536-9716-ab3867d4a73a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:37.270663 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764ac8f3-4794-4536-9716-ab3867d4a73a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:37.272047 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764ac8f3-4794-4536-9716-ab3867d4a73a None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:37.281604 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:37.289475 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 396/796] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Jun 22 10:03:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:37.291298 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921b834f-ffd9-4f29-aaec-bbf1dfee72ee None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:37.291585 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921b834f-ffd9-4f29-aaec-bbf1dfee72ee None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:37.291864 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921b834f-ffd9-4f29-aaec-bbf1dfee72ee None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:37.297789 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 397/797] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:03:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:03:37.299217 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921b834f-ffd9-4f29-aaec-bbf1dfee72ee None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:37.311388 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26898114-ba8b-4807-8e8d-b649cd847722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:37.312583 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26898114-ba8b-4807-8e8d-b649cd847722 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:37.312876 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26898114-ba8b-4807-8e8d-b649cd847722 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:37.313159 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26898114-ba8b-4807-8e8d-b649cd847722 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:37.322683 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26898114-ba8b-4807-8e8d-b649cd847722 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:37.324616 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26898114-ba8b-4807-8e8d-b649cd847722 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:37.343320 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-26898114-ba8b-4807-8e8d-b649cd847722 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:03:37.343320 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:37.343320 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:37.343320 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:37.343320 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:37.343320 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:37.343320 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:37.343320 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:37.343320 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:37.343320 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:37.343320 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:37.343320 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:37.343320 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 10:03:37.343320 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 10:03:37.343320 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 10:03:37.344239 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 10:03:37.344239 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:37.344239 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:37.344239 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:37.344239 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:37.344239 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:37.344239 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:37.344239 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:37.344239 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:37.344239 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:37.344239 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:37.344239 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:37.344239 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:37.344239 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:37.344239 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:37.344239 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:37.344239 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:37.345534 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 10:03:37.345534 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 10:03:37.345534 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 10:03:37.345534 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 10:03:37.345534 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 10:03:37.345534 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 10:03:37.345534 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:03:37.345534 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:03:37.345534 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 401/798] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Jun 22 10:03:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:03:37.350156 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5158a720-adf5-46ad-ad7f-ae4c660dc3f8 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:37.350732 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5158a720-adf5-46ad-ad7f-ae4c660dc3f8 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:37.351467 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5158a720-adf5-46ad-ad7f-ae4c660dc3f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:37.374552 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-5158a720-adf5-46ad-ad7f-ae4c660dc3f8 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:03:37.375891 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-5158a720-adf5-46ad-ad7f-ae4c660dc3f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:03:37.436595 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921b834f-ffd9-4f29-aaec-bbf1dfee72ee None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:37.443180 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:37.466088 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 402/799] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:03:37 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 10:03:37.467743 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5158a720-adf5-46ad-ad7f-ae4c660dc3f8 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:37.496868 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd054ab4-06ef-475a-93b5-80fc8ea0632c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:37.498185 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd054ab4-06ef-475a-93b5-80fc8ea0632c None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:37.498916 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd054ab4-06ef-475a-93b5-80fc8ea0632c None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:37.499599 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd054ab4-06ef-475a-93b5-80fc8ea0632c None admin] PATH_INFO: `/v3/users/swift` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:37.509733 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd054ab4-06ef-475a-93b5-80fc8ea0632c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:37.511611 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd054ab4-06ef-475a-93b5-80fc8ea0632c None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:37.529143 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-cd054ab4-06ef-475a-93b5-80fc8ea0632c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 22 10:03:37.529143 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:37.529143 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:37.529143 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:37.529143 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:37.529143 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:37.529143 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:37.529143 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:37.529143 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:37.529143 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:37.529143 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:37.529143 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:37.529143 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 10:03:37.529143 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 10:03:37.529143 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 10:03:37.529143 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 10:03:37.530136 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:37.530136 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:37.530136 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 10:03:37.530136 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:03:37.530136 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 10:03:37.530136 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:03:37.530136 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:37.530136 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:37.530136 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:37.530136 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:37.530136 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:37.530136 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:37.530136 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:37.530136 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:37.530136 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:37.530136 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:37.530136 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:37.530136 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:37.531084 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:37.531084 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:37.531084 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 10:03:37.531084 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 10:03:37.531084 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 10:03:37.531084 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 10:03:37.531084 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 10:03:37.531084 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 10:03:37.531084 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 22 10:03:37.531084 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:03:37.537914 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 398/800] 10.222.0.43 () {56 vars in 1096 bytes} [Wed Jun 22 10:03:37 2022] GET /identity/v3/users/swift => generated 83 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:03:37.539036 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd054ab4-06ef-475a-93b5-80fc8ea0632c None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:37.597117 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5158a720-adf5-46ad-ad7f-ae4c660dc3f8 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:37.604021 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:37.636431 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef471d8-4d1a-4516-b61b-d93c736536b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:37.637099 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef471d8-4d1a-4516-b61b-d93c736536b9 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:37.637383 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef471d8-4d1a-4516-b61b-d93c736536b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:37.637661 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef471d8-4d1a-4516-b61b-d93c736536b9 None admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:37.638491 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef471d8-4d1a-4516-b61b-d93c736536b9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:37.639154 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef471d8-4d1a-4516-b61b-d93c736536b9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:37.640345 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef471d8-4d1a-4516-b61b-d93c736536b9 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:37.652069 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd054ab4-06ef-475a-93b5-80fc8ea0632c None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:37.653362 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 403/801] 10.222.0.43 () {56 vars in 1148 bytes} [Wed Jun 22 10:03:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:37.654510 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef471d8-4d1a-4516-b61b-d93c736536b9 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:37.690048 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f77eb29-00d7-46e3-ba02-1c59edee5458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:37.691217 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f77eb29-00d7-46e3-ba02-1c59edee5458 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:37.692219 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f77eb29-00d7-46e3-ba02-1c59edee5458 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:37.693241 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f77eb29-00d7-46e3-ba02-1c59edee5458 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:37.704527 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f77eb29-00d7-46e3-ba02-1c59edee5458 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:03:37.713234 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-6f77eb29-00d7-46e3-ba02-1c59edee5458 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 10:03:37.713234 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:37.713234 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:37.713234 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:37.713234 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:37.713234 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:37.713234 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:37.713234 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:37.713234 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:37.713234 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:37.713234 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:37.713234 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:37.713234 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:03:37.713234 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:03:37.713234 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:03:37.713234 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:03:37.714180 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:03:37.714180 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:03:37.714180 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:03:37.714180 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:03:37.714180 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:37.714180 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:37.714180 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:37.714180 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:37.714180 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:37.714180 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:37.714180 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:37.714180 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:37.714180 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:37.714180 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:37.714180 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:37.714180 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:37.715008 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:37.715008 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:37.715008 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:37.715008 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:37.715008 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:03:37.715008 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:03:37.715008 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:03:37.715008 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:03:37.715008 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:03:37.715008 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:03:37.715008 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 10:03:37.715008 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:03:37.717640 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 399/802] 10.222.0.43 () {56 vars in 1096 bytes} [Wed Jun 22 10:03:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:03:37.718026 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:37.718869 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f77eb29-00d7-46e3-ba02-1c59edee5458 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:37.771187 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef471d8-4d1a-4516-b61b-d93c736536b9 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:37.812018 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf8075c-062a-47f9-a9d4-706bad11b5e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:37.812619 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf8075c-062a-47f9-a9d4-706bad11b5e7 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:37.812900 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf8075c-062a-47f9-a9d4-706bad11b5e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:37.813176 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf8075c-062a-47f9-a9d4-706bad11b5e7 None admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:37.814110 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf8075c-062a-47f9-a9d4-706bad11b5e7 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:37.814485 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf8075c-062a-47f9-a9d4-706bad11b5e7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:37.816014 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf8075c-062a-47f9-a9d4-706bad11b5e7 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:37.840297 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 404/803] 10.222.0.43 () {56 vars in 1135 bytes} [Wed Jun 22 10:03:37 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:37.840297 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf8075c-062a-47f9-a9d4-706bad11b5e7 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:37.846876 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f77eb29-00d7-46e3-ba02-1c59edee5458 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:37.868031 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:37.885359 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0e69c5-12a9-4216-9134-2f60fdb1e13b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:37.886280 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0e69c5-12a9-4216-9134-2f60fdb1e13b None admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:37.886566 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0e69c5-12a9-4216-9134-2f60fdb1e13b None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:37.886839 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0e69c5-12a9-4216-9134-2f60fdb1e13b None admin] PATH_INFO: `/v3/projects/e03f1c17e0884f188231d2949dc6f956/users/317e7e7dd5c741d49d34a1fd949a7c07/roles/18493ce78e7c480c9202245b6d93cb4c` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:37.901892 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0e69c5-12a9-4216-9134-2f60fdb1e13b None admin] RBAC: Authorizing `identity:create_grant(project_id=e03f1c17e0884f188231d2949dc6f956, user_id=317e7e7dd5c741d49d34a1fd949a7c07, role_id=18493ce78e7c480c9202245b6d93cb4c)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:37.903368 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0e69c5-12a9-4216-9134-2f60fdb1e13b None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:37.916883 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 400/804] 10.222.0.43 () {58 vars in 1439 bytes} [Wed Jun 22 10:03:37 2022] PUT /identity/v3/projects/e03f1c17e0884f188231d2949dc6f956/users/317e7e7dd5c741d49d34a1fd949a7c07/roles/18493ce78e7c480c9202245b6d93cb4c => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:03:37.917980 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0e69c5-12a9-4216-9134-2f60fdb1e13b None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:37.985291 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf8075c-062a-47f9-a9d4-706bad11b5e7 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:37.998128 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:38.032214 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7ad6d2-11ac-4787-ac27-9c9aa5b8f7b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:38.033081 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7ad6d2-11ac-4787-ac27-9c9aa5b8f7b1 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:38.033370 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7ad6d2-11ac-4787-ac27-9c9aa5b8f7b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:38.033647 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7ad6d2-11ac-4787-ac27-9c9aa5b8f7b1 None admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:38.034457 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7ad6d2-11ac-4787-ac27-9c9aa5b8f7b1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:38.034742 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7ad6d2-11ac-4787-ac27-9c9aa5b8f7b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:38.036834 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7ad6d2-11ac-4787-ac27-9c9aa5b8f7b1 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:38.047303 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 405/805] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Jun 22 10:03:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:38.053768 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9e87e1-c433-47d1-9d04-ad41a481e03f None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:38.054092 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9e87e1-c433-47d1-9d04-ad41a481e03f None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:38.055835 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9e87e1-c433-47d1-9d04-ad41a481e03f None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:38.057902 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 406/806] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:03:38 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:03:38.058890 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9e87e1-c433-47d1-9d04-ad41a481e03f None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:38.086446 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0e69c5-12a9-4216-9134-2f60fdb1e13b None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:38.149026 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6360ae-2893-46ee-bb96-1e0a50eb47fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:38.154006 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6360ae-2893-46ee-bb96-1e0a50eb47fe None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:38.154336 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6360ae-2893-46ee-bb96-1e0a50eb47fe None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:38.154627 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6360ae-2893-46ee-bb96-1e0a50eb47fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:38.171571 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6360ae-2893-46ee-bb96-1e0a50eb47fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:38.173182 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6360ae-2893-46ee-bb96-1e0a50eb47fe None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:38.192786 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-9a6360ae-2893-46ee-bb96-1e0a50eb47fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:03:38.192786 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:38.192786 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:38.192786 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:38.192786 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:38.192786 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:38.192786 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:38.192786 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:38.192786 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:38.192786 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:38.192786 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:38.192786 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:38.192786 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:03:38.192786 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:03:38.192786 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:03:38.194590 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:03:38.194590 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:38.194590 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:38.194590 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:38.194590 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:38.194590 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:38.194590 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:38.194590 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:38.194590 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:38.194590 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:38.194590 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:38.194590 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:38.194590 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:38.194590 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:38.194590 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:38.194590 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:38.194590 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:38.196389 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:03:38.196389 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:03:38.196389 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:03:38.196389 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:03:38.196389 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 401/807] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jun 22 10:03:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:03:38.196389 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c597f1a0-7052-4abc-9ff2-343fe75d00d1 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:38.196389 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c597f1a0-7052-4abc-9ff2-343fe75d00d1 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:38.196389 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c597f1a0-7052-4abc-9ff2-343fe75d00d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:38.214084 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-c597f1a0-7052-4abc-9ff2-343fe75d00d1 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:03:38.215278 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-c597f1a0-7052-4abc-9ff2-343fe75d00d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:03:38.219228 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9e87e1-c433-47d1-9d04-ad41a481e03f None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:38.231079 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:38.282499 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf787d12-5628-4fae-b0a1-789432212331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:38.283821 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf787d12-5628-4fae-b0a1-789432212331 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:38.284527 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf787d12-5628-4fae-b0a1-789432212331 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:38.285017 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf787d12-5628-4fae-b0a1-789432212331 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:38.295019 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 402/808] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:03:38 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 10:03:38.295876 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c597f1a0-7052-4abc-9ff2-343fe75d00d1 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:38.308598 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf787d12-5628-4fae-b0a1-789432212331 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:38.311257 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf787d12-5628-4fae-b0a1-789432212331 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:38.350792 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-bf787d12-5628-4fae-b0a1-789432212331 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:03:38.350792 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:38.350792 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:38.350792 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:38.350792 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:38.350792 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:38.350792 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:38.350792 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:38.350792 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:38.350792 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:38.350792 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:38.350792 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:38.350792 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:03:38.350792 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:03:38.350792 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:03:38.354253 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:03:38.354253 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:38.354253 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:38.354253 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:38.354253 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:38.354253 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:38.354253 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:38.354253 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:38.354253 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:38.354253 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:38.354253 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:38.354253 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:38.354253 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:38.354253 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:38.354253 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:38.354253 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:38.354253 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:38.357648 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:03:38.357648 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:03:38.357648 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:03:38.357648 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:03:38.357648 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 407/809] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jun 22 10:03:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:03:38.365735 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf787d12-5628-4fae-b0a1-789432212331 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:38.401077 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:38.426613 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c597f1a0-7052-4abc-9ff2-343fe75d00d1 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:38.465062 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19977a3f-f721-46ea-9ebb-c4ada87428ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:38.466013 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19977a3f-f721-46ea-9ebb-c4ada87428ed None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:38.466488 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19977a3f-f721-46ea-9ebb-c4ada87428ed None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:38.466920 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19977a3f-f721-46ea-9ebb-c4ada87428ed None admin] PATH_INFO: `/v3/domains` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:38.467810 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19977a3f-f721-46ea-9ebb-c4ada87428ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:38.468270 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19977a3f-f721-46ea-9ebb-c4ada87428ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:38.469862 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19977a3f-f721-46ea-9ebb-c4ada87428ed None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:38.482876 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 403/810] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Jun 22 10:03:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:38.483964 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19977a3f-f721-46ea-9ebb-c4ada87428ed None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:38.502044 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:38.544094 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf787d12-5628-4fae-b0a1-789432212331 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:38.591132 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19977a3f-f721-46ea-9ebb-c4ada87428ed None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:38.605901 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f68dafa-8bd6-48c2-b67b-15407836f74a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:38.607199 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f68dafa-8bd6-48c2-b67b-15407836f74a None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:38.607720 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f68dafa-8bd6-48c2-b67b-15407836f74a None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:38.608316 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f68dafa-8bd6-48c2-b67b-15407836f74a None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:38.609563 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f68dafa-8bd6-48c2-b67b-15407836f74a None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:38.612018 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f68dafa-8bd6-48c2-b67b-15407836f74a None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:38.630851 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e73772e-9f0b-462f-8399-f499844b4203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:38.631986 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e73772e-9f0b-462f-8399-f499844b4203 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:38.632480 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e73772e-9f0b-462f-8399-f499844b4203 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:38.633008 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e73772e-9f0b-462f-8399-f499844b4203 None admin] PATH_INFO: `/v3/domains` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:38.634006 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e73772e-9f0b-462f-8399-f499844b4203 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:38.634521 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e73772e-9f0b-462f-8399-f499844b4203 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:38.636110 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e73772e-9f0b-462f-8399-f499844b4203 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:38.638117 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-4f68dafa-8bd6-48c2-b67b-15407836f74a None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 22 10:03:38.638117 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:38.638117 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 10:03:38.638117 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 10:03:38.638117 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 10:03:38.638117 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 10:03:38.638117 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 10:03:38.638117 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 10:03:38.638117 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 22 10:03:38.638117 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:03:38.638117 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 10:03:38.638117 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:03:38.638117 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:38.638117 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:38.638117 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:38.638117 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:38.639043 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:38.639043 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:38.639043 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:38.639043 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:38.639043 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:38.639043 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:38.639043 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:38.639043 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 10:03:38.639043 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 10:03:38.639043 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 10:03:38.639043 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 10:03:38.639043 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:38.639043 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:38.639043 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:38.639043 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:38.639043 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:38.639872 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:38.639872 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:38.639872 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:38.639872 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:38.639872 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:38.639872 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:38.639872 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:38.639872 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:38.639872 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:38.639872 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:38.639872 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:38.639872 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 10:03:38.639872 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 10:03:38.639872 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 22 10:03:38.639872 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:03:38.647821 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 408/811] 10.222.0.43 () {56 vars in 1129 bytes} [Wed Jun 22 10:03:38 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:03:38.649295 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f68dafa-8bd6-48c2-b67b-15407836f74a None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:38.654553 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 404/812] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Jun 22 10:03:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:38.661884 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e73772e-9f0b-462f-8399-f499844b4203 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:38.747508 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:38.763838 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:38.781561 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e73772e-9f0b-462f-8399-f499844b4203 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:38.783103 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f68dafa-8bd6-48c2-b67b-15407836f74a None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:38.819566 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fc9f48-a915-42c8-8780-aa81350b53f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:38.820370 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fc9f48-a915-42c8-8780-aa81350b53f7 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:38.820602 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed7fec5-a513-4cd4-9c2a-69bb6332a680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:38.820734 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fc9f48-a915-42c8-8780-aa81350b53f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:38.820936 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fc9f48-a915-42c8-8780-aa81350b53f7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:38.821668 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed7fec5-a513-4cd4-9c2a-69bb6332a680 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:38.822141 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed7fec5-a513-4cd4-9c2a-69bb6332a680 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:38.822561 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed7fec5-a513-4cd4-9c2a-69bb6332a680 None admin] PATH_INFO: `/v3/services` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:38.823397 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed7fec5-a513-4cd4-9c2a-69bb6332a680 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:38.823850 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed7fec5-a513-4cd4-9c2a-69bb6332a680 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:38.825255 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed7fec5-a513-4cd4-9c2a-69bb6332a680 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:38.827961 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fc9f48-a915-42c8-8780-aa81350b53f7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:38.829381 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fc9f48-a915-42c8-8780-aa81350b53f7 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:38.835238 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 405/813] 10.222.0.43 () {56 vars in 1124 bytes} [Wed Jun 22 10:03:38 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:03:38.835238 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed7fec5-a513-4cd4-9c2a-69bb6332a680 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:38.851574 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-d9fc9f48-a915-42c8-8780-aa81350b53f7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:03:38.851574 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:38.851574 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:38.851574 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:38.851574 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:38.851574 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:38.851574 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:38.851574 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:38.851574 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:38.851574 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:38.851574 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:38.851574 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:38.851574 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 10:03:38.851574 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 10:03:38.851574 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 10:03:38.852483 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 10:03:38.852483 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:38.852483 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:38.852483 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:38.852483 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:38.852483 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:38.852483 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:38.852483 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:38.852483 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:38.852483 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:38.852483 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:38.852483 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:38.852483 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:38.852483 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:38.852483 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:38.852483 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:38.852483 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:38.853361 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 10:03:38.853361 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 10:03:38.853361 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 10:03:38.853361 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 10:03:38.853361 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 10:03:38.853361 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 10:03:38.853361 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:03:38.853361 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:03:38.853361 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 409/814] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Jun 22 10:03:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:03:38.854589 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eca6062-9c2e-42b2-a765-0a5bbb400b48 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:38.854589 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eca6062-9c2e-42b2-a765-0a5bbb400b48 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:38.854589 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eca6062-9c2e-42b2-a765-0a5bbb400b48 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:38.859981 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 410/815] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:03:38 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:03:38.859981 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eca6062-9c2e-42b2-a765-0a5bbb400b48 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:38.944163 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed7fec5-a513-4cd4-9c2a-69bb6332a680 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:38.968773 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eca6062-9c2e-42b2-a765-0a5bbb400b48 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:38.983432 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917efe58-48d6-42aa-b35e-a08aec7cdea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:38.984234 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917efe58-48d6-42aa-b35e-a08aec7cdea1 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:38.984522 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917efe58-48d6-42aa-b35e-a08aec7cdea1 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:38.984800 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917efe58-48d6-42aa-b35e-a08aec7cdea1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:38.987021 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:38.996055 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917efe58-48d6-42aa-b35e-a08aec7cdea1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:38.997528 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917efe58-48d6-42aa-b35e-a08aec7cdea1 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:39.012761 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-917efe58-48d6-42aa-b35e-a08aec7cdea1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 22 10:03:39.012761 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:39.012761 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:39.012761 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:39.012761 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:39.012761 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:39.012761 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:39.012761 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:39.012761 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:39.012761 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:39.012761 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:39.012761 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:39.012761 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 10:03:39.012761 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 10:03:39.012761 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 10:03:39.012761 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 10:03:39.014004 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:39.014004 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:39.014004 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 10:03:39.014004 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:03:39.014004 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 10:03:39.014004 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:03:39.014004 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:39.014004 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:39.014004 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:39.014004 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:39.014004 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:39.014004 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:39.014004 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:39.014004 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:39.014004 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:39.014004 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:39.014004 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:39.014004 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:39.014963 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:39.014963 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:39.014963 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 10:03:39.014963 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 10:03:39.014963 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 10:03:39.014963 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 10:03:39.014963 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 10:03:39.014963 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 10:03:39.014963 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 22 10:03:39.014963 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:03:39.015492 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d72a6af-2d47-4f6e-a277-aeab1e0f8c58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:39.015492 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d72a6af-2d47-4f6e-a277-aeab1e0f8c58 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:39.015492 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d72a6af-2d47-4f6e-a277-aeab1e0f8c58 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:39.015492 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d72a6af-2d47-4f6e-a277-aeab1e0f8c58 None admin] PATH_INFO: `/v3/services` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:39.016096 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d72a6af-2d47-4f6e-a277-aeab1e0f8c58 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:39.016096 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d72a6af-2d47-4f6e-a277-aeab1e0f8c58 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:39.016622 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d72a6af-2d47-4f6e-a277-aeab1e0f8c58 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:39.018671 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 406/816] 10.222.0.43 () {56 vars in 1093 bytes} [Wed Jun 22 10:03:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:03:39.020137 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0626c0e8-539d-4523-aaca-63cb50f0c33a None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:39.020425 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0626c0e8-539d-4523-aaca-63cb50f0c33a None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:39.020707 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0626c0e8-539d-4523-aaca-63cb50f0c33a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:39.026145 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 411/817] 10.222.0.43 () {56 vars in 1124 bytes} [Wed Jun 22 10:03:38 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:39.026145 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d72a6af-2d47-4f6e-a277-aeab1e0f8c58 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:39.034605 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:39.042694 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-0626c0e8-539d-4523-aaca-63cb50f0c33a None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:03:39.043894 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-0626c0e8-539d-4523-aaca-63cb50f0c33a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:03:39.122580 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 407/818] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:03:39 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 10:03:39.123377 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0626c0e8-539d-4523-aaca-63cb50f0c33a None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:39.151513 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d72a6af-2d47-4f6e-a277-aeab1e0f8c58 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:39.193005 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37dc347-a055-4307-bf05-43bf868d7e87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:39.193682 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37dc347-a055-4307-bf05-43bf868d7e87 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:39.193994 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37dc347-a055-4307-bf05-43bf868d7e87 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:39.194274 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37dc347-a055-4307-bf05-43bf868d7e87 None admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:39.195076 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37dc347-a055-4307-bf05-43bf868d7e87 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:39.195390 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37dc347-a055-4307-bf05-43bf868d7e87 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:39.196841 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37dc347-a055-4307-bf05-43bf868d7e87 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:39.215089 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 412/819] 10.222.0.43 () {56 vars in 1148 bytes} [Wed Jun 22 10:03:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:39.215905 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37dc347-a055-4307-bf05-43bf868d7e87 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:39.249163 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0626c0e8-539d-4523-aaca-63cb50f0c33a None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:39.276170 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:39.289225 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1485edd1-1664-4ab9-92f5-d20edc281c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:39.289927 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1485edd1-1664-4ab9-92f5-d20edc281c41 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:39.290211 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1485edd1-1664-4ab9-92f5-d20edc281c41 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:39.290487 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1485edd1-1664-4ab9-92f5-d20edc281c41 None admin] PATH_INFO: `/v3/users` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:39.291320 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1485edd1-1664-4ab9-92f5-d20edc281c41 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:39.291630 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1485edd1-1664-4ab9-92f5-d20edc281c41 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:39.293084 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1485edd1-1664-4ab9-92f5-d20edc281c41 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:39.299283 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:39.312053 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 408/820] 10.222.0.43 () {56 vars in 1133 bytes} [Wed Jun 22 10:03:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:39.317371 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1485edd1-1664-4ab9-92f5-d20edc281c41 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:39.336512 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37dc347-a055-4307-bf05-43bf868d7e87 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:39.371451 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cfc91f-4b0f-4db9-89fe-d8a43840a69b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:39.372107 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cfc91f-4b0f-4db9-89fe-d8a43840a69b None admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:39.372446 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cfc91f-4b0f-4db9-89fe-d8a43840a69b None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:39.372789 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cfc91f-4b0f-4db9-89fe-d8a43840a69b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:39.373486 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cfc91f-4b0f-4db9-89fe-d8a43840a69b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:39.374879 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cfc91f-4b0f-4db9-89fe-d8a43840a69b None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:39.398240 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 413/821] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Jun 22 10:03:39 2022] POST /identity/v3/endpoints => generated 346 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:03:39.406824 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cfc91f-4b0f-4db9-89fe-d8a43840a69b None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:39.435777 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1485edd1-1664-4ab9-92f5-d20edc281c41 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:39.485508 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b3ae17-9aa1-4370-8551-3798dce77c0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:39.486800 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b3ae17-9aa1-4370-8551-3798dce77c0a None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:39.487284 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b3ae17-9aa1-4370-8551-3798dce77c0a None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:39.487865 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b3ae17-9aa1-4370-8551-3798dce77c0a None admin] PATH_INFO: `/v3/services/network` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:39.489286 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b3ae17-9aa1-4370-8551-3798dce77c0a None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:39.491016 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b3ae17-9aa1-4370-8551-3798dce77c0a None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:39.504268 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-98b3ae17-9aa1-4370-8551-3798dce77c0a None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 22 10:03:39.504268 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:39.504268 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 10:03:39.504268 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 10:03:39.504268 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 10:03:39.504268 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 10:03:39.504268 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 10:03:39.504268 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 10:03:39.504268 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 22 10:03:39.504268 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:03:39.504268 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 10:03:39.504268 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:03:39.504268 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:39.504268 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:39.504268 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:39.504268 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:39.504268 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:39.506326 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:39.506326 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:39.506326 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:39.506326 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:39.506326 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:39.506326 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:39.506326 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 10:03:39.506326 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 10:03:39.506326 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 10:03:39.506326 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 10:03:39.506326 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:39.506326 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:39.506326 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:39.506326 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:39.506326 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:39.506326 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:39.507161 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:39.507161 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:39.507161 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:39.507161 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:39.507161 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:39.507161 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:39.507161 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:39.507161 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:39.507161 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:39.507161 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:39.507161 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 10:03:39.507161 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 10:03:39.507161 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 22 10:03:39.507161 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:03:39.515094 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 409/822] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Jun 22 10:03:39 2022] GET /identity/v3/services/network => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:03:39.516360 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b3ae17-9aa1-4370-8551-3798dce77c0a None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:39.558754 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cfc91f-4b0f-4db9-89fe-d8a43840a69b None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:39.572113 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:39.593660 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:39.610703 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8053384f-dbe5-4a41-86a2-cd797bf83e33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:39.611246 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8053384f-dbe5-4a41-86a2-cd797bf83e33 None admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:39.611533 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8053384f-dbe5-4a41-86a2-cd797bf83e33 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:39.611810 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8053384f-dbe5-4a41-86a2-cd797bf83e33 None admin] PATH_INFO: `/v3/projects/e03f1c17e0884f188231d2949dc6f956/users/9566f8cca2574f4cb5edcbf384f368a7/roles/26d9c2ab5dfc4e6d9ca80c6014123906` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:39.613928 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8053384f-dbe5-4a41-86a2-cd797bf83e33 None admin] RBAC: Authorizing `identity:create_grant(project_id=e03f1c17e0884f188231d2949dc6f956, user_id=9566f8cca2574f4cb5edcbf384f368a7, role_id=26d9c2ab5dfc4e6d9ca80c6014123906)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:39.615993 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8053384f-dbe5-4a41-86a2-cd797bf83e33 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:39.634221 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 414/823] 10.222.0.43 () {58 vars in 1439 bytes} [Wed Jun 22 10:03:39 2022] PUT /identity/v3/projects/e03f1c17e0884f188231d2949dc6f956/users/9566f8cca2574f4cb5edcbf384f368a7/roles/26d9c2ab5dfc4e6d9ca80c6014123906 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:03:39.635270 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8053384f-dbe5-4a41-86a2-cd797bf83e33 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:39.656568 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b3ae17-9aa1-4370-8551-3798dce77c0a None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:39.730481 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aa7bcb-9e8e-4abf-9acf-858242d1a4c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:39.731148 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aa7bcb-9e8e-4abf-9acf-858242d1a4c0 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:39.731433 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aa7bcb-9e8e-4abf-9acf-858242d1a4c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:39.731710 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aa7bcb-9e8e-4abf-9acf-858242d1a4c0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:39.818662 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8053384f-dbe5-4a41-86a2-cd797bf83e33 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:39.846764 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37aa7bcb-9e8e-4abf-9acf-858242d1a4c0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:39.849006 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37aa7bcb-9e8e-4abf-9acf-858242d1a4c0 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:39.864524 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba23d8a-64d2-410d-903b-74a824955828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:39.865226 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba23d8a-64d2-410d-903b-74a824955828 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:39.865512 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba23d8a-64d2-410d-903b-74a824955828 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:39.866201 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba23d8a-64d2-410d-903b-74a824955828 None admin] PATH_INFO: `/v3/services` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:39.867202 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba23d8a-64d2-410d-903b-74a824955828 None admin] RBAC: Adding query filter params (name=network) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:39.867519 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba23d8a-64d2-410d-903b-74a824955828 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:39.869073 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba23d8a-64d2-410d-903b-74a824955828 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:39.877779 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 415/824] 10.222.0.43 () {56 vars in 1112 bytes} [Wed Jun 22 10:03:39 2022] GET /identity/v3/services?name=network => generated 124 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:39.882334 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba23d8a-64d2-410d-903b-74a824955828 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:39.914340 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:39.944174 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:40.014981 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 410/825] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Jun 22 10:03:39 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 499 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 10:03:40.021337 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aa7bcb-9e8e-4abf-9acf-858242d1a4c0 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:40.049712 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba23d8a-64d2-410d-903b-74a824955828 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:40.116407 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a05d29f-20ec-4a9a-abe8-d820e2687093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:40.117421 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a05d29f-20ec-4a9a-abe8-d820e2687093 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:40.118413 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a05d29f-20ec-4a9a-abe8-d820e2687093 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:40.119485 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a05d29f-20ec-4a9a-abe8-d820e2687093 None admin] PATH_INFO: `/v3/services` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:40.120410 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a05d29f-20ec-4a9a-abe8-d820e2687093 None admin] RBAC: Adding query filter params (type=network) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:40.122142 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a05d29f-20ec-4a9a-abe8-d820e2687093 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:40.123923 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a05d29f-20ec-4a9a-abe8-d820e2687093 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:40.130295 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 416/826] 10.222.0.43 () {56 vars in 1112 bytes} [Wed Jun 22 10:03:39 2022] GET /identity/v3/services?type=network => generated 350 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:40.131615 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3953aea-e4d5-4afa-b2f3-65820b7a1b3c None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:40.131953 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3953aea-e4d5-4afa-b2f3-65820b7a1b3c None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:40.132189 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3953aea-e4d5-4afa-b2f3-65820b7a1b3c None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:40.137469 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 417/827] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:03:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:03:40.138645 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3953aea-e4d5-4afa-b2f3-65820b7a1b3c None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:40.183047 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aa7bcb-9e8e-4abf-9acf-858242d1a4c0 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:40.220681 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0e9653-c757-47aa-b1c2-0a8c791bc7ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:40.222018 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0e9653-c757-47aa-b1c2-0a8c791bc7ac None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:40.222544 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0e9653-c757-47aa-b1c2-0a8c791bc7ac None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:40.223081 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0e9653-c757-47aa-b1c2-0a8c791bc7ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:40.234909 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0e9653-c757-47aa-b1c2-0a8c791bc7ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:40.236758 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0e9653-c757-47aa-b1c2-0a8c791bc7ac None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:40.239518 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:40.250851 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3953aea-e4d5-4afa-b2f3-65820b7a1b3c None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:40.259503 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-2d0e9653-c757-47aa-b1c2-0a8c791bc7ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:03:40.259503 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:40.259503 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:40.259503 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:40.259503 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:40.259503 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:40.259503 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:40.259503 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:40.259503 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:40.259503 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:40.259503 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:40.259503 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:40.259503 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:03:40.259503 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:03:40.259503 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:03:40.260417 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:03:40.260417 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:40.260417 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:40.260417 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:40.260417 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:40.260417 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:40.260417 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:40.260417 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:40.260417 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:40.260417 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:40.260417 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:40.260417 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:40.260417 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:40.260417 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:40.260417 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:40.260417 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:40.260417 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:40.261301 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:03:40.261301 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:03:40.261301 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:03:40.261301 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:03:40.263819 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 411/828] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jun 22 10:03:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:03:40.265291 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9969f39-2965-4757-8b4e-409386195310 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:40.266115 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:40.266348 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9969f39-2965-4757-8b4e-409386195310 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:40.266815 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9969f39-2965-4757-8b4e-409386195310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:40.287402 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-d9969f39-2965-4757-8b4e-409386195310 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:03:40.288921 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-d9969f39-2965-4757-8b4e-409386195310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:03:40.289947 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc097240-e29d-465d-822a-894f46cbd5af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:40.290623 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc097240-e29d-465d-822a-894f46cbd5af None admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:40.290914 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc097240-e29d-465d-822a-894f46cbd5af None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:40.291199 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc097240-e29d-465d-822a-894f46cbd5af None admin] PATH_INFO: `/v3/endpoints` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:40.292010 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc097240-e29d-465d-822a-894f46cbd5af None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:40.293719 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc097240-e29d-465d-822a-894f46cbd5af None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:40.319028 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 418/829] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Jun 22 10:03:40 2022] POST /identity/v3/endpoints => generated 327 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:03:40.320191 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc097240-e29d-465d-822a-894f46cbd5af None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:40.456113 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 412/830] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:03:40 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 10:03:40.474026 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc097240-e29d-465d-822a-894f46cbd5af None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:40.491454 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9969f39-2965-4757-8b4e-409386195310 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:40.554831 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf64ba1d-cfd4-4d25-b0fb-70dd6f854a33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:40.555524 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf64ba1d-cfd4-4d25-b0fb-70dd6f854a33 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:40.555811 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf64ba1d-cfd4-4d25-b0fb-70dd6f854a33 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:40.556307 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf64ba1d-cfd4-4d25-b0fb-70dd6f854a33 None admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:40.557172 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf64ba1d-cfd4-4d25-b0fb-70dd6f854a33 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:40.557489 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf64ba1d-cfd4-4d25-b0fb-70dd6f854a33 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:40.558921 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf64ba1d-cfd4-4d25-b0fb-70dd6f854a33 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:40.575909 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 419/831] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Jun 22 10:03:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:40.581184 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf64ba1d-cfd4-4d25-b0fb-70dd6f854a33 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:40.615429 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:40.622332 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9969f39-2965-4757-8b4e-409386195310 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:40.652576 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:40.669416 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4f635f-d82d-46da-8a2f-612c9f5e2e28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:40.670253 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4f635f-d82d-46da-8a2f-612c9f5e2e28 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:40.670547 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4f635f-d82d-46da-8a2f-612c9f5e2e28 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:40.670833 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4f635f-d82d-46da-8a2f-612c9f5e2e28 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:40.685039 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4f635f-d82d-46da-8a2f-612c9f5e2e28 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:03:40.696925 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-af4f635f-d82d-46da-8a2f-612c9f5e2e28 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 10:03:40.696925 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:40.696925 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:40.696925 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:40.696925 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:40.696925 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:40.696925 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:40.696925 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:40.696925 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:40.696925 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:40.696925 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:40.696925 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:40.696925 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:03:40.696925 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:03:40.696925 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:03:40.696925 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:03:40.698040 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:03:40.698040 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:03:40.698040 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:03:40.698040 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:03:40.698040 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:40.698040 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:40.698040 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:40.698040 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:40.698040 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:40.698040 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:40.698040 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:40.698040 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:40.698040 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:40.698040 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:40.698040 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:40.698040 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:40.698885 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:40.698885 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:40.698885 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:40.698885 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:40.698885 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:03:40.698885 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:03:40.698885 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:03:40.698885 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:03:40.698885 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:03:40.698885 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:03:40.698885 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 10:03:40.698885 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:03:40.698885 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 413/832] 10.222.0.43 () {56 vars in 1102 bytes} [Wed Jun 22 10:03:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 10:03:40.705256 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4f635f-d82d-46da-8a2f-612c9f5e2e28 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:40.712126 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf64ba1d-cfd4-4d25-b0fb-70dd6f854a33 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:40.757034 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095cffe4-8cbe-4543-965b-0ae9359bbbcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:40.758138 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095cffe4-8cbe-4543-965b-0ae9359bbbcc None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:40.758590 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095cffe4-8cbe-4543-965b-0ae9359bbbcc None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:40.759026 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095cffe4-8cbe-4543-965b-0ae9359bbbcc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:40.766704 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095cffe4-8cbe-4543-965b-0ae9359bbbcc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:40.768353 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095cffe4-8cbe-4543-965b-0ae9359bbbcc None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:40.783570 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-095cffe4-8cbe-4543-965b-0ae9359bbbcc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:03:40.783570 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:40.783570 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:40.783570 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:40.783570 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:40.783570 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:40.783570 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:40.783570 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:40.783570 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:40.783570 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:40.783570 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:40.783570 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:40.783570 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 10:03:40.783570 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 10:03:40.783570 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 10:03:40.784682 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 10:03:40.784682 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:40.784682 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:40.784682 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:40.784682 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:40.784682 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:40.784682 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:40.784682 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:40.784682 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:40.784682 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:40.784682 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:40.784682 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:40.784682 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:40.784682 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:40.784682 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:40.784682 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:40.784682 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:40.785911 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 10:03:40.785911 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 10:03:40.785911 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 10:03:40.785911 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 10:03:40.785911 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 10:03:40.785911 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 10:03:40.785911 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:03:40.785911 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:03:40.789804 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 420/833] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Jun 22 10:03:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 10:03:40.793375 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095cffe4-8cbe-4543-965b-0ae9359bbbcc None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:40.831884 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4f635f-d82d-46da-8a2f-612c9f5e2e28 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:40.868732 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd68da89-954e-4d2e-a113-fb017beeccc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:40.869417 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd68da89-954e-4d2e-a113-fb017beeccc4 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:40.869726 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd68da89-954e-4d2e-a113-fb017beeccc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:40.870041 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd68da89-954e-4d2e-a113-fb017beeccc4 None admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:40.870802 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd68da89-954e-4d2e-a113-fb017beeccc4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:40.871116 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd68da89-954e-4d2e-a113-fb017beeccc4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:40.872741 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd68da89-954e-4d2e-a113-fb017beeccc4 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:40.882048 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 414/834] 10.222.0.43 () {56 vars in 1103 bytes} [Wed Jun 22 10:03:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:03:40.887180 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd68da89-954e-4d2e-a113-fb017beeccc4 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:40.911222 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:40.930728 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095cffe4-8cbe-4543-965b-0ae9359bbbcc None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:40.934253 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:40.983913 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5321087-fd7c-4fb2-b321-1c4bd7ad00ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:40.985274 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5321087-fd7c-4fb2-b321-1c4bd7ad00ac None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:40.985823 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5321087-fd7c-4fb2-b321-1c4bd7ad00ac None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:40.986522 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5321087-fd7c-4fb2-b321-1c4bd7ad00ac None admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:40.987467 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5321087-fd7c-4fb2-b321-1c4bd7ad00ac None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:40.987919 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5321087-fd7c-4fb2-b321-1c4bd7ad00ac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:40.990501 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5321087-fd7c-4fb2-b321-1c4bd7ad00ac None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:41.008100 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 421/835] 10.222.0.43 () {56 vars in 1148 bytes} [Wed Jun 22 10:03:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:41.017513 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5321087-fd7c-4fb2-b321-1c4bd7ad00ac None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:41.018232 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd68da89-954e-4d2e-a113-fb017beeccc4 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:41.062612 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4c1aaf-027d-463e-82b0-4b05f5eaa683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:41.063685 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4c1aaf-027d-463e-82b0-4b05f5eaa683 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:41.064162 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4c1aaf-027d-463e-82b0-4b05f5eaa683 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:41.064642 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4c1aaf-027d-463e-82b0-4b05f5eaa683 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:41.076936 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4c1aaf-027d-463e-82b0-4b05f5eaa683 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:41.078741 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4c1aaf-027d-463e-82b0-4b05f5eaa683 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:41.106461 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-af4c1aaf-027d-463e-82b0-4b05f5eaa683 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:03:41.106461 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:41.106461 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:41.106461 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:41.106461 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:41.106461 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:41.106461 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:41.106461 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:41.106461 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:41.106461 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:41.106461 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:41.106461 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:41.106461 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:03:41.106461 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:03:41.106461 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:03:41.107500 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:03:41.107500 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:41.107500 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:41.107500 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:41.107500 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:41.107500 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:41.107500 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:41.107500 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:41.107500 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:41.107500 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:41.107500 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:41.107500 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:41.107500 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:41.107500 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:41.107500 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:41.107500 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:41.107500 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:41.108589 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:03:41.108589 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:03:41.108589 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:03:41.108589 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:03:41.110632 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 415/836] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jun 22 10:03:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 10:03:41.116346 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4c1aaf-027d-463e-82b0-4b05f5eaa683 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:41.147406 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5321087-fd7c-4fb2-b321-1c4bd7ad00ac None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:41.184232 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d853d90-7cfb-4920-8cbc-0e13a56c64bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:41.185133 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d853d90-7cfb-4920-8cbc-0e13a56c64bb None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:41.185559 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d853d90-7cfb-4920-8cbc-0e13a56c64bb None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:41.185994 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d853d90-7cfb-4920-8cbc-0e13a56c64bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:41.187094 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d853d90-7cfb-4920-8cbc-0e13a56c64bb None admin] RBAC: Adding query filter params (role.id=26d9c2ab5dfc4e6d9ca80c6014123906, scope.project.id=e03f1c17e0884f188231d2949dc6f956, user.id=158a49aa3750478a84bf71b9aad24397) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:41.187602 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d853d90-7cfb-4920-8cbc-0e13a56c64bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:41.189212 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d853d90-7cfb-4920-8cbc-0e13a56c64bb None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:41.195839 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 422/837] 10.222.0.43 () {56 vars in 1374 bytes} [Wed Jun 22 10:03:41 2022] GET /identity/v3/role_assignments?user.id=158a49aa3750478a84bf71b9aad24397&scope.project.id=e03f1c17e0884f188231d2949dc6f956&role.id=26d9c2ab5dfc4e6d9ca80c6014123906 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:03:41.247622 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:41.254842 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4c1aaf-027d-463e-82b0-4b05f5eaa683 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:41.299359 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddeb531-0755-4215-9ac6-b7fd3e86c6aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:41.300422 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddeb531-0755-4215-9ac6-b7fd3e86c6aa None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:41.300912 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddeb531-0755-4215-9ac6-b7fd3e86c6aa None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:41.301658 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddeb531-0755-4215-9ac6-b7fd3e86c6aa None admin] PATH_INFO: `/v3/domains` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:41.303039 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddeb531-0755-4215-9ac6-b7fd3e86c6aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:41.303892 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddeb531-0755-4215-9ac6-b7fd3e86c6aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:41.306581 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddeb531-0755-4215-9ac6-b7fd3e86c6aa None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:41.328715 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 416/838] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Jun 22 10:03:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:41.334628 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d853d90-7cfb-4920-8cbc-0e13a56c64bb None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:41.353003 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:41.446750 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d853d90-7cfb-4920-8cbc-0e13a56c64bb None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:41.482862 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ce50f9-2a45-480a-9cb2-62e1dfbb7fca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:41.483829 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ce50f9-2a45-480a-9cb2-62e1dfbb7fca None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:41.484210 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ce50f9-2a45-480a-9cb2-62e1dfbb7fca None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:41.484586 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ce50f9-2a45-480a-9cb2-62e1dfbb7fca None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:41.492996 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ce50f9-2a45-480a-9cb2-62e1dfbb7fca None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:41.494590 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ce50f9-2a45-480a-9cb2-62e1dfbb7fca None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:41.509784 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-64ce50f9-2a45-480a-9cb2-62e1dfbb7fca None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 22 10:03:41.509784 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:41.509784 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:41.509784 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:41.509784 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:41.509784 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:41.509784 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:41.509784 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:41.509784 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:41.509784 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:41.509784 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:41.509784 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:41.509784 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 10:03:41.509784 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 10:03:41.509784 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 10:03:41.509784 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 10:03:41.510914 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:41.510914 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:41.510914 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 10:03:41.510914 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:03:41.510914 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 10:03:41.510914 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:03:41.510914 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:41.510914 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:41.510914 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:41.510914 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:41.510914 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:41.510914 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:41.510914 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:41.510914 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:41.510914 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:41.510914 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:41.510914 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:41.510914 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:41.512039 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:41.512039 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:41.512039 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 10:03:41.512039 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 10:03:41.512039 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 10:03:41.512039 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 10:03:41.512039 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 10:03:41.512039 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 10:03:41.512039 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 22 10:03:41.512039 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:03:41.513951 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 423/839] 10.222.0.43 () {56 vars in 1117 bytes} [Wed Jun 22 10:03:41 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:03:41.522824 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddeb531-0755-4215-9ac6-b7fd3e86c6aa None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:41.635662 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddeb531-0755-4215-9ac6-b7fd3e86c6aa None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:41.671972 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed1a404-0d02-4571-a426-b1b8a78b6d72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:41.672803 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed1a404-0d02-4571-a426-b1b8a78b6d72 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:41.673190 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed1a404-0d02-4571-a426-b1b8a78b6d72 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:41.673568 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed1a404-0d02-4571-a426-b1b8a78b6d72 None admin] PATH_INFO: `/v3/users` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:41.674532 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed1a404-0d02-4571-a426-b1b8a78b6d72 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:41.674946 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed1a404-0d02-4571-a426-b1b8a78b6d72 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:41.677020 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed1a404-0d02-4571-a426-b1b8a78b6d72 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:41.695505 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 417/840] 10.222.0.43 () {56 vars in 1149 bytes} [Wed Jun 22 10:03:41 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:41.702760 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ce50f9-2a45-480a-9cb2-62e1dfbb7fca None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:41.762068 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d79f12-061b-49c1-ad9c-ac04441106db None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:41.762581 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d79f12-061b-49c1-ad9c-ac04441106db None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:41.763075 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d79f12-061b-49c1-ad9c-ac04441106db None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:41.764835 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 418/841] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:03:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 10:03:41.772163 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfbae85-192e-40cb-980f-981bc0581ed6 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:41.772639 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfbae85-192e-40cb-980f-981bc0581ed6 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:41.773234 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfbae85-192e-40cb-980f-981bc0581ed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:41.781777 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:41.796194 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-ebfbae85-192e-40cb-980f-981bc0581ed6 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:03:41.797683 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-ebfbae85-192e-40cb-980f-981bc0581ed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:03:41.813116 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:41.813887 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ce50f9-2a45-480a-9cb2-62e1dfbb7fca None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:41.848978 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0730e5-563c-4617-b977-6fe7a3d98f85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:41.849746 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0730e5-563c-4617-b977-6fe7a3d98f85 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:41.850108 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0730e5-563c-4617-b977-6fe7a3d98f85 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:41.850392 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0730e5-563c-4617-b977-6fe7a3d98f85 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:41.884714 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 419/842] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:03:41 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 10:03:41.906939 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfbae85-192e-40cb-980f-981bc0581ed6 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:41.933263 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0730e5-563c-4617-b977-6fe7a3d98f85 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:41.935387 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0730e5-563c-4617-b977-6fe7a3d98f85 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:42.028774 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:42.036502 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfbae85-192e-40cb-980f-981bc0581ed6 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:42.062693 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 424/843] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Jun 22 10:03:41 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 10:03:42.064047 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2772b966-b4f4-49b0-8b46-84ce2e0295d5 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:42.064337 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2772b966-b4f4-49b0-8b46-84ce2e0295d5 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:42.064615 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2772b966-b4f4-49b0-8b46-84ce2e0295d5 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:42.066131 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 425/844] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:03:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:03:42.069742 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2772b966-b4f4-49b0-8b46-84ce2e0295d5 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:42.080436 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122c41e5-207d-496c-9e53-468fc4fcaf4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:42.081248 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122c41e5-207d-496c-9e53-468fc4fcaf4f None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:42.081533 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122c41e5-207d-496c-9e53-468fc4fcaf4f None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:42.081853 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122c41e5-207d-496c-9e53-468fc4fcaf4f None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:42.083355 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122c41e5-207d-496c-9e53-468fc4fcaf4f None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:42.084845 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122c41e5-207d-496c-9e53-468fc4fcaf4f None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:42.096993 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-122c41e5-207d-496c-9e53-468fc4fcaf4f None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 22 10:03:42.096993 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:42.096993 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 10:03:42.096993 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 10:03:42.096993 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 10:03:42.096993 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 10:03:42.096993 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 10:03:42.096993 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 10:03:42.096993 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 22 10:03:42.096993 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:03:42.096993 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 10:03:42.096993 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:03:42.096993 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:42.096993 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:42.096993 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:42.096993 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:42.096993 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:42.098209 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:42.098209 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:42.098209 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:42.098209 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:42.098209 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:42.098209 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:42.098209 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 10:03:42.098209 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 10:03:42.098209 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 10:03:42.098209 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 10:03:42.098209 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:42.098209 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:42.098209 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:42.098209 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:42.098209 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:42.098209 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:42.099060 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:42.099060 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:42.099060 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:42.099060 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:42.099060 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:42.099060 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:42.099060 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:42.099060 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:42.099060 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:42.099060 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:42.099060 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 10:03:42.099060 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 10:03:42.099060 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 22 10:03:42.099060 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:03:42.103941 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 420/845] 10.222.0.43 () {56 vars in 1114 bytes} [Wed Jun 22 10:03:41 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:03:42.105295 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f631bfb3-28bb-4aba-b69e-620982aa2044 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:42.105591 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f631bfb3-28bb-4aba-b69e-620982aa2044 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:42.105900 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f631bfb3-28bb-4aba-b69e-620982aa2044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:42.117158 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:42.122863 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-f631bfb3-28bb-4aba-b69e-620982aa2044 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:03:42.124412 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-f631bfb3-28bb-4aba-b69e-620982aa2044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:03:42.181209 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2772b966-b4f4-49b0-8b46-84ce2e0295d5 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:42.205889 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 421/846] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:03:42 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 10:03:42.206573 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f631bfb3-28bb-4aba-b69e-620982aa2044 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:42.230493 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb164c2-9871-4df9-a8ff-261ddf9cfff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:42.231578 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb164c2-9871-4df9-a8ff-261ddf9cfff6 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:42.231870 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb164c2-9871-4df9-a8ff-261ddf9cfff6 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:42.232412 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb164c2-9871-4df9-a8ff-261ddf9cfff6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:42.247156 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb164c2-9871-4df9-a8ff-261ddf9cfff6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:42.249097 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb164c2-9871-4df9-a8ff-261ddf9cfff6 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:42.273515 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-6bb164c2-9871-4df9-a8ff-261ddf9cfff6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:03:42.273515 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:42.273515 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:42.273515 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:42.273515 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:42.273515 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:42.273515 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:42.273515 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:42.273515 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:42.273515 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:42.273515 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:42.273515 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:42.273515 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:03:42.273515 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:03:42.273515 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:03:42.274579 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:03:42.274579 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:42.274579 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:42.274579 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:42.274579 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:42.274579 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:42.274579 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:42.274579 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:42.274579 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:42.274579 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:42.274579 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:42.274579 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:42.274579 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:42.274579 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:42.274579 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:42.274579 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:42.274579 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:42.275477 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:03:42.275477 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:03:42.275477 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:03:42.275477 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:03:42.276334 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 426/847] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jun 22 10:03:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 10:03:42.277157 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb164c2-9871-4df9-a8ff-261ddf9cfff6 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:42.303674 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:42.317209 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f631bfb3-28bb-4aba-b69e-620982aa2044 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:42.357235 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a80d41-9fb4-48ac-b9d9-2963c16fe6a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:42.358459 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a80d41-9fb4-48ac-b9d9-2963c16fe6a2 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:42.360695 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a80d41-9fb4-48ac-b9d9-2963c16fe6a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:42.362852 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a80d41-9fb4-48ac-b9d9-2963c16fe6a2 None admin] PATH_INFO: `/v3/services` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:42.363651 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a80d41-9fb4-48ac-b9d9-2963c16fe6a2 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:42.363973 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a80d41-9fb4-48ac-b9d9-2963c16fe6a2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:42.366898 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a80d41-9fb4-48ac-b9d9-2963c16fe6a2 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:42.369250 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:42.378080 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 422/848] 10.222.0.43 () {56 vars in 1114 bytes} [Wed Jun 22 10:03:42 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:42.379788 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a80d41-9fb4-48ac-b9d9-2963c16fe6a2 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:42.384799 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb164c2-9871-4df9-a8ff-261ddf9cfff6 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:42.421975 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923348e6-be0d-4b41-b821-f1a5deccb87a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:42.422880 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923348e6-be0d-4b41-b821-f1a5deccb87a None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:42.423252 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923348e6-be0d-4b41-b821-f1a5deccb87a None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:42.423600 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923348e6-be0d-4b41-b821-f1a5deccb87a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:42.435059 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923348e6-be0d-4b41-b821-f1a5deccb87a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:03:42.443166 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-923348e6-be0d-4b41-b821-f1a5deccb87a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 10:03:42.443166 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:42.443166 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:42.443166 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:42.443166 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:42.443166 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:42.443166 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:42.443166 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:42.443166 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:42.443166 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:42.443166 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:42.443166 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:42.443166 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:03:42.443166 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:03:42.443166 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:03:42.443166 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:03:42.444335 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:03:42.444335 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:03:42.444335 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:03:42.444335 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:03:42.444335 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:42.444335 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:42.444335 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:42.444335 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:42.444335 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:42.444335 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:42.444335 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:42.444335 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:42.444335 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:42.444335 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:42.444335 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:42.444335 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:42.445355 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:42.445355 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:42.445355 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:42.445355 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:42.445355 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:03:42.445355 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:03:42.445355 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:03:42.445355 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:03:42.445355 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:03:42.445355 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:03:42.445355 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 10:03:42.445355 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:03:42.452647 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 427/849] 10.222.0.43 () {56 vars in 1096 bytes} [Wed Jun 22 10:03:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:03:42.452647 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923348e6-be0d-4b41-b821-f1a5deccb87a None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:42.495135 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a80d41-9fb4-48ac-b9d9-2963c16fe6a2 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:42.530280 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5dd781-57f8-4918-9f73-1fe1ef9d549a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:42.530950 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5dd781-57f8-4918-9f73-1fe1ef9d549a None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:42.531246 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5dd781-57f8-4918-9f73-1fe1ef9d549a None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:42.531528 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5dd781-57f8-4918-9f73-1fe1ef9d549a None admin] PATH_INFO: `/v3/domains` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:42.532253 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5dd781-57f8-4918-9f73-1fe1ef9d549a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:42.532566 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5dd781-57f8-4918-9f73-1fe1ef9d549a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:42.533978 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5dd781-57f8-4918-9f73-1fe1ef9d549a None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:42.546504 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 423/850] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Jun 22 10:03:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:42.547305 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5dd781-57f8-4918-9f73-1fe1ef9d549a None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:42.557767 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:42.575853 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923348e6-be0d-4b41-b821-f1a5deccb87a None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:42.611689 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:42.613413 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245af3bf-b8b9-4bf5-848e-b41f34d1259f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:42.614185 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245af3bf-b8b9-4bf5-848e-b41f34d1259f None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:42.614466 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245af3bf-b8b9-4bf5-848e-b41f34d1259f None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:42.615317 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245af3bf-b8b9-4bf5-848e-b41f34d1259f None admin] PATH_INFO: `/v3/services` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:42.616153 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245af3bf-b8b9-4bf5-848e-b41f34d1259f None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:42.616464 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245af3bf-b8b9-4bf5-848e-b41f34d1259f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:42.617874 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245af3bf-b8b9-4bf5-848e-b41f34d1259f None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:42.633722 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 428/851] 10.222.0.43 () {56 vars in 1114 bytes} [Wed Jun 22 10:03:42 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:42.633722 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245af3bf-b8b9-4bf5-848e-b41f34d1259f None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:42.683066 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5dd781-57f8-4918-9f73-1fe1ef9d549a None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:42.735650 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf6ce11-0b8e-4058-bc33-09eca6a08cad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:42.736603 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf6ce11-0b8e-4058-bc33-09eca6a08cad None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:42.736993 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf6ce11-0b8e-4058-bc33-09eca6a08cad None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:42.737633 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf6ce11-0b8e-4058-bc33-09eca6a08cad None admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:42.739434 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf6ce11-0b8e-4058-bc33-09eca6a08cad None admin] RBAC: Adding query filter params (name=admin) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:42.739754 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf6ce11-0b8e-4058-bc33-09eca6a08cad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:42.741226 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245af3bf-b8b9-4bf5-848e-b41f34d1259f None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:42.741352 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf6ce11-0b8e-4058-bc33-09eca6a08cad None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:42.753915 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 424/852] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Jun 22 10:03:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:42.759338 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf6ce11-0b8e-4058-bc33-09eca6a08cad None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:42.791747 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039df0fd-d9ad-4841-b0ee-740e9b6565fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:42.793878 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039df0fd-d9ad-4841-b0ee-740e9b6565fa None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:42.794497 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039df0fd-d9ad-4841-b0ee-740e9b6565fa None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:42.795512 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039df0fd-d9ad-4841-b0ee-740e9b6565fa None admin] PATH_INFO: `/v3/projects/service` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:42.805058 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039df0fd-d9ad-4841-b0ee-740e9b6565fa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:42.806649 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039df0fd-d9ad-4841-b0ee-740e9b6565fa None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:42.823339 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-039df0fd-d9ad-4841-b0ee-740e9b6565fa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:03:42.823339 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:42.823339 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:42.823339 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:42.823339 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:42.823339 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:42.823339 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:42.823339 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:42.823339 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:42.823339 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:42.823339 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:42.823339 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:42.823339 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 10:03:42.823339 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 10:03:42.823339 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 10:03:42.824266 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 10:03:42.824266 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:42.824266 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:42.824266 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:42.824266 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:42.824266 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:42.824266 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:42.824266 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:42.824266 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:42.824266 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:42.824266 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:42.824266 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:42.824266 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:42.824266 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:42.824266 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:42.824266 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:42.824266 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:42.825175 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 10:03:42.825175 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 10:03:42.825175 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 10:03:42.825175 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 10:03:42.825175 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 10:03:42.825175 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 10:03:42.825175 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:03:42.825175 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:03:42.825175 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 429/853] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Jun 22 10:03:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:03:42.830039 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039df0fd-d9ad-4841-b0ee-740e9b6565fa None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:42.862299 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:42.958690 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039df0fd-d9ad-4841-b0ee-740e9b6565fa None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:42.998811 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7599696c-19a2-453f-bdf6-42b3d8c5b018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:42.999846 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7599696c-19a2-453f-bdf6-42b3d8c5b018 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:43.000345 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7599696c-19a2-453f-bdf6-42b3d8c5b018 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:43.000859 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7599696c-19a2-453f-bdf6-42b3d8c5b018 None admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:43.001913 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7599696c-19a2-453f-bdf6-42b3d8c5b018 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:43.002437 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7599696c-19a2-453f-bdf6-42b3d8c5b018 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:43.004165 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7599696c-19a2-453f-bdf6-42b3d8c5b018 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:43.021374 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 430/854] 10.222.0.43 () {56 vars in 1148 bytes} [Wed Jun 22 10:03:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:03:43.028449 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7599696c-19a2-453f-bdf6-42b3d8c5b018 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:43.046893 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf6ce11-0b8e-4058-bc33-09eca6a08cad None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:43.077631 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:43.093634 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dedda6-2147-4b82-a665-a1a90e868008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:43.094462 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dedda6-2147-4b82-a665-a1a90e868008 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:43.094745 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dedda6-2147-4b82-a665-a1a90e868008 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:43.095024 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dedda6-2147-4b82-a665-a1a90e868008 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:43.112223 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dedda6-2147-4b82-a665-a1a90e868008 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:43.114166 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dedda6-2147-4b82-a665-a1a90e868008 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:43.126936 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:43.144234 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-22dedda6-2147-4b82-a665-a1a90e868008 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:03:43.144234 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:43.144234 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:43.144234 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:43.144234 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:43.144234 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:43.144234 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:43.144234 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:43.144234 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:43.144234 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:43.144234 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:43.144234 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:43.144234 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:03:43.144234 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:03:43.144234 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:03:43.145804 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:03:43.145804 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:43.145804 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:43.145804 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:43.145804 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:43.145804 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:43.145804 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:43.145804 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:43.145804 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:43.145804 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:43.145804 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:43.145804 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:43.145804 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:43.145804 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:43.145804 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:43.145804 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:43.145804 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:43.146708 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:03:43.146708 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:03:43.146708 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:03:43.146708 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:03:43.149719 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 425/855] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jun 22 10:03:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 390 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 10:03:43.154446 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dedda6-2147-4b82-a665-a1a90e868008 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:43.170130 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7599696c-19a2-453f-bdf6-42b3d8c5b018 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:43.216288 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf250792-218a-40c9-867d-b0722861035d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:43.217124 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf250792-218a-40c9-867d-b0722861035d None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:43.217798 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf250792-218a-40c9-867d-b0722861035d None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:43.218184 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf250792-218a-40c9-867d-b0722861035d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:43.219619 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf250792-218a-40c9-867d-b0722861035d None admin] RBAC: Adding query filter params (role.id=18493ce78e7c480c9202245b6d93cb4c, scope.project.id=e03f1c17e0884f188231d2949dc6f956, user.id=317e7e7dd5c741d49d34a1fd949a7c07) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:43.220041 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf250792-218a-40c9-867d-b0722861035d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:43.222140 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf250792-218a-40c9-867d-b0722861035d None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:43.231253 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 431/856] 10.222.0.43 () {56 vars in 1374 bytes} [Wed Jun 22 10:03:43 2022] GET /identity/v3/role_assignments?user.id=317e7e7dd5c741d49d34a1fd949a7c07&scope.project.id=e03f1c17e0884f188231d2949dc6f956&role.id=18493ce78e7c480c9202245b6d93cb4c => generated 608 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:43.288371 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dedda6-2147-4b82-a665-a1a90e868008 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:43.328132 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cf57e4-b5a4-426d-91b7-f1ce45a2fc57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:43.329048 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cf57e4-b5a4-426d-91b7-f1ce45a2fc57 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:43.329478 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cf57e4-b5a4-426d-91b7-f1ce45a2fc57 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:43.329938 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cf57e4-b5a4-426d-91b7-f1ce45a2fc57 None admin] PATH_INFO: `/v3/domains` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:43.330849 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cf57e4-b5a4-426d-91b7-f1ce45a2fc57 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:43.331322 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cf57e4-b5a4-426d-91b7-f1ce45a2fc57 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:43.333421 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cf57e4-b5a4-426d-91b7-f1ce45a2fc57 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:43.346970 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 426/857] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Jun 22 10:03:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:03:43.356059 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf250792-218a-40c9-867d-b0722861035d None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:43.409594 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dd7c89-d9dd-4d22-b6b3-60e47d279d79 None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:43.410064 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dd7c89-d9dd-4d22-b6b3-60e47d279d79 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:43.410975 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dd7c89-d9dd-4d22-b6b3-60e47d279d79 None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:43.412963 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 427/858] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:03:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:03:43.418645 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3501d6fc-f862-41de-af44-0e60c2fbbddd None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:43.418825 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3501d6fc-f862-41de-af44-0e60c2fbbddd None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:43.419150 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3501d6fc-f862-41de-af44-0e60c2fbbddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:43.437469 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-3501d6fc-f862-41de-af44-0e60c2fbbddd None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:03:43.438804 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-3501d6fc-f862-41de-af44-0e60c2fbbddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:03:43.478202 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:43.491639 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf250792-218a-40c9-867d-b0722861035d None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:43.528290 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:43.533874 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 428/859] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:03:43 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 10:03:43.538336 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1491393-2de6-4dc5-ba6c-9d259863c437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:43.539580 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1491393-2de6-4dc5-ba6c-9d259863c437 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:43.540225 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1491393-2de6-4dc5-ba6c-9d259863c437 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:43.540916 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1491393-2de6-4dc5-ba6c-9d259863c437 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:43.549331 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1491393-2de6-4dc5-ba6c-9d259863c437 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:43.550888 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1491393-2de6-4dc5-ba6c-9d259863c437 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:43.556064 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3501d6fc-f862-41de-af44-0e60c2fbbddd None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:43.570646 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-f1491393-2de6-4dc5-ba6c-9d259863c437 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 22 10:03:43.570646 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:43.570646 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:43.570646 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:43.570646 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:43.570646 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:43.570646 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:43.570646 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:43.570646 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:43.570646 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:43.570646 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:43.570646 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:43.570646 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 10:03:43.570646 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 10:03:43.570646 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 10:03:43.570646 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 10:03:43.571733 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:43.571733 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:43.571733 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 10:03:43.571733 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:03:43.571733 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 10:03:43.571733 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:03:43.571733 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:43.571733 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:43.571733 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:43.571733 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:43.571733 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:43.571733 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:43.571733 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:43.571733 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:43.571733 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:43.571733 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:43.571733 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:43.571733 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:43.572872 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:43.572872 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:43.572872 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 10:03:43.572872 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 10:03:43.572872 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 10:03:43.572872 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 10:03:43.572872 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 10:03:43.572872 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 10:03:43.572872 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 22 10:03:43.572872 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:03:43.574859 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 432/860] 10.222.0.43 () {56 vars in 1096 bytes} [Wed Jun 22 10:03:43 2022] GET /identity/v3/users/swift => generated 83 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:03:43.580580 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1491393-2de6-4dc5-ba6c-9d259863c437 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:43.681722 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3501d6fc-f862-41de-af44-0e60c2fbbddd None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:43.697896 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1491393-2de6-4dc5-ba6c-9d259863c437 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:43.718394 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10ba589-42ef-47f4-ba05-0affae76a742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:43.719204 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10ba589-42ef-47f4-ba05-0affae76a742 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:43.719488 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10ba589-42ef-47f4-ba05-0affae76a742 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:43.719761 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10ba589-42ef-47f4-ba05-0affae76a742 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:43.720409 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10ba589-42ef-47f4-ba05-0affae76a742 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:43.721804 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10ba589-42ef-47f4-ba05-0affae76a742 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:43.735318 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-a10ba589-42ef-47f4-ba05-0affae76a742 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 22 10:03:43.735318 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:43.735318 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 10:03:43.735318 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 10:03:43.735318 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 10:03:43.735318 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 10:03:43.735318 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 10:03:43.735318 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 10:03:43.735318 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 22 10:03:43.735318 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:03:43.735318 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 10:03:43.735318 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:03:43.735318 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:43.735318 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:43.735318 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:43.735318 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:43.736290 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:43.736290 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:43.736290 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:43.736290 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:43.736290 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:43.736290 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:43.736290 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:43.736290 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 10:03:43.736290 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 10:03:43.736290 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 10:03:43.736290 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 10:03:43.736290 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:43.736290 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:43.736290 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:43.736290 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:43.736290 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:43.737209 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:43.737209 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:43.737209 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:43.737209 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:43.737209 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:43.737209 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:43.737209 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:43.737209 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:43.737209 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:43.737209 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:43.737209 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:43.737209 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 10:03:43.737209 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 10:03:43.737209 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 22 10:03:43.737209 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:03:43.737209 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 429/861] 10.222.0.43 () {56 vars in 1132 bytes} [Wed Jun 22 10:03:43 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:03:43.744277 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10ba589-42ef-47f4-ba05-0affae76a742 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:43.746673 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2d6b50-e012-412d-8f81-33f7cdd73ded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:43.747884 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2d6b50-e012-412d-8f81-33f7cdd73ded None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:43.749336 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2d6b50-e012-412d-8f81-33f7cdd73ded None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:43.749879 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2d6b50-e012-412d-8f81-33f7cdd73ded None admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:43.750960 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2d6b50-e012-412d-8f81-33f7cdd73ded None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:43.751484 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2d6b50-e012-412d-8f81-33f7cdd73ded None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:43.753122 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2d6b50-e012-412d-8f81-33f7cdd73ded None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:43.775433 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:43.780604 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 433/862] 10.222.0.43 () {56 vars in 1135 bytes} [Wed Jun 22 10:03:43 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:03:43.786906 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2d6b50-e012-412d-8f81-33f7cdd73ded None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:43.860339 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:43.870279 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10ba589-42ef-47f4-ba05-0affae76a742 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:43.916528 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0334b3-f4e8-4ad4-a698-115b5c3d653c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:43.917144 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0334b3-f4e8-4ad4-a698-115b5c3d653c None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:43.917619 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0334b3-f4e8-4ad4-a698-115b5c3d653c None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:43.917954 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0334b3-f4e8-4ad4-a698-115b5c3d653c None admin] PATH_INFO: `/v3/services` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:43.918765 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0334b3-f4e8-4ad4-a698-115b5c3d653c None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:43.919177 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0334b3-f4e8-4ad4-a698-115b5c3d653c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:43.920779 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0334b3-f4e8-4ad4-a698-115b5c3d653c None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:43.926567 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 430/863] 10.222.0.43 () {56 vars in 1126 bytes} [Wed Jun 22 10:03:43 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:03:43.928380 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2d6b50-e012-412d-8f81-33f7cdd73ded None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:43.931777 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0334b3-f4e8-4ad4-a698-115b5c3d653c None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:43.973643 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6e7d79-5f80-4212-96fd-23593ba094fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:43.974836 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6e7d79-5f80-4212-96fd-23593ba094fe None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:43.975331 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6e7d79-5f80-4212-96fd-23593ba094fe None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:43.976595 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6e7d79-5f80-4212-96fd-23593ba094fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:44.030267 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:44.040770 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0334b3-f4e8-4ad4-a698-115b5c3d653c None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:44.070873 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6e7d79-5f80-4212-96fd-23593ba094fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:44.073575 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6e7d79-5f80-4212-96fd-23593ba094fe None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:44.084733 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44493f9-3a14-4c6b-bbd5-4926365bf239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:44.086088 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44493f9-3a14-4c6b-bbd5-4926365bf239 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:44.086546 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44493f9-3a14-4c6b-bbd5-4926365bf239 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:44.086977 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44493f9-3a14-4c6b-bbd5-4926365bf239 None admin] PATH_INFO: `/v3/services` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:44.088458 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44493f9-3a14-4c6b-bbd5-4926365bf239 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:44.088924 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44493f9-3a14-4c6b-bbd5-4926365bf239 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:44.091009 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44493f9-3a14-4c6b-bbd5-4926365bf239 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:44.097614 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 431/864] 10.222.0.43 () {56 vars in 1126 bytes} [Wed Jun 22 10:03:43 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:44.146320 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:44.195869 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 434/865] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Jun 22 10:03:43 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 22 10:03:44.201770 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44493f9-3a14-4c6b-bbd5-4926365bf239 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:44.314815 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44493f9-3a14-4c6b-bbd5-4926365bf239 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:44.354955 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecc0e2e-7387-473e-97f1-8686e6a411ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:44.355751 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecc0e2e-7387-473e-97f1-8686e6a411ba None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:44.356033 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecc0e2e-7387-473e-97f1-8686e6a411ba None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:44.356311 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecc0e2e-7387-473e-97f1-8686e6a411ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:44.368242 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecc0e2e-7387-473e-97f1-8686e6a411ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:44.369708 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecc0e2e-7387-473e-97f1-8686e6a411ba None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:44.387151 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-0ecc0e2e-7387-473e-97f1-8686e6a411ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:03:44.387151 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:44.387151 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:44.387151 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:44.387151 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:44.387151 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:44.387151 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:44.387151 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:44.387151 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:44.387151 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:44.387151 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:44.387151 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:44.387151 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:03:44.387151 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:03:44.387151 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:03:44.388080 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:03:44.388080 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:44.388080 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:44.388080 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:44.388080 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:44.388080 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:44.388080 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:44.388080 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:44.388080 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:44.388080 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:44.388080 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:44.388080 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:44.388080 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:44.388080 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:44.388080 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:44.388080 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:44.388080 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:44.388953 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:03:44.388953 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:03:44.388953 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:03:44.388953 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:03:44.388953 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 432/866] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jun 22 10:03:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:03:44.395320 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6e7d79-5f80-4212-96fd-23593ba094fe None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:44.500412 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6e7d79-5f80-4212-96fd-23593ba094fe None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:44.537832 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2598c7c-61d8-46bf-b8d6-592d28a5f77c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:44.538889 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2598c7c-61d8-46bf-b8d6-592d28a5f77c None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:44.539384 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2598c7c-61d8-46bf-b8d6-592d28a5f77c None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:44.539870 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2598c7c-61d8-46bf-b8d6-592d28a5f77c None admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:44.540800 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2598c7c-61d8-46bf-b8d6-592d28a5f77c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:44.541324 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2598c7c-61d8-46bf-b8d6-592d28a5f77c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:44.542963 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2598c7c-61d8-46bf-b8d6-592d28a5f77c None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:44.559294 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 435/867] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Jun 22 10:03:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:44.564959 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecc0e2e-7387-473e-97f1-8686e6a411ba None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:44.579991 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:44.678629 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecc0e2e-7387-473e-97f1-8686e6a411ba None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:44.717000 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7946670e-77e4-4406-b970-d3acb3ab6d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:44.718228 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7946670e-77e4-4406-b970-d3acb3ab6d91 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:44.718719 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7946670e-77e4-4406-b970-d3acb3ab6d91 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:44.719697 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7946670e-77e4-4406-b970-d3acb3ab6d91 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:44.727517 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7946670e-77e4-4406-b970-d3acb3ab6d91 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:44.729327 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7946670e-77e4-4406-b970-d3acb3ab6d91 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:44.744952 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-7946670e-77e4-4406-b970-d3acb3ab6d91 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:03:44.744952 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:44.744952 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:44.744952 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:44.744952 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:44.744952 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:44.744952 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:44.744952 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:44.744952 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:44.744952 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:44.744952 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:44.744952 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:44.744952 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 10:03:44.744952 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 10:03:44.744952 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 10:03:44.745891 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 10:03:44.745891 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:44.745891 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:44.745891 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:44.745891 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:44.745891 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:44.745891 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:44.745891 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:44.745891 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:44.745891 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:44.745891 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:44.745891 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:44.745891 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:44.745891 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:44.745891 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:44.745891 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:44.745891 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:44.746781 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 10:03:44.746781 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 10:03:44.746781 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 10:03:44.746781 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 10:03:44.746781 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 10:03:44.746781 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 10:03:44.746781 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:03:44.746781 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:03:44.749203 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 433/868] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Jun 22 10:03:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:03:44.755789 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2598c7c-61d8-46bf-b8d6-592d28a5f77c None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:44.770565 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:44.848816 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d888ff8-a76a-4b93-91fe-54b97d219fb1 None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:44.849468 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d888ff8-a76a-4b93-91fe-54b97d219fb1 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:44.850011 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d888ff8-a76a-4b93-91fe-54b97d219fb1 None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:44.852103 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 434/869] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:03:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:03:44.857260 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01703001-97ac-4499-819c-9a786a3557bb None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:44.857795 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01703001-97ac-4499-819c-9a786a3557bb None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:44.858274 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01703001-97ac-4499-819c-9a786a3557bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:44.864483 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2598c7c-61d8-46bf-b8d6-592d28a5f77c None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:44.877223 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-01703001-97ac-4499-819c-9a786a3557bb None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:03:44.878647 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-01703001-97ac-4499-819c-9a786a3557bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:03:44.900148 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93db957b-9485-4305-ae0b-3cd612ac1224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:44.900824 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93db957b-9485-4305-ae0b-3cd612ac1224 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:44.901111 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93db957b-9485-4305-ae0b-3cd612ac1224 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:44.901394 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93db957b-9485-4305-ae0b-3cd612ac1224 None admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:44.902222 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93db957b-9485-4305-ae0b-3cd612ac1224 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:44.902539 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93db957b-9485-4305-ae0b-3cd612ac1224 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:44.903977 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93db957b-9485-4305-ae0b-3cd612ac1224 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:44.917583 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 436/870] 10.222.0.43 () {56 vars in 1148 bytes} [Wed Jun 22 10:03:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:03:44.926950 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93db957b-9485-4305-ae0b-3cd612ac1224 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:44.947067 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:44.953220 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 435/871] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:03:44 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 10:03:44.977653 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01703001-97ac-4499-819c-9a786a3557bb None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:45.006695 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:45.055265 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93db957b-9485-4305-ae0b-3cd612ac1224 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:45.100034 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01703001-97ac-4499-819c-9a786a3557bb None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:45.112011 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8fcdcc-b6a8-4441-9221-b8bd94178588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:45.112670 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8fcdcc-b6a8-4441-9221-b8bd94178588 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:45.113274 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8fcdcc-b6a8-4441-9221-b8bd94178588 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:45.113396 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8fcdcc-b6a8-4441-9221-b8bd94178588 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:45.114915 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8fcdcc-b6a8-4441-9221-b8bd94178588 None admin] RBAC: Adding query filter params (role.id=26d9c2ab5dfc4e6d9ca80c6014123906, scope.project.id=e03f1c17e0884f188231d2949dc6f956, user.id=9566f8cca2574f4cb5edcbf384f368a7) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:45.115229 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8fcdcc-b6a8-4441-9221-b8bd94178588 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:45.116978 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8fcdcc-b6a8-4441-9221-b8bd94178588 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:45.129725 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 437/872] 10.222.0.43 () {56 vars in 1374 bytes} [Wed Jun 22 10:03:44 2022] GET /identity/v3/role_assignments?user.id=9566f8cca2574f4cb5edcbf384f368a7&scope.project.id=e03f1c17e0884f188231d2949dc6f956&role.id=26d9c2ab5dfc4e6d9ca80c6014123906 => generated 608 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:45.146826 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12b6343-5948-4fa1-959f-19a41d4cb5a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:45.147916 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12b6343-5948-4fa1-959f-19a41d4cb5a5 None admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:45.148253 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12b6343-5948-4fa1-959f-19a41d4cb5a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:45.148536 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12b6343-5948-4fa1-959f-19a41d4cb5a5 None admin] PATH_INFO: `/v3/services` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:45.149290 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12b6343-5948-4fa1-959f-19a41d4cb5a5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:45.150756 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12b6343-5948-4fa1-959f-19a41d4cb5a5 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:45.170597 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 436/873] 10.222.0.43 () {60 vars in 1141 bytes} [Wed Jun 22 10:03:44 2022] POST /identity/v3/services => generated 251 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 10:03:45.608096 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45317ab3-b851-4ebf-abd9-99cb18a9b22b None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:45.608623 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45317ab3-b851-4ebf-abd9-99cb18a9b22b None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:45.608809 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45317ab3-b851-4ebf-abd9-99cb18a9b22b None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:45.610270 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 438/874] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:03:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:03:45.616309 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d09297f-15d8-4ec8-b673-a2ddf89cdd68 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:45.616611 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d09297f-15d8-4ec8-b673-a2ddf89cdd68 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:45.616902 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d09297f-15d8-4ec8-b673-a2ddf89cdd68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:45.634994 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-5d09297f-15d8-4ec8-b673-a2ddf89cdd68 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:03:45.636193 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-5d09297f-15d8-4ec8-b673-a2ddf89cdd68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:03:45.695248 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:45.716392 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 437/875] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:03:45 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 10:03:45.741516 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45317ab3-b851-4ebf-abd9-99cb18a9b22b None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:45.851370 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45317ab3-b851-4ebf-abd9-99cb18a9b22b None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:45.888822 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49cd078-d61a-427f-8d58-36c88911c206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:45.890003 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49cd078-d61a-427f-8d58-36c88911c206 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:45.890493 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49cd078-d61a-427f-8d58-36c88911c206 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:45.890989 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49cd078-d61a-427f-8d58-36c88911c206 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:45.893115 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:45.903950 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49cd078-d61a-427f-8d58-36c88911c206 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:03:45.914158 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-b49cd078-d61a-427f-8d58-36c88911c206 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 22 10:03:45.914158 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:45.914158 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:45.914158 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:45.914158 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:45.914158 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:45.914158 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:45.914158 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:45.914158 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:45.914158 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:45.914158 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:45.914158 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:45.914158 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:03:45.914158 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:03:45.914158 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:03:45.914158 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:03:45.915093 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:03:45.915093 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:03:45.915093 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:03:45.915093 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:03:45.915093 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:45.915093 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:45.915093 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:45.915093 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:45.915093 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:45.915093 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:45.915093 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:45.915093 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:45.915093 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:45.915093 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:45.915093 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:45.915093 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:45.915926 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:45.915926 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:45.915926 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:45.915926 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:45.915926 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:03:45.915926 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:03:45.915926 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:03:45.915926 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:03:45.915926 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:03:45.915926 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:03:45.915926 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 22 10:03:45.915926 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:03:45.918744 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 439/876] 10.222.0.43 () {56 vars in 1120 bytes} [Wed Jun 22 10:03:45 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:03:45.927011 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d09297f-15d8-4ec8-b673-a2ddf89cdd68 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:46.034053 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d09297f-15d8-4ec8-b673-a2ddf89cdd68 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:46.071097 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bb935c-e82e-4f9c-bafe-cd7ac4105829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:46.072104 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bb935c-e82e-4f9c-bafe-cd7ac4105829 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:46.072593 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bb935c-e82e-4f9c-bafe-cd7ac4105829 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:46.073072 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bb935c-e82e-4f9c-bafe-cd7ac4105829 None admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:46.074084 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bb935c-e82e-4f9c-bafe-cd7ac4105829 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:46.074594 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bb935c-e82e-4f9c-bafe-cd7ac4105829 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:46.076164 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bb935c-e82e-4f9c-bafe-cd7ac4105829 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:46.085947 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 438/877] 10.222.0.43 () {56 vars in 1115 bytes} [Wed Jun 22 10:03:45 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:46.094160 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49cd078-d61a-427f-8d58-36c88911c206 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:46.199298 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49cd078-d61a-427f-8d58-36c88911c206 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:46.234496 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0259ed5c-57c7-4d87-b22d-7df8527411b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:46.235648 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0259ed5c-57c7-4d87-b22d-7df8527411b5 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:46.236144 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0259ed5c-57c7-4d87-b22d-7df8527411b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:46.236710 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0259ed5c-57c7-4d87-b22d-7df8527411b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:46.248724 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0259ed5c-57c7-4d87-b22d-7df8527411b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:46.250508 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0259ed5c-57c7-4d87-b22d-7df8527411b5 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:46.273933 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-0259ed5c-57c7-4d87-b22d-7df8527411b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:03:46.273933 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:46.273933 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:46.273933 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:46.273933 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:46.273933 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:46.273933 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:46.273933 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:46.273933 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:46.273933 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:46.273933 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:46.273933 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:46.273933 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:03:46.273933 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:03:46.273933 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:03:46.274886 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:03:46.274886 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:46.274886 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:46.274886 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:46.274886 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:46.274886 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:46.274886 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:46.274886 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:46.274886 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:46.274886 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:46.274886 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:46.274886 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:46.274886 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:46.274886 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:46.274886 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:46.274886 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:46.274886 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:46.275803 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:03:46.275803 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:03:46.275803 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:03:46.275803 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:03:46.275803 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 440/878] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jun 22 10:03:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:03:46.282977 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bb935c-e82e-4f9c-bafe-cd7ac4105829 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:46.299507 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d99c16-4c73-4eed-87bf-08f1140e8ca3 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:46.299789 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d99c16-4c73-4eed-87bf-08f1140e8ca3 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:46.300077 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d99c16-4c73-4eed-87bf-08f1140e8ca3 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:46.301898 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 441/879] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:03:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:03:46.306747 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49cbcf2-4064-43d2-89f0-11c3d20f5613 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:46.307038 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49cbcf2-4064-43d2-89f0-11c3d20f5613 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:46.307319 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49cbcf2-4064-43d2-89f0-11c3d20f5613 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:46.325037 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-f49cbcf2-4064-43d2-89f0-11c3d20f5613 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:03:46.326251 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-f49cbcf2-4064-43d2-89f0-11c3d20f5613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:03:46.358085 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:46.389750 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:46.422006 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 442/880] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:03:46 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 10:03:46.424422 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bb935c-e82e-4f9c-bafe-cd7ac4105829 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:46.442475 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49cbcf2-4064-43d2-89f0-11c3d20f5613 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:46.466102 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614d18bd-2201-4d85-8ff9-c21c3a27ef30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:46.466960 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614d18bd-2201-4d85-8ff9-c21c3a27ef30 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:46.467247 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614d18bd-2201-4d85-8ff9-c21c3a27ef30 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:46.467524 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614d18bd-2201-4d85-8ff9-c21c3a27ef30 None admin] PATH_INFO: `/v3/domains` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:46.468503 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614d18bd-2201-4d85-8ff9-c21c3a27ef30 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:46.469229 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614d18bd-2201-4d85-8ff9-c21c3a27ef30 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:46.470887 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614d18bd-2201-4d85-8ff9-c21c3a27ef30 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:46.487302 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 439/881] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Jun 22 10:03:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:46.493379 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614d18bd-2201-4d85-8ff9-c21c3a27ef30 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:46.560978 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49cbcf2-4064-43d2-89f0-11c3d20f5613 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:46.597553 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdbdf39-0374-4747-82e2-bfc97299e8c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:46.598961 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdbdf39-0374-4747-82e2-bfc97299e8c7 None admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:46.599210 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdbdf39-0374-4747-82e2-bfc97299e8c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:46.599545 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdbdf39-0374-4747-82e2-bfc97299e8c7 None admin] PATH_INFO: `/v3/services` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:46.600450 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdbdf39-0374-4747-82e2-bfc97299e8c7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:46.602126 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdbdf39-0374-4747-82e2-bfc97299e8c7 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:46.619494 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614d18bd-2201-4d85-8ff9-c21c3a27ef30 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:46.623568 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 443/882] 10.222.0.43 () {60 vars in 1141 bytes} [Wed Jun 22 10:03:46 2022] POST /identity/v3/services => generated 269 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:03:46.632899 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:46.672082 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e541ab-2669-4f62-b411-22c08780c954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:46.672971 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e541ab-2669-4f62-b411-22c08780c954 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:46.673259 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e541ab-2669-4f62-b411-22c08780c954 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:46.673544 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e541ab-2669-4f62-b411-22c08780c954 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:46.683870 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e541ab-2669-4f62-b411-22c08780c954 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:46.685383 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e541ab-2669-4f62-b411-22c08780c954 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:46.702777 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-91e541ab-2669-4f62-b411-22c08780c954 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 22 10:03:46.702777 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:46.702777 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:46.702777 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:46.702777 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:46.702777 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:46.702777 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:46.702777 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:46.702777 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:46.702777 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:46.702777 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:46.702777 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:46.702777 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 10:03:46.702777 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 10:03:46.702777 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 10:03:46.702777 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 10:03:46.704977 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:46.704977 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:46.704977 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 10:03:46.704977 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:03:46.704977 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 10:03:46.704977 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:03:46.704977 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:46.704977 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:46.704977 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:46.704977 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:46.704977 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:46.704977 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:46.704977 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:46.704977 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:46.704977 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:46.704977 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:46.704977 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:46.704977 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:46.707366 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:46.707366 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:46.707366 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 10:03:46.707366 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 10:03:46.707366 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 10:03:46.707366 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 10:03:46.707366 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 10:03:46.707366 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 10:03:46.707366 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 22 10:03:46.707366 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:03:46.707366 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 440/883] 10.222.0.43 () {56 vars in 1117 bytes} [Wed Jun 22 10:03:46 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 10:03:46.713773 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdbdf39-0374-4747-82e2-bfc97299e8c7 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:46.751516 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:46.823694 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdbdf39-0374-4747-82e2-bfc97299e8c7 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:46.859991 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a473c119-163b-44c2-9982-ab4343b6837d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:46.860669 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a473c119-163b-44c2-9982-ab4343b6837d None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:46.860949 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a473c119-163b-44c2-9982-ab4343b6837d None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:46.861226 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a473c119-163b-44c2-9982-ab4343b6837d None admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:46.862091 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a473c119-163b-44c2-9982-ab4343b6837d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:46.862401 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a473c119-163b-44c2-9982-ab4343b6837d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:46.864770 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a473c119-163b-44c2-9982-ab4343b6837d None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:46.882903 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 444/884] 10.222.0.43 () {56 vars in 1149 bytes} [Wed Jun 22 10:03:46 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:46.888503 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e541ab-2669-4f62-b411-22c08780c954 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:46.997501 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e541ab-2669-4f62-b411-22c08780c954 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:47.032707 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60251ce4-d004-4879-ac8e-8d254a7e4a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:47.033283 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60251ce4-d004-4879-ac8e-8d254a7e4a81 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:47.033565 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60251ce4-d004-4879-ac8e-8d254a7e4a81 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:47.033869 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60251ce4-d004-4879-ac8e-8d254a7e4a81 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:47.072268 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:47.114506 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60251ce4-d004-4879-ac8e-8d254a7e4a81 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:47.115938 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60251ce4-d004-4879-ac8e-8d254a7e4a81 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:47.221650 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 441/885] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Jun 22 10:03:46 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 10:03:47.227123 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a473c119-163b-44c2-9982-ab4343b6837d None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:47.317889 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3b9564-7dba-47c2-8d93-05c690cb1d50 None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:47.318505 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3b9564-7dba-47c2-8d93-05c690cb1d50 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:47.318982 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3b9564-7dba-47c2-8d93-05c690cb1d50 None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:47.324342 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 442/886] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:03:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:03:47.326244 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72fc925-4caa-42fe-a520-079ceb78fe08 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:47.326752 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72fc925-4caa-42fe-a520-079ceb78fe08 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:47.327033 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:47.327430 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72fc925-4caa-42fe-a520-079ceb78fe08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:47.334573 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a473c119-163b-44c2-9982-ab4343b6837d None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:47.344908 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-f72fc925-4caa-42fe-a520-079ceb78fe08 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:03:47.346346 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-f72fc925-4caa-42fe-a520-079ceb78fe08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:03:47.386794 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6ff387-8726-4e53-befb-07bb9fba18d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:47.387949 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6ff387-8726-4e53-befb-07bb9fba18d6 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:47.388451 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6ff387-8726-4e53-befb-07bb9fba18d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:47.388924 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6ff387-8726-4e53-befb-07bb9fba18d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:47.400240 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6ff387-8726-4e53-befb-07bb9fba18d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:47.402058 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6ff387-8726-4e53-befb-07bb9fba18d6 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:47.415239 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:47.422399 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-1f6ff387-8726-4e53-befb-07bb9fba18d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:03:47.422399 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:47.422399 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:47.422399 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:47.422399 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:47.422399 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:47.422399 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:47.422399 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:47.422399 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:47.422399 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:47.422399 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:47.422399 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:47.422399 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:03:47.422399 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:03:47.422399 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:03:47.424440 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:03:47.424440 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:47.424440 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:47.424440 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:47.424440 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:47.424440 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:47.424440 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:47.424440 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:47.424440 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:47.424440 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:47.424440 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:47.424440 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:47.424440 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:47.424440 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:47.424440 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:47.424440 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:47.424440 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:47.427292 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:03:47.427292 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:03:47.427292 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:03:47.427292 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:03:47.427292 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 445/887] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jun 22 10:03:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:03:47.427292 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8df37a-5019-490b-bf28-ae950ce3ade4 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:47.427292 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8df37a-5019-490b-bf28-ae950ce3ade4 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:47.427292 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8df37a-5019-490b-bf28-ae950ce3ade4 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:47.428788 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 446/888] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:03:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:03:47.430472 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8df37a-5019-490b-bf28-ae950ce3ade4 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:47.436975 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 443/889] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:03:47 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 10:03:47.436975 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aaba10-a85a-424b-be32-c7e550eb5145 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:47.436975 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aaba10-a85a-424b-be32-c7e550eb5145 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:47.436975 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aaba10-a85a-424b-be32-c7e550eb5145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:47.453281 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-12aaba10-a85a-424b-be32-c7e550eb5145 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:03:47.454500 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-12aaba10-a85a-424b-be32-c7e550eb5145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:03:47.532177 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 444/890] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:03:47 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 10:03:47.533015 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12aaba10-a85a-424b-be32-c7e550eb5145 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:47.558242 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8df37a-5019-490b-bf28-ae950ce3ade4 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:47.595603 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a9768b-f41b-4194-8f3d-10994d9dfcf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:47.596191 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a9768b-f41b-4194-8f3d-10994d9dfcf4 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:47.596657 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a9768b-f41b-4194-8f3d-10994d9dfcf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:47.596942 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a9768b-f41b-4194-8f3d-10994d9dfcf4 None admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:47.597673 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a9768b-f41b-4194-8f3d-10994d9dfcf4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:47.598130 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a9768b-f41b-4194-8f3d-10994d9dfcf4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:47.599445 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a9768b-f41b-4194-8f3d-10994d9dfcf4 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:47.616892 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 447/891] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Jun 22 10:03:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:47.616892 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a9768b-f41b-4194-8f3d-10994d9dfcf4 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:47.626442 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:47.651511 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12aaba10-a85a-424b-be32-c7e550eb5145 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:47.675690 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:47.689063 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b66c9e7-095f-4782-9c85-2b2a34ae02ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:47.689887 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b66c9e7-095f-4782-9c85-2b2a34ae02ed None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:47.690166 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b66c9e7-095f-4782-9c85-2b2a34ae02ed None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:47.690459 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b66c9e7-095f-4782-9c85-2b2a34ae02ed None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:47.691109 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b66c9e7-095f-4782-9c85-2b2a34ae02ed None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:47.692656 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b66c9e7-095f-4782-9c85-2b2a34ae02ed None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:47.704530 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-8b66c9e7-095f-4782-9c85-2b2a34ae02ed None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 22 10:03:47.704530 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:47.704530 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 10:03:47.704530 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 10:03:47.704530 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 10:03:47.704530 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 10:03:47.704530 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 10:03:47.704530 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 10:03:47.704530 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 22 10:03:47.704530 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:03:47.704530 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 10:03:47.704530 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:03:47.704530 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:47.704530 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:47.704530 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:47.704530 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:47.704530 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:47.705521 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:47.705521 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:47.705521 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:47.705521 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:47.705521 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:47.705521 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:47.705521 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 10:03:47.705521 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 10:03:47.705521 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 10:03:47.705521 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 10:03:47.705521 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:47.705521 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:47.705521 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:47.705521 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:47.705521 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:47.705521 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:47.706726 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:47.706726 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:47.706726 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:47.706726 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:47.706726 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:47.706726 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:47.706726 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:47.706726 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:47.706726 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:47.706726 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:47.706726 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 10:03:47.706726 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 10:03:47.706726 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 22 10:03:47.706726 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:03:47.706726 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 445/892] 10.222.0.43 () {56 vars in 1114 bytes} [Wed Jun 22 10:03:47 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:03:47.708178 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b66c9e7-095f-4782-9c85-2b2a34ae02ed None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:47.737154 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a9768b-f41b-4194-8f3d-10994d9dfcf4 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:47.773647 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ce55aa-8cac-49c1-bb4e-5599e9f6c33b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:47.774482 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ce55aa-8cac-49c1-bb4e-5599e9f6c33b None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:47.774770 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ce55aa-8cac-49c1-bb4e-5599e9f6c33b None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:47.775049 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ce55aa-8cac-49c1-bb4e-5599e9f6c33b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:47.775700 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ce55aa-8cac-49c1-bb4e-5599e9f6c33b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:47.777080 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ce55aa-8cac-49c1-bb4e-5599e9f6c33b None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:47.789616 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-55ce55aa-8cac-49c1-bb4e-5599e9f6c33b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 22 10:03:47.789616 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:47.789616 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 10:03:47.789616 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 10:03:47.789616 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 10:03:47.789616 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 10:03:47.789616 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 10:03:47.789616 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 10:03:47.789616 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 22 10:03:47.789616 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:03:47.789616 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 10:03:47.789616 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:03:47.789616 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:47.789616 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:47.789616 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:47.789616 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:47.789616 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:47.790645 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:47.790645 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:47.790645 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:47.790645 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:47.790645 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:47.790645 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:47.790645 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 10:03:47.790645 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 10:03:47.790645 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 10:03:47.790645 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 10:03:47.790645 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:47.790645 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:47.790645 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:47.790645 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:47.790645 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:47.790645 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:47.791482 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:47.791482 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:47.791482 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:47.791482 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:47.791482 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:47.791482 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:47.791482 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:47.791482 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:47.791482 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:47.791482 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:47.791482 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 10:03:47.791482 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 10:03:47.791482 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 22 10:03:47.791482 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:03:47.791482 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 448/893] 10.222.0.43 () {56 vars in 1126 bytes} [Wed Jun 22 10:03:47 2022] GET /identity/v3/services/object-store => generated 93 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:03:47.792288 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ce55aa-8cac-49c1-bb4e-5599e9f6c33b None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:47.829556 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b66c9e7-095f-4782-9c85-2b2a34ae02ed None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:47.874398 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac078ec-6742-4552-9cc8-e88461f9cb3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:47.875120 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac078ec-6742-4552-9cc8-e88461f9cb3a None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:47.875405 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac078ec-6742-4552-9cc8-e88461f9cb3a None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:47.875682 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac078ec-6742-4552-9cc8-e88461f9cb3a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:47.876694 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:47.885245 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac078ec-6742-4552-9cc8-e88461f9cb3a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:47.886801 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac078ec-6742-4552-9cc8-e88461f9cb3a None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:47.902860 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-3ac078ec-6742-4552-9cc8-e88461f9cb3a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:03:47.902860 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:47.902860 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:47.902860 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:47.902860 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:47.902860 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:47.902860 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:47.902860 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:47.902860 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:47.902860 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:47.902860 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:47.902860 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:47.902860 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 10:03:47.902860 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 10:03:47.902860 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 10:03:47.903894 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 10:03:47.903894 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:47.903894 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:47.903894 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:47.903894 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:47.903894 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:47.903894 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:47.903894 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:47.903894 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:47.903894 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:47.903894 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:47.903894 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:47.903894 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:47.903894 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:47.903894 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:47.903894 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:47.903894 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:47.904843 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 10:03:47.904843 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 10:03:47.904843 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 10:03:47.904843 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 10:03:47.904843 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 10:03:47.904843 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 10:03:47.904843 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:03:47.904843 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:03:47.904843 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 446/894] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Jun 22 10:03:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:03:47.905365 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac078ec-6742-4552-9cc8-e88461f9cb3a None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:47.917865 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ce55aa-8cac-49c1-bb4e-5599e9f6c33b None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:47.956135 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aeedd5-9a3d-4b47-b2c3-3d6c5326a22b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:47.956953 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aeedd5-9a3d-4b47-b2c3-3d6c5326a22b None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:47.957309 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aeedd5-9a3d-4b47-b2c3-3d6c5326a22b None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:47.958016 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aeedd5-9a3d-4b47-b2c3-3d6c5326a22b None admin] PATH_INFO: `/v3/services` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:47.958456 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:47.958833 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41aeedd5-9a3d-4b47-b2c3-3d6c5326a22b None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:47.959144 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41aeedd5-9a3d-4b47-b2c3-3d6c5326a22b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:47.960950 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41aeedd5-9a3d-4b47-b2c3-3d6c5326a22b None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:47.966706 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 449/895] 10.222.0.43 () {56 vars in 1114 bytes} [Wed Jun 22 10:03:47 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:47.967769 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aeedd5-9a3d-4b47-b2c3-3d6c5326a22b None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:48.023386 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac078ec-6742-4552-9cc8-e88461f9cb3a None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:48.061223 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10172d6f-1c0c-4324-87b0-05c1ebf00369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:48.061927 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10172d6f-1c0c-4324-87b0-05c1ebf00369 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:48.062219 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10172d6f-1c0c-4324-87b0-05c1ebf00369 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:48.062915 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10172d6f-1c0c-4324-87b0-05c1ebf00369 None admin] PATH_INFO: `/v3/services` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:48.063718 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10172d6f-1c0c-4324-87b0-05c1ebf00369 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:48.063965 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10172d6f-1c0c-4324-87b0-05c1ebf00369 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:48.065307 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10172d6f-1c0c-4324-87b0-05c1ebf00369 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:48.071241 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 447/896] 10.222.0.43 () {56 vars in 1122 bytes} [Wed Jun 22 10:03:47 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:48.072091 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10172d6f-1c0c-4324-87b0-05c1ebf00369 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:48.079532 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aeedd5-9a3d-4b47-b2c3-3d6c5326a22b None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:48.120511 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06c1407-16d1-455c-9550-b9df10b8dd09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:48.121266 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06c1407-16d1-455c-9550-b9df10b8dd09 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:48.121613 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06c1407-16d1-455c-9550-b9df10b8dd09 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:48.122009 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06c1407-16d1-455c-9550-b9df10b8dd09 None admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:48.122870 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06c1407-16d1-455c-9550-b9df10b8dd09 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:48.123244 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06c1407-16d1-455c-9550-b9df10b8dd09 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:48.124794 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06c1407-16d1-455c-9550-b9df10b8dd09 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:48.126552 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:48.139501 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 450/897] 10.222.0.43 () {56 vars in 1148 bytes} [Wed Jun 22 10:03:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:48.144946 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06c1407-16d1-455c-9550-b9df10b8dd09 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:48.187447 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10172d6f-1c0c-4324-87b0-05c1ebf00369 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:48.200273 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:48.227050 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616c23ab-feaf-43da-9255-744edc31e728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:48.228034 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616c23ab-feaf-43da-9255-744edc31e728 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:48.228484 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616c23ab-feaf-43da-9255-744edc31e728 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:48.228753 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616c23ab-feaf-43da-9255-744edc31e728 None admin] PATH_INFO: `/v3/services` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:48.229470 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616c23ab-feaf-43da-9255-744edc31e728 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:48.229832 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616c23ab-feaf-43da-9255-744edc31e728 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:48.231190 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616c23ab-feaf-43da-9255-744edc31e728 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:48.241227 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 448/898] 10.222.0.43 () {56 vars in 1114 bytes} [Wed Jun 22 10:03:48 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:48.241227 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616c23ab-feaf-43da-9255-744edc31e728 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:48.255170 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06c1407-16d1-455c-9550-b9df10b8dd09 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:48.291279 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e882762-7b18-4412-b5a4-9a87527594c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:48.291950 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e882762-7b18-4412-b5a4-9a87527594c7 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:48.292241 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e882762-7b18-4412-b5a4-9a87527594c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:48.292524 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e882762-7b18-4412-b5a4-9a87527594c7 None admin] PATH_INFO: `/v3/services` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:48.293240 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e882762-7b18-4412-b5a4-9a87527594c7 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:48.293550 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e882762-7b18-4412-b5a4-9a87527594c7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:48.294961 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e882762-7b18-4412-b5a4-9a87527594c7 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:48.309740 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 451/899] 10.222.0.43 () {56 vars in 1122 bytes} [Wed Jun 22 10:03:48 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:48.309740 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e882762-7b18-4412-b5a4-9a87527594c7 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:48.375948 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616c23ab-feaf-43da-9255-744edc31e728 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:48.388189 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:48.417830 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944d1465-d1e1-46b8-806c-28ecd36566c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:48.418598 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944d1465-d1e1-46b8-806c-28ecd36566c3 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:48.418957 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944d1465-d1e1-46b8-806c-28ecd36566c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:48.419304 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944d1465-d1e1-46b8-806c-28ecd36566c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:48.420226 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944d1465-d1e1-46b8-806c-28ecd36566c3 None admin] RBAC: Adding query filter params (role.id=23300d26129048399321250a40367eb7, scope.project.id=e03f1c17e0884f188231d2949dc6f956, user.id=317e7e7dd5c741d49d34a1fd949a7c07) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:48.420612 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944d1465-d1e1-46b8-806c-28ecd36566c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:48.422215 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944d1465-d1e1-46b8-806c-28ecd36566c3 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:48.438152 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 449/900] 10.222.0.43 () {56 vars in 1374 bytes} [Wed Jun 22 10:03:48 2022] GET /identity/v3/role_assignments?user.id=317e7e7dd5c741d49d34a1fd949a7c07&scope.project.id=e03f1c17e0884f188231d2949dc6f956&role.id=23300d26129048399321250a40367eb7 => generated 259 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:48.438428 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e882762-7b18-4412-b5a4-9a87527594c7 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:48.483553 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085627d7-f6a9-4c04-9863-1565922c9fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:48.484636 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085627d7-f6a9-4c04-9863-1565922c9fbc None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:48.484928 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085627d7-f6a9-4c04-9863-1565922c9fbc None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:48.485212 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085627d7-f6a9-4c04-9863-1565922c9fbc None admin] PATH_INFO: `/v3/endpoints` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:48.486088 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085627d7-f6a9-4c04-9863-1565922c9fbc None admin] RBAC: Adding query filter params (interface=public, service_id=49844ebf3a984a4b8667487fe6b9fa6e, region_id=RegionOne) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:48.486412 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085627d7-f6a9-4c04-9863-1565922c9fbc None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:48.487858 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085627d7-f6a9-4c04-9863-1565922c9fbc None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:48.502377 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 452/901] 10.222.0.43 () {56 vars in 1251 bytes} [Wed Jun 22 10:03:48 2022] GET /identity/v3/endpoints?service_id=49844ebf3a984a4b8667487fe6b9fa6e&interface=public®ion_id=RegionOne => generated 194 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:48.503417 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944d1465-d1e1-46b8-806c-28ecd36566c3 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:48.557675 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:48.630352 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944d1465-d1e1-46b8-806c-28ecd36566c3 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:48.666465 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce8f766-e1bd-4c0a-8c59-304b27046c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:48.667137 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce8f766-e1bd-4c0a-8c59-304b27046c7c None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:48.667540 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce8f766-e1bd-4c0a-8c59-304b27046c7c None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:48.667826 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce8f766-e1bd-4c0a-8c59-304b27046c7c None admin] PATH_INFO: `/v3/services` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:48.668518 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce8f766-e1bd-4c0a-8c59-304b27046c7c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:48.669939 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce8f766-e1bd-4c0a-8c59-304b27046c7c None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:48.677352 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 450/902] 10.222.0.43 () {56 vars in 1087 bytes} [Wed Jun 22 10:03:48 2022] GET /identity/v3/services => generated 1268 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:03:48.838145 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471a94a3-c333-4106-a8fd-9358d6c1a040 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:48.838691 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471a94a3-c333-4106-a8fd-9358d6c1a040 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:48.838691 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471a94a3-c333-4106-a8fd-9358d6c1a040 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:48.840084 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 453/903] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:03:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:03:48.845500 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ad5f72-5492-4bb9-9970-6dd95f2b814f None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:48.845830 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ad5f72-5492-4bb9-9970-6dd95f2b814f None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:48.846113 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ad5f72-5492-4bb9-9970-6dd95f2b814f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:48.865069 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-f9ad5f72-5492-4bb9-9970-6dd95f2b814f None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:03:48.866299 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-f9ad5f72-5492-4bb9-9970-6dd95f2b814f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:03:48.951848 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 451/904] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:03:48 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 10:03:48.976798 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471a94a3-c333-4106-a8fd-9358d6c1a040 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:49.096592 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471a94a3-c333-4106-a8fd-9358d6c1a040 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:49.123688 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:49.137428 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcb439e-8a52-40ed-adbf-8d50f8baeb37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:49.138275 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcb439e-8a52-40ed-adbf-8d50f8baeb37 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:49.138563 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcb439e-8a52-40ed-adbf-8d50f8baeb37 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:49.138845 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcb439e-8a52-40ed-adbf-8d50f8baeb37 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:49.139599 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcb439e-8a52-40ed-adbf-8d50f8baeb37 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:49.140976 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcb439e-8a52-40ed-adbf-8d50f8baeb37 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:49.153791 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-9fcb439e-8a52-40ed-adbf-8d50f8baeb37 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 22 10:03:49.153791 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:49.153791 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 10:03:49.153791 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 10:03:49.153791 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 10:03:49.153791 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 10:03:49.153791 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 10:03:49.153791 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 10:03:49.153791 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 22 10:03:49.153791 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:03:49.153791 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 10:03:49.153791 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:03:49.153791 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:49.153791 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:49.153791 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:49.153791 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:49.154791 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:49.154791 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:49.154791 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:49.154791 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:49.154791 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:49.154791 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:49.154791 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:49.154791 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 10:03:49.154791 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 10:03:49.154791 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 10:03:49.154791 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 10:03:49.154791 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:49.154791 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:49.154791 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:49.154791 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:49.154791 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:49.156067 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:49.156067 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:49.156067 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:49.156067 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:49.156067 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:49.156067 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:49.156067 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:49.156067 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:49.156067 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:49.156067 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:49.156067 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:49.156067 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 10:03:49.156067 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 10:03:49.156067 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 22 10:03:49.156067 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:03:49.156067 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 454/905] 10.222.0.43 () {56 vars in 1132 bytes} [Wed Jun 22 10:03:48 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:03:49.161333 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ad5f72-5492-4bb9-9970-6dd95f2b814f None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:49.197440 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:49.275757 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ad5f72-5492-4bb9-9970-6dd95f2b814f None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:49.312904 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cc6d7b-c6f1-4dce-9711-93236514d9d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:49.313583 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cc6d7b-c6f1-4dce-9711-93236514d9d7 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:49.313901 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cc6d7b-c6f1-4dce-9711-93236514d9d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:49.314185 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cc6d7b-c6f1-4dce-9711-93236514d9d7 None admin] PATH_INFO: `/v3/services` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:49.314902 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cc6d7b-c6f1-4dce-9711-93236514d9d7 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:49.315213 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cc6d7b-c6f1-4dce-9711-93236514d9d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:49.316658 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cc6d7b-c6f1-4dce-9711-93236514d9d7 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:49.321945 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 452/906] 10.222.0.43 () {56 vars in 1126 bytes} [Wed Jun 22 10:03:49 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:49.327316 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcb439e-8a52-40ed-adbf-8d50f8baeb37 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:49.435749 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcb439e-8a52-40ed-adbf-8d50f8baeb37 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:49.473643 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223b31b2-cd46-4c87-87f0-ea2f1d6c4331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:49.474712 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223b31b2-cd46-4c87-87f0-ea2f1d6c4331 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:49.475217 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223b31b2-cd46-4c87-87f0-ea2f1d6c4331 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:49.475718 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223b31b2-cd46-4c87-87f0-ea2f1d6c4331 None admin] PATH_INFO: `/v3/services` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:49.476882 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223b31b2-cd46-4c87-87f0-ea2f1d6c4331 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:49.477391 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223b31b2-cd46-4c87-87f0-ea2f1d6c4331 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:49.479015 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223b31b2-cd46-4c87-87f0-ea2f1d6c4331 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:49.484954 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 455/907] 10.222.0.43 () {56 vars in 1126 bytes} [Wed Jun 22 10:03:49 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:49.495109 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cc6d7b-c6f1-4dce-9711-93236514d9d7 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:49.601772 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:49.608514 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cc6d7b-c6f1-4dce-9711-93236514d9d7 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:49.646351 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806d83c7-c2bd-4179-a4d8-8347ffa79fa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:49.647017 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806d83c7-c2bd-4179-a4d8-8347ffa79fa6 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:49.647303 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806d83c7-c2bd-4179-a4d8-8347ffa79fa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:49.647642 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806d83c7-c2bd-4179-a4d8-8347ffa79fa6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:49.648438 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806d83c7-c2bd-4179-a4d8-8347ffa79fa6 None admin] RBAC: Adding query filter params (interface=public, service_id=e1e4bdad8e714fb09644514f5d0ca4b9, region_id=RegionOne) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:49.648753 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806d83c7-c2bd-4179-a4d8-8347ffa79fa6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:49.650174 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806d83c7-c2bd-4179-a4d8-8347ffa79fa6 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:49.655605 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 453/908] 10.222.0.43 () {56 vars in 1251 bytes} [Wed Jun 22 10:03:49 2022] GET /identity/v3/endpoints?service_id=e1e4bdad8e714fb09644514f5d0ca4b9&interface=public®ion_id=RegionOne => generated 194 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:49.661840 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223b31b2-cd46-4c87-87f0-ea2f1d6c4331 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:49.714788 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:49.766798 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223b31b2-cd46-4c87-87f0-ea2f1d6c4331 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:49.802178 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b92403b-9e65-4a87-9cb1-e7c57102122c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:49.802853 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b92403b-9e65-4a87-9cb1-e7c57102122c None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:49.803134 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b92403b-9e65-4a87-9cb1-e7c57102122c None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:49.803481 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b92403b-9e65-4a87-9cb1-e7c57102122c None admin] PATH_INFO: `/v3/services` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:49.804172 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b92403b-9e65-4a87-9cb1-e7c57102122c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:49.805549 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b92403b-9e65-4a87-9cb1-e7c57102122c None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:49.811710 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 456/909] 10.222.0.43 () {56 vars in 1087 bytes} [Wed Jun 22 10:03:49 2022] GET /identity/v3/services => generated 1268 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:03:50.500578 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b29499-41e0-428b-97b8-5f7e32745c08 None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:50.501133 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b29499-41e0-428b-97b8-5f7e32745c08 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:50.501133 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b29499-41e0-428b-97b8-5f7e32745c08 None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:50.502678 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 454/910] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:03:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:03:50.508444 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16017af-25ef-4317-b8c0-ea6404ad4100 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:50.509357 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16017af-25ef-4317-b8c0-ea6404ad4100 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:50.509916 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16017af-25ef-4317-b8c0-ea6404ad4100 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:50.531153 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-d16017af-25ef-4317-b8c0-ea6404ad4100 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:03:50.532688 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-d16017af-25ef-4317-b8c0-ea6404ad4100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:03:50.595304 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ca07e4-82ae-4ace-98fd-3391541a295d None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:50.595644 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ca07e4-82ae-4ace-98fd-3391541a295d None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:50.595868 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ca07e4-82ae-4ace-98fd-3391541a295d None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:50.597492 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 455/911] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:03:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:03:50.603797 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7595bb2-2292-4999-bc71-ef6e022ed462 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:50.604082 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7595bb2-2292-4999-bc71-ef6e022ed462 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:50.604364 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7595bb2-2292-4999-bc71-ef6e022ed462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:50.613955 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 457/912] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:03:50 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 10:03:50.621985 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-f7595bb2-2292-4999-bc71-ef6e022ed462 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:03:50.623178 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-f7595bb2-2292-4999-bc71-ef6e022ed462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:03:50.631640 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16017af-25ef-4317-b8c0-ea6404ad4100 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:50.680109 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:50.705915 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 456/913] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:03:50 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 10:03:50.726933 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7595bb2-2292-4999-bc71-ef6e022ed462 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:50.738730 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16017af-25ef-4317-b8c0-ea6404ad4100 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:50.779384 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c05589-9334-43bc-a980-751c53486790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:50.779771 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c05589-9334-43bc-a980-751c53486790 None admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:50.780061 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c05589-9334-43bc-a980-751c53486790 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:50.780339 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c05589-9334-43bc-a980-751c53486790 None admin] PATH_INFO: `/v3/services` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:50.781071 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c05589-9334-43bc-a980-751c53486790 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:50.782473 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c05589-9334-43bc-a980-751c53486790 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:50.799858 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 458/914] 10.222.0.43 () {60 vars in 1141 bytes} [Wed Jun 22 10:03:50 2022] POST /identity/v3/services => generated 241 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:03:50.849674 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:50.861282 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7595bb2-2292-4999-bc71-ef6e022ed462 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:50.910021 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2c8db5-9506-449c-9cd2-a58defb47bbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:50.912144 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c8db5-9506-449c-9cd2-a58defb47bbd None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:50.912431 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c8db5-9506-449c-9cd2-a58defb47bbd None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:50.912713 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c8db5-9506-449c-9cd2-a58defb47bbd None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:50.925165 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2c8db5-9506-449c-9cd2-a58defb47bbd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:03:50.934378 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-dc2c8db5-9506-449c-9cd2-a58defb47bbd None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 22 10:03:50.934378 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:50.934378 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:50.934378 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:50.934378 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:50.934378 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:50.934378 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:50.934378 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:50.934378 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:50.934378 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:50.934378 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:50.934378 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:50.934378 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:03:50.934378 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:03:50.934378 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:03:50.934378 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:03:50.935431 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:03:50.935431 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:03:50.935431 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:03:50.935431 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:03:50.935431 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:50.935431 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:50.935431 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:50.935431 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:50.935431 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:50.935431 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:50.935431 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:50.935431 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:50.935431 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:50.935431 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:50.935431 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:50.935431 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:50.936261 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:50.936261 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:50.936261 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:50.936261 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:50.936261 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:03:50.936261 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:03:50.936261 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:03:50.936261 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:03:50.936261 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:03:50.936261 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:03:50.936261 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 22 10:03:50.936261 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:03:50.936261 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 457/915] 10.222.0.43 () {56 vars in 1120 bytes} [Wed Jun 22 10:03:50 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:03:50.942973 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c05589-9334-43bc-a980-751c53486790 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:50.946554 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df1b17c-0cbb-4095-9ffd-c61882cf6d51 None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:50.946847 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df1b17c-0cbb-4095-9ffd-c61882cf6d51 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:50.947182 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df1b17c-0cbb-4095-9ffd-c61882cf6d51 None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:50.948671 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 458/916] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:03:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 10:03:50.953787 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2479e1a9-9364-4177-a890-b225f206605a None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:50.954082 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2479e1a9-9364-4177-a890-b225f206605a None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:50.954366 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2479e1a9-9364-4177-a890-b225f206605a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:50.971972 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-2479e1a9-9364-4177-a890-b225f206605a None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:03:50.974349 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-2479e1a9-9364-4177-a890-b225f206605a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:03:51.062862 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 459/917] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:03:50 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 10:03:51.077259 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c05589-9334-43bc-a980-751c53486790 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:51.084879 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:51.086094 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2479e1a9-9364-4177-a890-b225f206605a None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:51.134741 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811d8ec4-db6b-46e5-b050-ec5aaa11cd21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:51.135581 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811d8ec4-db6b-46e5-b050-ec5aaa11cd21 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:51.135964 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811d8ec4-db6b-46e5-b050-ec5aaa11cd21 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:51.136422 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811d8ec4-db6b-46e5-b050-ec5aaa11cd21 None admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:51.137553 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811d8ec4-db6b-46e5-b050-ec5aaa11cd21 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:51.138847 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811d8ec4-db6b-46e5-b050-ec5aaa11cd21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:51.140398 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811d8ec4-db6b-46e5-b050-ec5aaa11cd21 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:51.153995 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 459/918] 10.222.0.43 () {56 vars in 1115 bytes} [Wed Jun 22 10:03:50 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:51.157053 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811d8ec4-db6b-46e5-b050-ec5aaa11cd21 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:51.196996 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:51.229328 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2479e1a9-9364-4177-a890-b225f206605a None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:51.268040 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa8ef93-ccef-4fc9-951a-58b72f4d54b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:51.269188 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa8ef93-ccef-4fc9-951a-58b72f4d54b0 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:51.270268 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa8ef93-ccef-4fc9-951a-58b72f4d54b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:51.270909 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa8ef93-ccef-4fc9-951a-58b72f4d54b0 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:51.271809 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa8ef93-ccef-4fc9-951a-58b72f4d54b0 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:51.273532 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa8ef93-ccef-4fc9-951a-58b72f4d54b0 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:51.276552 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811d8ec4-db6b-46e5-b050-ec5aaa11cd21 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:51.289945 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-caa8ef93-ccef-4fc9-951a-58b72f4d54b0 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 22 10:03:51.289945 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:51.289945 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 10:03:51.289945 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 10:03:51.289945 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 10:03:51.289945 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 10:03:51.289945 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 10:03:51.289945 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 10:03:51.289945 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 22 10:03:51.289945 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:03:51.289945 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 10:03:51.289945 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:03:51.289945 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:51.289945 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:51.289945 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:51.289945 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:51.289945 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:51.290981 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:51.290981 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:51.290981 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:51.290981 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:51.290981 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:51.290981 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:51.290981 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 10:03:51.290981 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 10:03:51.290981 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 10:03:51.290981 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 10:03:51.290981 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:51.290981 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:51.290981 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:51.290981 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:51.290981 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:51.290981 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:51.291787 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:51.291787 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:51.291787 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:51.291787 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:51.291787 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:51.291787 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:51.291787 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:51.291787 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:51.291787 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:51.291787 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:51.291787 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 10:03:51.291787 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 10:03:51.291787 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 22 10:03:51.291787 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:03:51.299315 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 460/919] 10.222.0.43 () {56 vars in 1114 bytes} [Wed Jun 22 10:03:51 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:03:51.300374 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa8ef93-ccef-4fc9-951a-58b72f4d54b0 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:51.321272 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ab2a81-ee01-4ade-b86b-6cf26e9b6c84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:51.322056 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ab2a81-ee01-4ade-b86b-6cf26e9b6c84 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:51.322346 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ab2a81-ee01-4ade-b86b-6cf26e9b6c84 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:51.322682 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ab2a81-ee01-4ade-b86b-6cf26e9b6c84 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:51.334887 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ab2a81-ee01-4ade-b86b-6cf26e9b6c84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:51.336346 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ab2a81-ee01-4ade-b86b-6cf26e9b6c84 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:51.357130 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-66ab2a81-ee01-4ade-b86b-6cf26e9b6c84 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:03:51.357130 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:51.357130 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:51.357130 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:51.357130 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:51.357130 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:51.357130 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:51.357130 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:51.357130 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:51.357130 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:51.357130 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:51.357130 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:51.357130 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:03:51.357130 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:03:51.357130 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:03:51.358108 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:03:51.358108 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:51.358108 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:51.358108 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:51.358108 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:51.358108 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:51.358108 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:51.358108 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:51.358108 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:51.358108 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:51.358108 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:51.358108 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:51.358108 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:51.358108 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:51.358108 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:51.358108 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:51.358108 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:51.358985 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:03:51.358985 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:03:51.358985 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:03:51.358985 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:03:51.363075 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 460/920] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jun 22 10:03:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:03:51.364505 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ab2a81-ee01-4ade-b86b-6cf26e9b6c84 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:51.385023 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:51.435986 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa8ef93-ccef-4fc9-951a-58b72f4d54b0 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:51.475612 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ab2a81-ee01-4ade-b86b-6cf26e9b6c84 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:51.482216 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d4c87d-49e3-43d9-a21a-831ea0a725d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:51.483618 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d4c87d-49e3-43d9-a21a-831ea0a725d4 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:51.484107 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d4c87d-49e3-43d9-a21a-831ea0a725d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:51.484584 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d4c87d-49e3-43d9-a21a-831ea0a725d4 None admin] PATH_INFO: `/v3/services` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:51.485987 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d4c87d-49e3-43d9-a21a-831ea0a725d4 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:51.486908 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d4c87d-49e3-43d9-a21a-831ea0a725d4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:51.489300 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d4c87d-49e3-43d9-a21a-831ea0a725d4 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:51.500874 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 461/921] 10.222.0.43 () {56 vars in 1114 bytes} [Wed Jun 22 10:03:51 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:51.501772 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d4c87d-49e3-43d9-a21a-831ea0a725d4 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:51.507980 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:51.518844 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede89f71-1b56-4639-a6d9-aca761f2802b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:51.520028 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede89f71-1b56-4639-a6d9-aca761f2802b None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:51.520329 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede89f71-1b56-4639-a6d9-aca761f2802b None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:51.520614 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede89f71-1b56-4639-a6d9-aca761f2802b None admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:51.521487 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede89f71-1b56-4639-a6d9-aca761f2802b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:51.521737 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede89f71-1b56-4639-a6d9-aca761f2802b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:51.523182 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede89f71-1b56-4639-a6d9-aca761f2802b None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:51.541217 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 461/922] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Jun 22 10:03:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:51.542567 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede89f71-1b56-4639-a6d9-aca761f2802b None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:51.633989 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d4c87d-49e3-43d9-a21a-831ea0a725d4 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:51.637621 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:51.660961 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede89f71-1b56-4639-a6d9-aca761f2802b None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:51.673336 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054872e2-b6bc-4e1b-92cd-5a50d59e7387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:51.674042 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054872e2-b6bc-4e1b-92cd-5a50d59e7387 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:51.674329 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054872e2-b6bc-4e1b-92cd-5a50d59e7387 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:51.674610 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054872e2-b6bc-4e1b-92cd-5a50d59e7387 None admin] PATH_INFO: `/v3/services` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:51.675323 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054872e2-b6bc-4e1b-92cd-5a50d59e7387 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:51.675634 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054872e2-b6bc-4e1b-92cd-5a50d59e7387 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:51.677453 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054872e2-b6bc-4e1b-92cd-5a50d59e7387 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:51.687217 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 462/923] 10.222.0.43 () {56 vars in 1114 bytes} [Wed Jun 22 10:03:51 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:51.688119 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054872e2-b6bc-4e1b-92cd-5a50d59e7387 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:51.706655 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34db97d7-7d10-48d2-9a7b-69e8a7d855df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:51.707598 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34db97d7-7d10-48d2-9a7b-69e8a7d855df None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:51.707890 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34db97d7-7d10-48d2-9a7b-69e8a7d855df None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:51.708168 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34db97d7-7d10-48d2-9a7b-69e8a7d855df None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:51.717456 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34db97d7-7d10-48d2-9a7b-69e8a7d855df None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:51.719801 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34db97d7-7d10-48d2-9a7b-69e8a7d855df None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:51.741375 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-34db97d7-7d10-48d2-9a7b-69e8a7d855df None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 22 10:03:51.741375 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:51.741375 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:51.741375 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:51.741375 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:51.741375 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:51.741375 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:51.741375 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:51.741375 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:51.741375 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:51.741375 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:51.741375 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:51.741375 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 10:03:51.741375 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 10:03:51.741375 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 10:03:51.741375 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 10:03:51.742410 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:51.742410 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:51.742410 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 10:03:51.742410 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:03:51.742410 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 10:03:51.742410 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:03:51.742410 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:51.742410 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:51.742410 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:51.742410 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:51.742410 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:51.742410 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:51.742410 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:51.742410 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:51.742410 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:51.742410 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:51.742410 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:51.742410 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:51.743337 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:51.743337 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:51.743337 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 10:03:51.743337 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 10:03:51.743337 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 10:03:51.743337 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 10:03:51.743337 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 10:03:51.743337 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 10:03:51.743337 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 22 10:03:51.743337 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:03:51.745760 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 462/924] 10.222.0.43 () {56 vars in 1117 bytes} [Wed Jun 22 10:03:51 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:03:51.749023 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34db97d7-7d10-48d2-9a7b-69e8a7d855df None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:51.777607 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:51.824608 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054872e2-b6bc-4e1b-92cd-5a50d59e7387 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:51.863109 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95e157d-4ebc-48dd-8757-0f0d36ae7251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:51.864333 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95e157d-4ebc-48dd-8757-0f0d36ae7251 None admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:51.864945 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95e157d-4ebc-48dd-8757-0f0d36ae7251 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:51.865431 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95e157d-4ebc-48dd-8757-0f0d36ae7251 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:51.866426 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95e157d-4ebc-48dd-8757-0f0d36ae7251 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:51.868264 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95e157d-4ebc-48dd-8757-0f0d36ae7251 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:51.873613 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34db97d7-7d10-48d2-9a7b-69e8a7d855df None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:51.891584 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 463/925] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Jun 22 10:03:51 2022] POST /identity/v3/endpoints => generated 346 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:03:51.932929 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8907f62e-b22c-4e0f-88ad-3cbdc7315335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:51.934072 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8907f62e-b22c-4e0f-88ad-3cbdc7315335 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:51.934605 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8907f62e-b22c-4e0f-88ad-3cbdc7315335 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:51.935093 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8907f62e-b22c-4e0f-88ad-3cbdc7315335 None admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:51.936191 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8907f62e-b22c-4e0f-88ad-3cbdc7315335 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:51.936763 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8907f62e-b22c-4e0f-88ad-3cbdc7315335 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:51.938461 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8907f62e-b22c-4e0f-88ad-3cbdc7315335 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:51.940636 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:51.965645 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 463/926] 10.222.0.43 () {56 vars in 1149 bytes} [Wed Jun 22 10:03:51 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:51.967713 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8907f62e-b22c-4e0f-88ad-3cbdc7315335 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:51.968366 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b6327a-4c82-4b63-9f94-f012850427ad None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:51.968731 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b6327a-4c82-4b63-9f94-f012850427ad None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:51.969109 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b6327a-4c82-4b63-9f94-f012850427ad None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:51.970937 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 464/927] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:03:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:03:51.978091 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4a6d11-04bc-4556-9731-7cb795be6878 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:51.978091 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4a6d11-04bc-4556-9731-7cb795be6878 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:51.978389 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4a6d11-04bc-4556-9731-7cb795be6878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:51.997230 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-2f4a6d11-04bc-4556-9731-7cb795be6878 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:03:51.998526 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-2f4a6d11-04bc-4556-9731-7cb795be6878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:03:52.083150 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 465/928] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:03:51 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 10:03:52.103208 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4a6d11-04bc-4556-9731-7cb795be6878 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:52.125039 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8907f62e-b22c-4e0f-88ad-3cbdc7315335 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:52.166761 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:52.171179 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647f3354-d842-4f2e-be53-53c23bee79b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:52.172016 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647f3354-d842-4f2e-be53-53c23bee79b0 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:52.172750 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647f3354-d842-4f2e-be53-53c23bee79b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:52.172861 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647f3354-d842-4f2e-be53-53c23bee79b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:52.192993 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647f3354-d842-4f2e-be53-53c23bee79b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:52.194539 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647f3354-d842-4f2e-be53-53c23bee79b0 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:52.214226 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-647f3354-d842-4f2e-be53-53c23bee79b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:03:52.214226 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:52.214226 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:52.214226 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:52.214226 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:52.214226 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:52.214226 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:52.214226 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:52.214226 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:52.214226 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:52.214226 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:52.214226 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:52.214226 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:03:52.214226 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:03:52.214226 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:03:52.215172 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:03:52.215172 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:52.215172 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:52.215172 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:52.215172 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:52.215172 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:52.215172 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:52.215172 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:52.215172 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:52.215172 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:52.215172 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:52.215172 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:52.215172 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:52.215172 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:52.215172 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:52.215172 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:52.215172 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:52.216054 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:03:52.216054 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:03:52.216054 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:03:52.216054 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:03:52.220103 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 464/929] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jun 22 10:03:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:03:52.221284 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647f3354-d842-4f2e-be53-53c23bee79b0 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:52.242957 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4a6d11-04bc-4556-9731-7cb795be6878 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:52.273144 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:52.284401 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bff626-7a40-4cf6-99c8-b1008e321a50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:52.285554 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bff626-7a40-4cf6-99c8-b1008e321a50 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:52.286076 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bff626-7a40-4cf6-99c8-b1008e321a50 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:52.286525 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bff626-7a40-4cf6-99c8-b1008e321a50 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:52.288437 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bff626-7a40-4cf6-99c8-b1008e321a50 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:52.290044 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bff626-7a40-4cf6-99c8-b1008e321a50 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:52.303667 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-21bff626-7a40-4cf6-99c8-b1008e321a50 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 22 10:03:52.303667 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:52.303667 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 10:03:52.303667 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 10:03:52.303667 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 10:03:52.303667 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 10:03:52.303667 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 10:03:52.303667 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 10:03:52.303667 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 22 10:03:52.303667 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:03:52.303667 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 10:03:52.303667 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:03:52.303667 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:52.303667 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:52.303667 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:52.303667 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:52.304639 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:52.304639 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:52.304639 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:52.304639 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:52.304639 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:52.304639 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:52.304639 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:52.304639 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 10:03:52.304639 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 10:03:52.304639 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 10:03:52.304639 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 10:03:52.304639 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:52.304639 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:52.304639 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:52.304639 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:52.304639 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:52.305445 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:52.305445 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:52.305445 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:52.305445 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:52.305445 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:52.305445 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:52.305445 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:52.305445 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:52.305445 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:52.305445 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:52.305445 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:52.305445 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 10:03:52.305445 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 10:03:52.305445 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 22 10:03:52.305445 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:03:52.308563 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 466/930] 10.222.0.43 () {56 vars in 1132 bytes} [Wed Jun 22 10:03:52 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 10:03:52.314466 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bff626-7a40-4cf6-99c8-b1008e321a50 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:52.333105 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647f3354-d842-4f2e-be53-53c23bee79b0 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:52.374158 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588348b5-835d-49d9-8bde-fdf4666c6134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:52.374836 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588348b5-835d-49d9-8bde-fdf4666c6134 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:52.375128 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588348b5-835d-49d9-8bde-fdf4666c6134 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:52.375411 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588348b5-835d-49d9-8bde-fdf4666c6134 None admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:52.376215 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588348b5-835d-49d9-8bde-fdf4666c6134 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:52.376787 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588348b5-835d-49d9-8bde-fdf4666c6134 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:52.377996 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588348b5-835d-49d9-8bde-fdf4666c6134 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:52.396007 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 465/931] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Jun 22 10:03:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:03:52.396965 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588348b5-835d-49d9-8bde-fdf4666c6134 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:52.429457 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bff626-7a40-4cf6-99c8-b1008e321a50 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:52.448640 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:52.468687 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9384eb-9154-46d2-ad5d-d6a0ecc4cbf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:52.469637 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9384eb-9154-46d2-ad5d-d6a0ecc4cbf3 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:52.470088 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9384eb-9154-46d2-ad5d-d6a0ecc4cbf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:52.470505 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9384eb-9154-46d2-ad5d-d6a0ecc4cbf3 None admin] PATH_INFO: `/v3/services` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:52.471474 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9384eb-9154-46d2-ad5d-d6a0ecc4cbf3 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:52.472019 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9384eb-9154-46d2-ad5d-d6a0ecc4cbf3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:52.474242 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9384eb-9154-46d2-ad5d-d6a0ecc4cbf3 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:52.484805 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 467/932] 10.222.0.43 () {56 vars in 1126 bytes} [Wed Jun 22 10:03:52 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:52.486037 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9384eb-9154-46d2-ad5d-d6a0ecc4cbf3 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:52.505827 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588348b5-835d-49d9-8bde-fdf4666c6134 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:52.508507 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:52.543361 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573249c3-d690-4237-a11e-46afd7dd303d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:52.544169 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573249c3-d690-4237-a11e-46afd7dd303d None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:52.544706 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573249c3-d690-4237-a11e-46afd7dd303d None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:52.544869 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573249c3-d690-4237-a11e-46afd7dd303d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:52.552717 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573249c3-d690-4237-a11e-46afd7dd303d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:52.554228 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573249c3-d690-4237-a11e-46afd7dd303d None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:52.569621 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-573249c3-d690-4237-a11e-46afd7dd303d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:03:52.569621 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:52.569621 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:52.569621 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:52.569621 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:52.569621 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:52.569621 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:52.569621 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:52.569621 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:52.569621 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:52.569621 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:52.569621 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:52.569621 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 10:03:52.569621 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 10:03:52.569621 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 10:03:52.570736 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 10:03:52.570736 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:52.570736 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:52.570736 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:52.570736 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:52.570736 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:52.570736 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:52.570736 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:52.570736 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:52.570736 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:52.570736 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:52.570736 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:52.570736 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:52.570736 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:52.570736 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:52.570736 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:52.570736 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:52.571834 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 10:03:52.571834 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 10:03:52.571834 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 10:03:52.571834 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 10:03:52.571834 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 10:03:52.571834 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 10:03:52.571834 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:03:52.571834 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:03:52.575676 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 466/933] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Jun 22 10:03:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:03:52.577052 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573249c3-d690-4237-a11e-46afd7dd303d None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:52.604427 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9384eb-9154-46d2-ad5d-d6a0ecc4cbf3 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:52.642154 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef35297f-ef53-4a43-aa2e-90a5a69c3848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:52.643096 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef35297f-ef53-4a43-aa2e-90a5a69c3848 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:52.643633 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef35297f-ef53-4a43-aa2e-90a5a69c3848 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:52.644062 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef35297f-ef53-4a43-aa2e-90a5a69c3848 None admin] PATH_INFO: `/v3/services` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:52.645258 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef35297f-ef53-4a43-aa2e-90a5a69c3848 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:52.645802 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef35297f-ef53-4a43-aa2e-90a5a69c3848 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:52.647534 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef35297f-ef53-4a43-aa2e-90a5a69c3848 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:52.657683 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 468/934] 10.222.0.43 () {56 vars in 1126 bytes} [Wed Jun 22 10:03:52 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:52.658879 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef35297f-ef53-4a43-aa2e-90a5a69c3848 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:52.689739 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573249c3-d690-4237-a11e-46afd7dd303d None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:52.712098 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:52.727485 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb57f609-29d8-45ce-b246-7ec4a3697bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:52.728164 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb57f609-29d8-45ce-b246-7ec4a3697bdf None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:52.728515 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb57f609-29d8-45ce-b246-7ec4a3697bdf None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:52.728802 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb57f609-29d8-45ce-b246-7ec4a3697bdf None admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:52.729607 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb57f609-29d8-45ce-b246-7ec4a3697bdf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:52.729956 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb57f609-29d8-45ce-b246-7ec4a3697bdf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:52.731411 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb57f609-29d8-45ce-b246-7ec4a3697bdf None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:52.751734 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 467/935] 10.222.0.43 () {56 vars in 1148 bytes} [Wed Jun 22 10:03:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:52.753171 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb57f609-29d8-45ce-b246-7ec4a3697bdf None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:52.777391 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef35297f-ef53-4a43-aa2e-90a5a69c3848 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:52.791304 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:52.824596 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d05313-cae2-4c5b-b9c2-2b1c17fcc44c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:52.825614 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d05313-cae2-4c5b-b9c2-2b1c17fcc44c None admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:52.826114 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d05313-cae2-4c5b-b9c2-2b1c17fcc44c None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:52.826536 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d05313-cae2-4c5b-b9c2-2b1c17fcc44c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:52.827427 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d05313-cae2-4c5b-b9c2-2b1c17fcc44c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:52.829181 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d05313-cae2-4c5b-b9c2-2b1c17fcc44c None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:52.861890 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 469/936] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Jun 22 10:03:52 2022] POST /identity/v3/endpoints => generated 347 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:03:52.878676 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb57f609-29d8-45ce-b246-7ec4a3697bdf None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:52.925752 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36d568c-aca3-45bc-9e3f-c07cc65341f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:52.927239 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36d568c-aca3-45bc-9e3f-c07cc65341f8 None admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:52.927589 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36d568c-aca3-45bc-9e3f-c07cc65341f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:52.927877 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36d568c-aca3-45bc-9e3f-c07cc65341f8 None admin] PATH_INFO: `/v3/projects/e03f1c17e0884f188231d2949dc6f956/users/317e7e7dd5c741d49d34a1fd949a7c07/roles/23300d26129048399321250a40367eb7` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:52.930345 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36d568c-aca3-45bc-9e3f-c07cc65341f8 None admin] RBAC: Authorizing `identity:create_grant(project_id=e03f1c17e0884f188231d2949dc6f956, user_id=317e7e7dd5c741d49d34a1fd949a7c07, role_id=23300d26129048399321250a40367eb7)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:52.931829 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36d568c-aca3-45bc-9e3f-c07cc65341f8 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:52.953978 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 468/937] 10.222.0.43 () {58 vars in 1439 bytes} [Wed Jun 22 10:03:52 2022] PUT /identity/v3/projects/e03f1c17e0884f188231d2949dc6f956/users/317e7e7dd5c741d49d34a1fd949a7c07/roles/23300d26129048399321250a40367eb7 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:03:53.003900 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ceaf6e-860f-40e3-837e-cfb209777acb None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:53.004760 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ceaf6e-860f-40e3-837e-cfb209777acb None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:53.005226 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ceaf6e-860f-40e3-837e-cfb209777acb None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:53.007285 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 470/938] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:03:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:03:53.015765 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed61f057-8022-4297-8203-8b7a4d77edc3 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:53.016461 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed61f057-8022-4297-8203-8b7a4d77edc3 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:53.016941 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed61f057-8022-4297-8203-8b7a4d77edc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:53.037215 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-ed61f057-8022-4297-8203-8b7a4d77edc3 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:03:53.038620 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-ed61f057-8022-4297-8203-8b7a4d77edc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:03:53.119051 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 469/939] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:03:53 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 10:03:53.143225 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ceaf6e-860f-40e3-837e-cfb209777acb None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:53.262074 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ceaf6e-860f-40e3-837e-cfb209777acb None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:53.263582 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:53.300831 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0def3c-7e97-4169-b39a-4ec7aaf39f83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:53.302119 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0def3c-7e97-4169-b39a-4ec7aaf39f83 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:53.302602 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0def3c-7e97-4169-b39a-4ec7aaf39f83 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:53.303118 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0def3c-7e97-4169-b39a-4ec7aaf39f83 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:53.303782 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0def3c-7e97-4169-b39a-4ec7aaf39f83 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:53.305216 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0def3c-7e97-4169-b39a-4ec7aaf39f83 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:53.319909 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-ee0def3c-7e97-4169-b39a-4ec7aaf39f83 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 22 10:03:53.319909 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:53.319909 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 10:03:53.319909 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 10:03:53.319909 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 10:03:53.319909 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 10:03:53.319909 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 10:03:53.319909 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 10:03:53.319909 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 22 10:03:53.319909 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:03:53.319909 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 10:03:53.319909 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:03:53.319909 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:53.319909 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:53.319909 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:53.319909 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:53.319909 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:53.320948 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:53.320948 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:53.320948 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:53.320948 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:53.320948 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:53.320948 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:53.320948 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 10:03:53.320948 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 10:03:53.320948 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 10:03:53.320948 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 10:03:53.320948 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:53.320948 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:53.320948 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:53.320948 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:53.320948 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:53.320948 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:53.321830 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:53.321830 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:53.321830 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:53.321830 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:53.321830 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:53.321830 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:53.321830 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:53.321830 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:53.321830 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:53.321830 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:53.321830 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 10:03:53.321830 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 10:03:53.321830 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 22 10:03:53.321830 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:03:53.321830 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 471/940] 10.222.0.43 () {56 vars in 1126 bytes} [Wed Jun 22 10:03:53 2022] GET /identity/v3/services/object-store => generated 93 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:03:53.327341 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed61f057-8022-4297-8203-8b7a4d77edc3 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:53.340622 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:53.440181 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed61f057-8022-4297-8203-8b7a4d77edc3 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:53.478019 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927e9630-0187-44ea-b844-6d8f46c00fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:53.479104 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927e9630-0187-44ea-b844-6d8f46c00fb7 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:53.479610 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927e9630-0187-44ea-b844-6d8f46c00fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:53.480096 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927e9630-0187-44ea-b844-6d8f46c00fb7 None admin] PATH_INFO: `/v3/services` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:53.481030 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927e9630-0187-44ea-b844-6d8f46c00fb7 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:53.481560 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927e9630-0187-44ea-b844-6d8f46c00fb7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:53.483201 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927e9630-0187-44ea-b844-6d8f46c00fb7 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:53.490815 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 470/941] 10.222.0.43 () {56 vars in 1122 bytes} [Wed Jun 22 10:03:53 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:53.498916 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0def3c-7e97-4169-b39a-4ec7aaf39f83 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:53.614711 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0def3c-7e97-4169-b39a-4ec7aaf39f83 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:53.649960 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afd3a13-53a8-4364-b8ee-95798e304823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:53.650633 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afd3a13-53a8-4364-b8ee-95798e304823 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:53.650916 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afd3a13-53a8-4364-b8ee-95798e304823 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:53.651190 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afd3a13-53a8-4364-b8ee-95798e304823 None admin] PATH_INFO: `/v3/services` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:53.651901 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afd3a13-53a8-4364-b8ee-95798e304823 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:53.652207 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afd3a13-53a8-4364-b8ee-95798e304823 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:53.653583 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afd3a13-53a8-4364-b8ee-95798e304823 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:53.659127 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 472/942] 10.222.0.43 () {56 vars in 1122 bytes} [Wed Jun 22 10:03:53 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:53.666846 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927e9630-0187-44ea-b844-6d8f46c00fb7 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:53.757306 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:53.784117 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927e9630-0187-44ea-b844-6d8f46c00fb7 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:53.822386 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acc16da-232f-4f2b-850e-607eaa948bfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:53.823057 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acc16da-232f-4f2b-850e-607eaa948bfc None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:53.823346 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acc16da-232f-4f2b-850e-607eaa948bfc None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:53.823631 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acc16da-232f-4f2b-850e-607eaa948bfc None admin] PATH_INFO: `/v3/endpoints` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:53.824432 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acc16da-232f-4f2b-850e-607eaa948bfc None admin] RBAC: Adding query filter params (interface=public, service_id=9db69f4b463f45a79295817b63029fc0, region_id=RegionOne) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:53.824747 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acc16da-232f-4f2b-850e-607eaa948bfc None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:53.826163 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acc16da-232f-4f2b-850e-607eaa948bfc None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:53.831945 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 471/943] 10.222.0.43 () {56 vars in 1251 bytes} [Wed Jun 22 10:03:53 2022] GET /identity/v3/endpoints?service_id=9db69f4b463f45a79295817b63029fc0&interface=public®ion_id=RegionOne => generated 194 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:53.837986 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afd3a13-53a8-4364-b8ee-95798e304823 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:53.874185 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:53.945656 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afd3a13-53a8-4364-b8ee-95798e304823 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:53.980451 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a066ab-d01d-41b6-9e3e-27bf5c608fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:53.981163 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a066ab-d01d-41b6-9e3e-27bf5c608fb7 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:53.981451 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a066ab-d01d-41b6-9e3e-27bf5c608fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:53.981748 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a066ab-d01d-41b6-9e3e-27bf5c608fb7 None admin] PATH_INFO: `/v3/services` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:53.982481 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a066ab-d01d-41b6-9e3e-27bf5c608fb7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:53.983862 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a066ab-d01d-41b6-9e3e-27bf5c608fb7 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:53.990876 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 473/944] 10.222.0.43 () {56 vars in 1087 bytes} [Wed Jun 22 10:03:53 2022] GET /identity/v3/services => generated 1497 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:03:54.235716 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4765544f-58d5-4246-af72-943c2f84236b None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:54.236005 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4765544f-58d5-4246-af72-943c2f84236b None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:54.236287 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4765544f-58d5-4246-af72-943c2f84236b None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:54.237915 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 472/945] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:03:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:03:54.243889 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38040d55-bed8-4c13-8456-44d2425321b2 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:54.244178 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38040d55-bed8-4c13-8456-44d2425321b2 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:54.244464 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38040d55-bed8-4c13-8456-44d2425321b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:54.261428 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-38040d55-bed8-4c13-8456-44d2425321b2 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:03:54.262632 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-38040d55-bed8-4c13-8456-44d2425321b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:03:54.331301 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 474/946] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:03:54 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 10:03:54.354940 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4765544f-58d5-4246-af72-943c2f84236b None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:54.516647 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4765544f-58d5-4246-af72-943c2f84236b None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:54.576750 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0452e248-dd56-426d-9c03-3a390b7f8567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:54.577967 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0452e248-dd56-426d-9c03-3a390b7f8567 None admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:54.578470 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0452e248-dd56-426d-9c03-3a390b7f8567 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:54.578978 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0452e248-dd56-426d-9c03-3a390b7f8567 None admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:54.580308 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0452e248-dd56-426d-9c03-3a390b7f8567 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:54.583566 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0452e248-dd56-426d-9c03-3a390b7f8567 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:54.586049 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: WARNING keystone.server.flask.common [None req-0452e248-dd56-426d-9c03-3a390b7f8567 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 22 10:03:54.601021 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:54.619236 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.sql.core [None req-0452e248-dd56-426d-9c03-3a390b7f8567 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 22 10:03:54.619236 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 22 10:03:54.619236 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [parameters: {'id': 'bd22524ab2344c38bb61faf25fea88be', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 22 10:03:54.619236 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80377) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 22 10:03:54.653919 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-0452e248-dd56-426d-9c03-3a390b7f8567 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id bd22524ab2344c38bb61faf25fea88be.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id bd22524ab2344c38bb61faf25fea88be. Jun 22 10:03:54.653919 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:54.653919 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 22 10:03:54.653919 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 22 10:03:54.653919 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 22 10:03:54.653919 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 22 10:03:54.653919 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 22 10:03:54.653919 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application result = self._query(query) Jun 22 10:03:54.653919 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 22 10:03:54.653919 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application conn.query(q) Jun 22 10:03:54.653919 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 22 10:03:54.653919 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 22 10:03:54.653919 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 22 10:03:54.655813 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application result.read() Jun 22 10:03:54.655813 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 22 10:03:54.655813 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 22 10:03:54.655813 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 22 10:03:54.655813 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 22 10:03:54.655813 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 22 10:03:54.655813 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 22 10:03:54.655813 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 22 10:03:54.655813 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 22 10:03:54.655813 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 22 10:03:54.655813 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:03:54.655813 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 22 10:03:54.655813 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:03:54.655813 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:54.655813 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 22 10:03:54.655813 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 22 10:03:54.655813 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jun 22 10:03:54.655813 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return project_ref.to_dict() Jun 22 10:03:54.658135 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 22 10:03:54.658135 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application next(self.gen) Jun 22 10:03:54.658135 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 22 10:03:54.658135 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application yield resource Jun 22 10:03:54.658135 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 22 10:03:54.658135 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application next(self.gen) Jun 22 10:03:54.658135 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 22 10:03:54.658135 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application self.session.rollback() Jun 22 10:03:54.658135 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 22 10:03:54.658135 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application self.force_reraise() Jun 22 10:03:54.658135 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 22 10:03:54.658135 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise self.value Jun 22 10:03:54.658135 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 22 10:03:54.658135 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 22 10:03:54.658135 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 22 10:03:54.658135 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application session.commit() Jun 22 10:03:54.658135 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 22 10:03:54.660781 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 22 10:03:54.660781 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 22 10:03:54.660781 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application self._prepare_impl() Jun 22 10:03:54.660781 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 22 10:03:54.660781 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application self.session.flush() Jun 22 10:03:54.660781 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 22 10:03:54.660781 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application self._flush(objects) Jun 22 10:03:54.660781 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 22 10:03:54.660781 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 22 10:03:54.660781 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 22 10:03:54.660781 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application compat.raise_( Jun 22 10:03:54.660781 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 22 10:03:54.660781 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception Jun 22 10:03:54.660781 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 22 10:03:54.660781 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application flush_context.execute() Jun 22 10:03:54.660781 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 22 10:03:54.660781 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rec.execute(self) Jun 22 10:03:54.662937 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 22 10:03:54.662937 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 22 10:03:54.662937 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 22 10:03:54.662937 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 22 10:03:54.662937 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 22 10:03:54.662937 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 22 10:03:54.662937 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 22 10:03:54.662937 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 22 10:03:54.662937 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 22 10:03:54.662937 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 22 10:03:54.662937 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 22 10:03:54.662937 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 22 10:03:54.662937 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 22 10:03:54.662937 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 22 10:03:54.662937 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 22 10:03:54.670978 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 22 10:03:54.670978 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 22 10:03:54.670978 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception Jun 22 10:03:54.670978 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 22 10:03:54.670978 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 22 10:03:54.670978 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 22 10:03:54.670978 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 22 10:03:54.670978 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 22 10:03:54.670978 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application result = self._query(query) Jun 22 10:03:54.670978 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 22 10:03:54.670978 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application conn.query(q) Jun 22 10:03:54.670978 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 22 10:03:54.670978 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 22 10:03:54.670978 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 22 10:03:54.670978 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application result.read() Jun 22 10:03:54.670978 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 22 10:03:54.670978 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 22 10:03:54.673061 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 22 10:03:54.673061 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 22 10:03:54.673061 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 22 10:03:54.673061 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 22 10:03:54.673061 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 22 10:03:54.673061 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 22 10:03:54.673061 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 22 10:03:54.673061 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 22 10:03:54.673061 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [parameters: {'id': 'bd22524ab2344c38bb61faf25fea88be', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 22 10:03:54.673061 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 22 10:03:54.673061 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:03:54.673061 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 10:03:54.673061 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:03:54.673061 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:54.673061 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jun 22 10:03:54.674982 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jun 22 10:03:54.674982 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 22 10:03:54.674982 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 22 10:03:54.674982 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jun 22 10:03:54.674982 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:03:54.674982 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 10:03:54.674982 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:03:54.674982 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:54.674982 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:54.674982 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:54.674982 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:54.674982 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:54.674982 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:54.674982 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:54.674982 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:54.674982 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:54.674982 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:54.677200 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:54.677200 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jun 22 10:03:54.677200 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jun 22 10:03:54.677200 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:54.677200 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:54.677200 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jun 22 10:03:54.677200 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.Conflict( Jun 22 10:03:54.677200 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id bd22524ab2344c38bb61faf25fea88be. Jun 22 10:03:54.677200 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:03:54.677200 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 473/947] 10.222.0.43 () {60 vars in 1140 bytes} [Wed Jun 22 10:03:54 2022] POST /identity/v3/projects => generated 262 bytes in 302 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:03:54.678515 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38040d55-bed8-4c13-8456-44d2425321b2 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:54.702761 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:54.790898 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38040d55-bed8-4c13-8456-44d2425321b2 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:54.833546 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfbb840-df15-4dcf-a9a7-5a01ef5a8610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:54.834393 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfbb840-df15-4dcf-a9a7-5a01ef5a8610 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:54.834680 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfbb840-df15-4dcf-a9a7-5a01ef5a8610 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:54.834956 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfbb840-df15-4dcf-a9a7-5a01ef5a8610 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:54.842492 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfbb840-df15-4dcf-a9a7-5a01ef5a8610 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:54.843951 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfbb840-df15-4dcf-a9a7-5a01ef5a8610 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:54.859284 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-8dfbb840-df15-4dcf-a9a7-5a01ef5a8610 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:03:54.859284 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:54.859284 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:54.859284 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:54.859284 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:54.859284 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:54.859284 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:54.859284 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:54.859284 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:54.859284 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:54.859284 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:54.859284 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:54.859284 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 10:03:54.859284 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 10:03:54.859284 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 10:03:54.861352 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 10:03:54.861352 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:54.861352 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:54.861352 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:54.861352 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:54.861352 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:54.861352 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:54.861352 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:54.861352 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:54.861352 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:54.861352 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:54.861352 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:54.861352 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:54.861352 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:54.861352 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:54.861352 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:54.861352 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:54.864127 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 10:03:54.864127 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 10:03:54.864127 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 10:03:54.864127 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 10:03:54.864127 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 10:03:54.864127 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 10:03:54.864127 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:03:54.864127 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:03:54.864127 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 475/948] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Jun 22 10:03:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 10:03:54.868017 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0452e248-dd56-426d-9c03-3a390b7f8567 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:54.981138 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0452e248-dd56-426d-9c03-3a390b7f8567 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:55.015661 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e18fb6-2203-48bb-b9b7-7f38720c592f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:55.016382 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e18fb6-2203-48bb-b9b7-7f38720c592f None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:55.016671 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e18fb6-2203-48bb-b9b7-7f38720c592f None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:55.016953 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e18fb6-2203-48bb-b9b7-7f38720c592f None admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:55.017764 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e18fb6-2203-48bb-b9b7-7f38720c592f None admin] RBAC: Adding query filter params (name=service) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:55.018083 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e18fb6-2203-48bb-b9b7-7f38720c592f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:55.020438 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e18fb6-2203-48bb-b9b7-7f38720c592f None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:55.043575 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 474/949] 10.222.0.43 () {56 vars in 1112 bytes} [Wed Jun 22 10:03:54 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:55.182588 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce68a904-bace-412c-93b9-353c2800129a None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:55.183045 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce68a904-bace-412c-93b9-353c2800129a None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:55.183478 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce68a904-bace-412c-93b9-353c2800129a None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:55.185385 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 476/950] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:03:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:03:55.191372 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7807605c-2363-449f-b8e2-03da618b75e2 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:55.192358 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7807605c-2363-449f-b8e2-03da618b75e2 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:55.192739 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7807605c-2363-449f-b8e2-03da618b75e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:55.211722 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-7807605c-2363-449f-b8e2-03da618b75e2 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:03:55.213592 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-7807605c-2363-449f-b8e2-03da618b75e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:03:55.213795 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083b289d-3087-44cf-b0e8-6da6004ac516 None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:55.213977 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083b289d-3087-44cf-b0e8-6da6004ac516 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:55.214234 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083b289d-3087-44cf-b0e8-6da6004ac516 None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:55.215883 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 477/951] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:03:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:03:55.220975 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e84eef9-1905-4bc0-b701-4342594614b6 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:55.221268 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e84eef9-1905-4bc0-b701-4342594614b6 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:55.221547 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e84eef9-1905-4bc0-b701-4342594614b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:55.243704 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-5e84eef9-1905-4bc0-b701-4342594614b6 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:03:55.244886 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-5e84eef9-1905-4bc0-b701-4342594614b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:03:55.275265 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:55.299135 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 475/952] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:03:55 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 10:03:55.322556 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7807605c-2363-449f-b8e2-03da618b75e2 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:55.333622 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 478/953] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:03:55 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 10:03:55.357775 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e84eef9-1905-4bc0-b701-4342594614b6 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:55.377946 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:55.441174 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7807605c-2363-449f-b8e2-03da618b75e2 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:55.479926 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2f54ee-770a-49ff-82d9-37cb8f278eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:55.481010 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2f54ee-770a-49ff-82d9-37cb8f278eac None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:55.481455 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2f54ee-770a-49ff-82d9-37cb8f278eac None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:55.481949 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2f54ee-770a-49ff-82d9-37cb8f278eac None admin] PATH_INFO: `/v3/services/compute` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:55.482771 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2f54ee-770a-49ff-82d9-37cb8f278eac None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:55.484311 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2f54ee-770a-49ff-82d9-37cb8f278eac None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:55.494833 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e84eef9-1905-4bc0-b701-4342594614b6 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:55.497853 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-da2f54ee-770a-49ff-82d9-37cb8f278eac None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 22 10:03:55.497853 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:55.497853 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 10:03:55.497853 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 10:03:55.497853 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 10:03:55.497853 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 10:03:55.497853 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 10:03:55.497853 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 10:03:55.497853 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 22 10:03:55.497853 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:03:55.497853 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 10:03:55.497853 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:03:55.497853 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:55.497853 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:55.497853 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:55.497853 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:55.497853 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:55.498845 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:55.498845 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:55.498845 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:55.498845 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:55.498845 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:55.498845 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:55.498845 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 10:03:55.498845 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 10:03:55.498845 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 10:03:55.498845 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 10:03:55.498845 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:55.498845 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:55.498845 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:55.498845 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:55.498845 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:55.498845 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:55.499885 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:55.499885 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:55.499885 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:55.499885 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:55.499885 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:55.499885 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:55.499885 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:55.499885 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:55.499885 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:55.499885 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:55.499885 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 10:03:55.499885 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 10:03:55.499885 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 22 10:03:55.499885 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:03:55.502421 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 476/954] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Jun 22 10:03:55 2022] GET /identity/v3/services/compute => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 10:03:55.508820 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2f54ee-770a-49ff-82d9-37cb8f278eac None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:55.540265 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983bad24-102c-419b-a164-46842ae26f05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:55.540737 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983bad24-102c-419b-a164-46842ae26f05 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:55.541024 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983bad24-102c-419b-a164-46842ae26f05 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:55.541304 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983bad24-102c-419b-a164-46842ae26f05 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:55.552933 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983bad24-102c-419b-a164-46842ae26f05 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:03:55.561256 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-983bad24-102c-419b-a164-46842ae26f05 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 22 10:03:55.561256 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:55.561256 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:55.561256 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:55.561256 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:55.561256 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:55.561256 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:55.561256 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:55.561256 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:55.561256 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:55.561256 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:55.561256 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:55.561256 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:03:55.561256 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:03:55.561256 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:03:55.561256 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:03:55.562257 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:03:55.562257 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:03:55.562257 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:03:55.562257 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:03:55.562257 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:55.562257 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:55.562257 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:55.562257 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:55.562257 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:55.562257 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:55.562257 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:55.562257 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:55.562257 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:55.562257 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:55.562257 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:55.562257 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:55.563125 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:55.563125 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:55.563125 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:55.563125 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:55.563125 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:03:55.563125 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:03:55.563125 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:03:55.563125 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:03:55.563125 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:03:55.563125 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:03:55.563125 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 22 10:03:55.563125 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:03:55.568098 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 479/955] 10.222.0.43 () {56 vars in 1120 bytes} [Wed Jun 22 10:03:55 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:03:55.569118 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983bad24-102c-419b-a164-46842ae26f05 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:55.577966 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:55.654228 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2f54ee-770a-49ff-82d9-37cb8f278eac None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:55.658398 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:55.689626 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983bad24-102c-419b-a164-46842ae26f05 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:55.702967 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aa7a52-999c-4ab1-a176-82ed411143e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:55.704863 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aa7a52-999c-4ab1-a176-82ed411143e2 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:55.705356 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aa7a52-999c-4ab1-a176-82ed411143e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:55.706135 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aa7a52-999c-4ab1-a176-82ed411143e2 None admin] PATH_INFO: `/v3/services` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:55.707360 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09aa7a52-999c-4ab1-a176-82ed411143e2 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:55.707896 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09aa7a52-999c-4ab1-a176-82ed411143e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:55.709893 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09aa7a52-999c-4ab1-a176-82ed411143e2 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:55.721526 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 477/956] 10.222.0.43 () {56 vars in 1112 bytes} [Wed Jun 22 10:03:55 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:03:55.723777 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aa7a52-999c-4ab1-a176-82ed411143e2 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:55.733073 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660bf938-af27-47da-a6e4-f883401671f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:55.733777 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660bf938-af27-47da-a6e4-f883401671f9 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:55.734069 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660bf938-af27-47da-a6e4-f883401671f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:55.734354 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660bf938-af27-47da-a6e4-f883401671f9 None admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:55.735116 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660bf938-af27-47da-a6e4-f883401671f9 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:55.735427 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660bf938-af27-47da-a6e4-f883401671f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:55.736819 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660bf938-af27-47da-a6e4-f883401671f9 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:55.751582 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 480/957] 10.222.0.43 () {56 vars in 1115 bytes} [Wed Jun 22 10:03:55 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:03:55.752700 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660bf938-af27-47da-a6e4-f883401671f9 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:55.869274 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660bf938-af27-47da-a6e4-f883401671f9 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:55.875848 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aa7a52-999c-4ab1-a176-82ed411143e2 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:55.893828 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:55.907225 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3014f10c-6948-4916-be7a-f0fe98307079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:55.908035 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3014f10c-6948-4916-be7a-f0fe98307079 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:55.908323 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3014f10c-6948-4916-be7a-f0fe98307079 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:55.908611 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3014f10c-6948-4916-be7a-f0fe98307079 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:55.912359 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:55.921722 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3014f10c-6948-4916-be7a-f0fe98307079 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:55.924039 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3014f10c-6948-4916-be7a-f0fe98307079 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:55.930401 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ee643a-aa6f-4a21-83f2-b3fe75e3daf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:55.931357 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ee643a-aa6f-4a21-83f2-b3fe75e3daf5 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:55.931857 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ee643a-aa6f-4a21-83f2-b3fe75e3daf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:55.932343 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ee643a-aa6f-4a21-83f2-b3fe75e3daf5 None admin] PATH_INFO: `/v3/services` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:55.933856 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ee643a-aa6f-4a21-83f2-b3fe75e3daf5 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:55.934946 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ee643a-aa6f-4a21-83f2-b3fe75e3daf5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:55.936884 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ee643a-aa6f-4a21-83f2-b3fe75e3daf5 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:55.948409 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-3014f10c-6948-4916-be7a-f0fe98307079 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:03:55.948409 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:55.948409 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:55.948409 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:55.948409 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:55.948409 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:55.948409 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:55.948409 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:55.948409 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:55.948409 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:55.948409 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:55.948409 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:55.948409 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:03:55.948409 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:03:55.948409 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:03:55.949353 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:03:55.949353 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:55.949353 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:55.949353 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:55.949353 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:55.949353 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:55.949353 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:55.949353 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:55.949353 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:55.949353 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:55.949353 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:55.949353 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:55.949353 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:55.949353 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:55.949353 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:55.949353 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:55.949353 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:55.950338 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:03:55.950338 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:03:55.950338 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:03:55.950338 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:03:55.950338 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 481/958] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jun 22 10:03:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 10:03:55.951194 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 478/959] 10.222.0.43 () {56 vars in 1112 bytes} [Wed Jun 22 10:03:55 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:55.951309 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3014f10c-6948-4916-be7a-f0fe98307079 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:56.069275 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3014f10c-6948-4916-be7a-f0fe98307079 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:56.108383 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd7664c-607f-40a5-b24d-25fbd1e11092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:56.109255 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd7664c-607f-40a5-b24d-25fbd1e11092 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:56.109683 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd7664c-607f-40a5-b24d-25fbd1e11092 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:56.110120 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd7664c-607f-40a5-b24d-25fbd1e11092 None admin] PATH_INFO: `/v3/domains` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:56.110997 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd7664c-607f-40a5-b24d-25fbd1e11092 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:56.111445 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd7664c-607f-40a5-b24d-25fbd1e11092 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:56.113058 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd7664c-607f-40a5-b24d-25fbd1e11092 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:56.127601 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 482/960] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Jun 22 10:03:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:56.132871 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ee643a-aa6f-4a21-83f2-b3fe75e3daf5 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:56.243467 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ee643a-aa6f-4a21-83f2-b3fe75e3daf5 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:56.259626 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d15fb8a-58dd-49bc-9286-802a2e385acf None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:56.259970 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d15fb8a-58dd-49bc-9286-802a2e385acf None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:56.260182 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d15fb8a-58dd-49bc-9286-802a2e385acf None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:56.261664 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 483/961] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:03:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 10:03:56.266925 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550593dd-a82a-4689-b6d5-125173a14cee None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:56.267462 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550593dd-a82a-4689-b6d5-125173a14cee None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:56.267967 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550593dd-a82a-4689-b6d5-125173a14cee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:56.285958 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e241a247-d5a2-4ada-a6de-4bf9a11e5b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:56.286514 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-550593dd-a82a-4689-b6d5-125173a14cee None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:03:56.286775 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e241a247-d5a2-4ada-a6de-4bf9a11e5b69 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:56.287062 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e241a247-d5a2-4ada-a6de-4bf9a11e5b69 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:56.287339 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e241a247-d5a2-4ada-a6de-4bf9a11e5b69 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:56.288610 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-550593dd-a82a-4689-b6d5-125173a14cee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:03:56.296590 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e241a247-d5a2-4ada-a6de-4bf9a11e5b69 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:56.298582 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e241a247-d5a2-4ada-a6de-4bf9a11e5b69 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:56.319603 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-e241a247-d5a2-4ada-a6de-4bf9a11e5b69 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 22 10:03:56.319603 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:56.319603 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:56.319603 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:56.319603 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:56.319603 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:56.319603 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:56.319603 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:56.319603 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:56.319603 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:56.319603 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:56.319603 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:56.319603 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 10:03:56.319603 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 10:03:56.319603 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 10:03:56.319603 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 10:03:56.320640 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:56.320640 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:56.320640 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 10:03:56.320640 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:03:56.320640 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 10:03:56.320640 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:03:56.320640 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:56.320640 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:56.320640 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:56.320640 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:56.320640 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:56.320640 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:56.320640 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:56.320640 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:56.320640 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:56.320640 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:56.320640 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:56.320640 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:56.321610 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:56.321610 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:56.321610 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 10:03:56.321610 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 10:03:56.321610 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 10:03:56.321610 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 10:03:56.321610 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 10:03:56.321610 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 10:03:56.321610 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 22 10:03:56.321610 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:03:56.321610 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 479/962] 10.222.0.43 () {56 vars in 1117 bytes} [Wed Jun 22 10:03:56 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:03:56.327039 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e241a247-d5a2-4ada-a6de-4bf9a11e5b69 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:56.344931 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:56.369131 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:56.377839 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 484/963] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:03:56 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 10:03:56.401220 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550593dd-a82a-4689-b6d5-125173a14cee None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:56.443223 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e241a247-d5a2-4ada-a6de-4bf9a11e5b69 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:56.479532 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd10055d-6403-448d-a659-4650c41c892a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:56.480432 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd10055d-6403-448d-a659-4650c41c892a None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:56.480623 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd10055d-6403-448d-a659-4650c41c892a None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:56.481033 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd10055d-6403-448d-a659-4650c41c892a None admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:56.482033 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd10055d-6403-448d-a659-4650c41c892a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:56.482365 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd10055d-6403-448d-a659-4650c41c892a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:56.483958 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd10055d-6403-448d-a659-4650c41c892a None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:56.506631 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 480/964] 10.222.0.43 () {56 vars in 1149 bytes} [Wed Jun 22 10:03:56 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:56.508695 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd10055d-6403-448d-a659-4650c41c892a None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:56.523539 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550593dd-a82a-4689-b6d5-125173a14cee None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:56.567215 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fd7df4-3f14-469e-a16a-b67245026734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:56.568361 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fd7df4-3f14-469e-a16a-b67245026734 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:56.568658 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fd7df4-3f14-469e-a16a-b67245026734 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:56.568942 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fd7df4-3f14-469e-a16a-b67245026734 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:56.569607 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fd7df4-3f14-469e-a16a-b67245026734 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:56.571218 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fd7df4-3f14-469e-a16a-b67245026734 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:56.590740 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-72fd7df4-3f14-469e-a16a-b67245026734 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 22 10:03:56.590740 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:56.590740 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 10:03:56.590740 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 10:03:56.590740 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 10:03:56.590740 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 10:03:56.590740 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 10:03:56.590740 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 10:03:56.590740 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 22 10:03:56.590740 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:03:56.590740 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 10:03:56.590740 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:03:56.590740 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:56.590740 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:56.590740 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:56.590740 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:56.590740 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:56.591808 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:56.591808 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:56.591808 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:56.591808 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:56.591808 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:56.591808 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:56.591808 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 10:03:56.591808 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 10:03:56.591808 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 10:03:56.591808 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 10:03:56.591808 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:56.591808 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:56.591808 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:56.591808 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:56.591808 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:56.591808 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:56.592648 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:56.592648 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:56.592648 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:56.592648 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:56.592648 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:56.592648 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:56.592648 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:56.592648 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:56.592648 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:56.592648 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:56.592648 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 10:03:56.592648 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 10:03:56.592648 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 22 10:03:56.592648 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:03:56.596812 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 485/965] 10.222.0.43 () {56 vars in 1126 bytes} [Wed Jun 22 10:03:56 2022] GET /identity/v3/services/object-store => generated 93 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 10:03:56.598336 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fd7df4-3f14-469e-a16a-b67245026734 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:56.641962 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:56.644919 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:56.655130 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd10055d-6403-448d-a659-4650c41c892a None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:56.694577 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8933eec-e97d-40f7-a35b-4e1854606fae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:56.694937 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8933eec-e97d-40f7-a35b-4e1854606fae None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:56.695283 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8933eec-e97d-40f7-a35b-4e1854606fae None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:56.695569 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8933eec-e97d-40f7-a35b-4e1854606fae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:56.727828 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fd7df4-3f14-469e-a16a-b67245026734 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:56.771449 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8933eec-e97d-40f7-a35b-4e1854606fae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:56.774515 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8933eec-e97d-40f7-a35b-4e1854606fae None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:56.779601 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb87361-9471-4794-a05b-bd22b41fd105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:56.780860 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb87361-9471-4794-a05b-bd22b41fd105 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:56.781527 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb87361-9471-4794-a05b-bd22b41fd105 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:56.782223 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb87361-9471-4794-a05b-bd22b41fd105 None admin] PATH_INFO: `/v3/services` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:56.783600 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb87361-9471-4794-a05b-bd22b41fd105 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:56.784539 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb87361-9471-4794-a05b-bd22b41fd105 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:56.787832 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb87361-9471-4794-a05b-bd22b41fd105 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:56.794324 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 486/966] 10.222.0.43 () {56 vars in 1122 bytes} [Wed Jun 22 10:03:56 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:56.799885 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb87361-9471-4794-a05b-bd22b41fd105 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:56.892827 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:56.907054 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 481/967] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Jun 22 10:03:56 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 10:03:56.908153 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8933eec-e97d-40f7-a35b-4e1854606fae None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:56.943761 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb87361-9471-4794-a05b-bd22b41fd105 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:56.952443 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:56.990455 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232e7703-1d35-4f8b-86d4-596c370a54a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:56.991282 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232e7703-1d35-4f8b-86d4-596c370a54a3 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:56.992383 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232e7703-1d35-4f8b-86d4-596c370a54a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:56.992383 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232e7703-1d35-4f8b-86d4-596c370a54a3 None admin] PATH_INFO: `/v3/services` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:56.992935 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232e7703-1d35-4f8b-86d4-596c370a54a3 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:56.993344 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232e7703-1d35-4f8b-86d4-596c370a54a3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:56.994886 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232e7703-1d35-4f8b-86d4-596c370a54a3 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:57.005202 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 487/968] 10.222.0.43 () {56 vars in 1122 bytes} [Wed Jun 22 10:03:56 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:57.006211 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232e7703-1d35-4f8b-86d4-596c370a54a3 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:57.029954 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8933eec-e97d-40f7-a35b-4e1854606fae None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:57.077757 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16a33a0-c0b8-42b2-aca5-1b7aade1ccb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:57.079456 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16a33a0-c0b8-42b2-aca5-1b7aade1ccb0 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:57.079908 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16a33a0-c0b8-42b2-aca5-1b7aade1ccb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:57.080628 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16a33a0-c0b8-42b2-aca5-1b7aade1ccb0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:57.102850 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16a33a0-c0b8-42b2-aca5-1b7aade1ccb0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:57.105052 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16a33a0-c0b8-42b2-aca5-1b7aade1ccb0 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:57.122445 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232e7703-1d35-4f8b-86d4-596c370a54a3 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:57.130403 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-f16a33a0-c0b8-42b2-aca5-1b7aade1ccb0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:03:57.130403 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:57.130403 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:57.130403 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:57.130403 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:57.130403 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:57.130403 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:57.130403 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:57.130403 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:57.130403 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:57.130403 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:57.130403 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:57.130403 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:03:57.130403 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:03:57.130403 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:03:57.131553 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:03:57.131553 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:57.131553 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:57.131553 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:57.131553 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:57.131553 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:57.131553 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:57.131553 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:57.131553 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:57.131553 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:57.131553 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:57.131553 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:57.131553 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:57.131553 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:57.131553 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:57.131553 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:57.131553 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:57.132661 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:03:57.132661 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:03:57.132661 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:03:57.132661 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:03:57.140062 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 482/969] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jun 22 10:03:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:03:57.140553 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16a33a0-c0b8-42b2-aca5-1b7aade1ccb0 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:57.170529 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e199044b-a5e0-41bc-b38e-57cf61c818fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:57.171222 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e199044b-a5e0-41bc-b38e-57cf61c818fa None admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:57.171506 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e199044b-a5e0-41bc-b38e-57cf61c818fa None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:57.171783 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e199044b-a5e0-41bc-b38e-57cf61c818fa None admin] PATH_INFO: `/v3/endpoints` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:57.172521 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e199044b-a5e0-41bc-b38e-57cf61c818fa None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:57.173920 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e199044b-a5e0-41bc-b38e-57cf61c818fa None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:57.201415 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 488/970] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Jun 22 10:03:57 2022] POST /identity/v3/endpoints => generated 349 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:03:57.215070 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:57.282065 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16a33a0-c0b8-42b2-aca5-1b7aade1ccb0 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:57.312068 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fae671-da42-4ce3-a47a-dbc1bcff8616 None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:57.312360 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fae671-da42-4ce3-a47a-dbc1bcff8616 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:57.312644 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fae671-da42-4ce3-a47a-dbc1bcff8616 None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:57.314527 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 489/971] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:03:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:03:57.320974 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496ab6c6-cb7c-4498-bb94-a3e7f74648c6 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:57.321282 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496ab6c6-cb7c-4498-bb94-a3e7f74648c6 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:57.321570 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496ab6c6-cb7c-4498-bb94-a3e7f74648c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:57.331053 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2fe80d-06fe-4f82-acc4-531fd11a3b8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:57.332632 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2fe80d-06fe-4f82-acc4-531fd11a3b8a None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:57.333089 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2fe80d-06fe-4f82-acc4-531fd11a3b8a None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:57.333521 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2fe80d-06fe-4f82-acc4-531fd11a3b8a None admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:57.334622 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2fe80d-06fe-4f82-acc4-531fd11a3b8a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:57.334945 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2fe80d-06fe-4f82-acc4-531fd11a3b8a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:57.336348 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2fe80d-06fe-4f82-acc4-531fd11a3b8a None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:57.340639 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-496ab6c6-cb7c-4498-bb94-a3e7f74648c6 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:03:57.342198 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-496ab6c6-cb7c-4498-bb94-a3e7f74648c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:03:57.353733 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 483/972] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Jun 22 10:03:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:03:57.356979 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2fe80d-06fe-4f82-acc4-531fd11a3b8a None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:57.376343 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:57.437045 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 490/973] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:03:57 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 10:03:57.467546 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496ab6c6-cb7c-4498-bb94-a3e7f74648c6 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:57.480907 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2fe80d-06fe-4f82-acc4-531fd11a3b8a None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:57.482727 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:57.526751 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da9266b-a172-4894-8de9-cf940b96e3c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:57.527309 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da9266b-a172-4894-8de9-cf940b96e3c5 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:57.527596 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da9266b-a172-4894-8de9-cf940b96e3c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:57.527927 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da9266b-a172-4894-8de9-cf940b96e3c5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:57.538057 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da9266b-a172-4894-8de9-cf940b96e3c5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:57.539564 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da9266b-a172-4894-8de9-cf940b96e3c5 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:57.555213 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-1da9266b-a172-4894-8de9-cf940b96e3c5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:03:57.555213 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:57.555213 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:57.555213 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:57.555213 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:57.555213 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:57.555213 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:57.555213 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:57.555213 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:57.555213 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:57.555213 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:57.555213 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:57.555213 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 10:03:57.555213 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 10:03:57.555213 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 10:03:57.556128 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 10:03:57.556128 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:57.556128 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:57.556128 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:57.556128 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:57.556128 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:57.556128 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:57.556128 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:57.556128 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:57.556128 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:57.556128 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:57.556128 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:57.556128 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:57.556128 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:57.556128 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:57.556128 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:57.556128 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:57.557022 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 10:03:57.557022 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 10:03:57.557022 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 10:03:57.557022 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 10:03:57.557022 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 10:03:57.557022 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 10:03:57.557022 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:03:57.557022 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:03:57.561452 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 484/974] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Jun 22 10:03:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:03:57.562346 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da9266b-a172-4894-8de9-cf940b96e3c5 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:57.610315 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496ab6c6-cb7c-4498-bb94-a3e7f74648c6 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:57.658867 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f01b5b5-cc66-4546-b3b7-56fab51c81e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:57.661649 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f01b5b5-cc66-4546-b3b7-56fab51c81e6 None admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:57.662514 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f01b5b5-cc66-4546-b3b7-56fab51c81e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:57.662975 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f01b5b5-cc66-4546-b3b7-56fab51c81e6 None admin] PATH_INFO: `/v3/users` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:57.663868 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f01b5b5-cc66-4546-b3b7-56fab51c81e6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:57.666076 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f01b5b5-cc66-4546-b3b7-56fab51c81e6 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:57.668111 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: WARNING keystone.server.flask.common [None req-1f01b5b5-cc66-4546-b3b7-56fab51c81e6 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 22 10:03:57.678247 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da9266b-a172-4894-8de9-cf940b96e3c5 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:57.690325 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.sql.core [None req-1f01b5b5-cc66-4546-b3b7-56fab51c81e6 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 22 10:03:57.690325 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 22 10:03:57.690325 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [parameters: {'user_id': '33f463860ff847c1b07554192e84fefb', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 22 10:03:57.690325 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80378) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 22 10:03:57.698666 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-1f01b5b5-cc66-4546-b3b7-56fab51c81e6 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 22 10:03:57.698666 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:57.698666 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 22 10:03:57.698666 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 22 10:03:57.698666 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 22 10:03:57.698666 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 22 10:03:57.698666 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 22 10:03:57.698666 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application result = self._query(query) Jun 22 10:03:57.698666 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 22 10:03:57.698666 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application conn.query(q) Jun 22 10:03:57.698666 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 22 10:03:57.698666 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 22 10:03:57.698666 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 22 10:03:57.698666 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application result.read() Jun 22 10:03:57.698666 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 22 10:03:57.699550 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 22 10:03:57.699550 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 22 10:03:57.699550 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 22 10:03:57.699550 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 22 10:03:57.699550 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 22 10:03:57.699550 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 22 10:03:57.699550 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 22 10:03:57.699550 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 22 10:03:57.699550 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:03:57.699550 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 22 10:03:57.699550 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:03:57.699550 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:57.699550 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 22 10:03:57.699550 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 22 10:03:57.699550 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jun 22 10:03:57.699550 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jun 22 10:03:57.699550 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 22 10:03:57.699550 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application next(self.gen) Jun 22 10:03:57.700485 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 22 10:03:57.700485 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application yield resource Jun 22 10:03:57.700485 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 22 10:03:57.700485 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application next(self.gen) Jun 22 10:03:57.700485 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 22 10:03:57.700485 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application self.session.rollback() Jun 22 10:03:57.700485 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 22 10:03:57.700485 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application self.force_reraise() Jun 22 10:03:57.700485 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 22 10:03:57.700485 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise self.value Jun 22 10:03:57.700485 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 22 10:03:57.700485 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 22 10:03:57.700485 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 22 10:03:57.700485 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application session.commit() Jun 22 10:03:57.700485 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 22 10:03:57.700485 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 22 10:03:57.700485 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 22 10:03:57.701356 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application self._prepare_impl() Jun 22 10:03:57.701356 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 22 10:03:57.701356 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application self.session.flush() Jun 22 10:03:57.701356 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 22 10:03:57.701356 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application self._flush(objects) Jun 22 10:03:57.701356 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 22 10:03:57.701356 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 22 10:03:57.701356 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 22 10:03:57.701356 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application compat.raise_( Jun 22 10:03:57.701356 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 22 10:03:57.701356 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception Jun 22 10:03:57.701356 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 22 10:03:57.701356 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application flush_context.execute() Jun 22 10:03:57.701356 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 22 10:03:57.701356 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rec.execute(self) Jun 22 10:03:57.701356 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 22 10:03:57.701356 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 22 10:03:57.703051 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 22 10:03:57.703051 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 22 10:03:57.703051 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 22 10:03:57.703051 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application result = connection._execute_20( Jun 22 10:03:57.703051 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 22 10:03:57.703051 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 22 10:03:57.703051 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 22 10:03:57.703051 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 22 10:03:57.703051 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 22 10:03:57.703051 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 22 10:03:57.703051 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 22 10:03:57.703051 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 22 10:03:57.703051 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 22 10:03:57.703051 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 22 10:03:57.703051 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 22 10:03:57.703051 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception Jun 22 10:03:57.703925 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 22 10:03:57.703925 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 22 10:03:57.703925 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 22 10:03:57.703925 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 22 10:03:57.703925 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 22 10:03:57.703925 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application result = self._query(query) Jun 22 10:03:57.703925 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 22 10:03:57.703925 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application conn.query(q) Jun 22 10:03:57.703925 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 22 10:03:57.703925 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 22 10:03:57.703925 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 22 10:03:57.703925 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application result.read() Jun 22 10:03:57.703925 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 22 10:03:57.703925 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 22 10:03:57.703925 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 22 10:03:57.703925 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 22 10:03:57.704780 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 22 10:03:57.704780 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 22 10:03:57.704780 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 22 10:03:57.704780 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 22 10:03:57.704780 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 22 10:03:57.704780 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 22 10:03:57.704780 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [parameters: {'user_id': '33f463860ff847c1b07554192e84fefb', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 22 10:03:57.704780 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 22 10:03:57.704780 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:03:57.704780 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 10:03:57.704780 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:03:57.704780 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:57.704780 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:57.704780 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:57.704780 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:57.705597 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:57.705597 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:57.705597 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:57.705597 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:57.705597 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:57.705597 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:57.705597 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:57.705597 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jun 22 10:03:57.705597 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jun 22 10:03:57.705597 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:57.705597 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:57.705597 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 10:03:57.705597 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:03:57.705597 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 10:03:57.705597 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:03:57.705597 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jun 22 10:03:57.705597 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jun 22 10:03:57.708213 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jun 22 10:03:57.708213 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jun 22 10:03:57.708213 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 22 10:03:57.708213 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 22 10:03:57.708213 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 22 10:03:57.708213 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:03:57.708213 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 491/975] 10.222.0.43 () {60 vars in 1131 bytes} [Wed Jun 22 10:03:57 2022] POST /identity/v3/users => generated 160 bytes in 233 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:03:57.708213 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f01b5b5-cc66-4546-b3b7-56fab51c81e6 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:57.732108 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:57.738042 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064c414b-992a-4195-9631-637e117cb917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:57.739094 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064c414b-992a-4195-9631-637e117cb917 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:57.739826 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064c414b-992a-4195-9631-637e117cb917 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:57.740363 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064c414b-992a-4195-9631-637e117cb917 None admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:57.741798 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064c414b-992a-4195-9631-637e117cb917 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:57.742313 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064c414b-992a-4195-9631-637e117cb917 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:57.744393 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064c414b-992a-4195-9631-637e117cb917 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:57.761169 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 485/976] 10.222.0.43 () {56 vars in 1148 bytes} [Wed Jun 22 10:03:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:03:57.766969 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064c414b-992a-4195-9631-637e117cb917 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:57.802973 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:57.836805 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f01b5b5-cc66-4546-b3b7-56fab51c81e6 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:57.873083 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b9a3c2-7930-43dd-9ca5-671c15602ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:57.873966 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b9a3c2-7930-43dd-9ca5-671c15602ed0 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:57.874587 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b9a3c2-7930-43dd-9ca5-671c15602ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:57.874587 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b9a3c2-7930-43dd-9ca5-671c15602ed0 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:57.883847 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b9a3c2-7930-43dd-9ca5-671c15602ed0 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:57.885620 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b9a3c2-7930-43dd-9ca5-671c15602ed0 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:57.901804 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-a8b9a3c2-7930-43dd-9ca5-671c15602ed0 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 22 10:03:57.901804 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:57.901804 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:57.901804 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:57.901804 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:57.901804 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:57.901804 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:57.901804 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:57.901804 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:57.901804 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:57.901804 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:57.901804 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:57.901804 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 10:03:57.901804 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 10:03:57.901804 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 10:03:57.901804 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 10:03:57.902818 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:57.902818 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:57.902818 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 10:03:57.902818 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:03:57.902818 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 10:03:57.902818 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:03:57.902818 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:57.902818 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:57.902818 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:57.902818 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:57.902818 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:57.902818 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:57.902818 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:57.902818 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:57.902818 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:57.902818 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:57.902818 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:57.902818 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:57.903747 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:57.903747 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:57.903747 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 10:03:57.903747 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 10:03:57.903747 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 10:03:57.903747 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 10:03:57.903747 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 10:03:57.903747 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 10:03:57.903747 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 22 10:03:57.903747 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:03:57.907856 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 492/977] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Jun 22 10:03:57 2022] GET /identity/v3/users/cinder => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:03:57.908773 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b9a3c2-7930-43dd-9ca5-671c15602ed0 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:57.911965 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064c414b-992a-4195-9631-637e117cb917 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:57.951486 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bf7819-9c3d-4c37-9c68-2a23016e378f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:57.952204 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bf7819-9c3d-4c37-9c68-2a23016e378f None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:57.952523 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bf7819-9c3d-4c37-9c68-2a23016e378f None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:57.952856 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bf7819-9c3d-4c37-9c68-2a23016e378f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:57.953881 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bf7819-9c3d-4c37-9c68-2a23016e378f None admin] RBAC: Adding query filter params (role.id=23300d26129048399321250a40367eb7, scope.project.id=e03f1c17e0884f188231d2949dc6f956, user.id=317e7e7dd5c741d49d34a1fd949a7c07) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:57.954208 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bf7819-9c3d-4c37-9c68-2a23016e378f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:57.955752 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bf7819-9c3d-4c37-9c68-2a23016e378f None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:57.970106 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 486/978] 10.222.0.43 () {56 vars in 1374 bytes} [Wed Jun 22 10:03:57 2022] GET /identity/v3/role_assignments?user.id=317e7e7dd5c741d49d34a1fd949a7c07&scope.project.id=e03f1c17e0884f188231d2949dc6f956&role.id=23300d26129048399321250a40367eb7 => generated 608 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:03:58.022099 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:58.032939 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b9a3c2-7930-43dd-9ca5-671c15602ed0 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:58.056982 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec6f83e-c2a9-44bf-8ad1-4639fda3300d None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:58.057283 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec6f83e-c2a9-44bf-8ad1-4639fda3300d None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:58.057571 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec6f83e-c2a9-44bf-8ad1-4639fda3300d None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:58.059255 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 487/979] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:03:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:03:58.064627 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60dea0f-0166-43f0-899d-2ca08994725f None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:58.065097 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60dea0f-0166-43f0-899d-2ca08994725f None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:58.065417 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60dea0f-0166-43f0-899d-2ca08994725f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:58.075527 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1080397-54ee-4aea-8d6d-284d4b911bf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:58.076383 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1080397-54ee-4aea-8d6d-284d4b911bf6 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:58.076899 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1080397-54ee-4aea-8d6d-284d4b911bf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:58.077199 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1080397-54ee-4aea-8d6d-284d4b911bf6 None admin] PATH_INFO: `/v3/users` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:58.078165 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1080397-54ee-4aea-8d6d-284d4b911bf6 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:58.078579 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1080397-54ee-4aea-8d6d-284d4b911bf6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:58.080169 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1080397-54ee-4aea-8d6d-284d4b911bf6 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:58.095765 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-e60dea0f-0166-43f0-899d-2ca08994725f None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:03:58.097297 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-e60dea0f-0166-43f0-899d-2ca08994725f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:03:58.124451 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 493/980] 10.222.0.43 () {56 vars in 1101 bytes} [Wed Jun 22 10:03:57 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:58.183522 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 488/981] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:03:58 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 10:03:58.206828 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1080397-54ee-4aea-8d6d-284d4b911bf6 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:58.324565 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1080397-54ee-4aea-8d6d-284d4b911bf6 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:58.361355 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80658a5b-f760-43fe-8fa4-5514ea3358f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:58.362147 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80658a5b-f760-43fe-8fa4-5514ea3358f2 None admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:58.362439 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80658a5b-f760-43fe-8fa4-5514ea3358f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:58.362723 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80658a5b-f760-43fe-8fa4-5514ea3358f2 None admin] PATH_INFO: `/v3/services` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:58.364005 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80658a5b-f760-43fe-8fa4-5514ea3358f2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:58.365402 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80658a5b-f760-43fe-8fa4-5514ea3358f2 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:58.368655 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:58.383205 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 494/982] 10.222.0.43 () {60 vars in 1141 bytes} [Wed Jun 22 10:03:58 2022] POST /identity/v3/services => generated 242 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:03:59.367458 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56605a79-e7a5-4dc9-9187-67727398c3e0 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:59.367954 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56605a79-e7a5-4dc9-9187-67727398c3e0 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:59.367954 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56605a79-e7a5-4dc9-9187-67727398c3e0 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:59.369365 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 489/983] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:03:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:03:59.374806 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3257f3-cae6-4f96-b607-0efc9d0944ae None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:59.375205 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3257f3-cae6-4f96-b607-0efc9d0944ae None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:59.375454 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3257f3-cae6-4f96-b607-0efc9d0944ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:59.393885 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-3f3257f3-cae6-4f96-b607-0efc9d0944ae None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:03:59.395496 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-3f3257f3-cae6-4f96-b607-0efc9d0944ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:03:59.470538 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 495/984] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:03:59 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 10:03:59.493903 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56605a79-e7a5-4dc9-9187-67727398c3e0 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:59.512661 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:59.603858 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56605a79-e7a5-4dc9-9187-67727398c3e0 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:59.639067 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbccc5e-456f-44b8-85ee-0084c2c248c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:59.640108 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbccc5e-456f-44b8-85ee-0084c2c248c2 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:59.640599 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbccc5e-456f-44b8-85ee-0084c2c248c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:59.641026 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbccc5e-456f-44b8-85ee-0084c2c248c2 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:59.641894 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbccc5e-456f-44b8-85ee-0084c2c248c2 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:59.643408 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbccc5e-456f-44b8-85ee-0084c2c248c2 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:59.656929 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-9fbccc5e-456f-44b8-85ee-0084c2c248c2 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 22 10:03:59.656929 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:59.656929 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 10:03:59.656929 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 10:03:59.656929 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 10:03:59.656929 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 10:03:59.656929 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 10:03:59.656929 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 10:03:59.656929 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 22 10:03:59.656929 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:03:59.656929 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 10:03:59.656929 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:03:59.656929 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:03:59.656929 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:03:59.656929 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:03:59.656929 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:03:59.656929 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:03:59.658133 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:03:59.658133 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:03:59.658133 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:03:59.658133 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:03:59.658133 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:03:59.658133 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:03:59.658133 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 10:03:59.658133 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 10:03:59.658133 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 10:03:59.658133 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 10:03:59.658133 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:03:59.658133 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:03:59.658133 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:03:59.658133 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:03:59.658133 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:03:59.658133 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:03:59.659166 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:03:59.659166 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jun 22 10:03:59.659166 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:03:59.659166 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:03:59.659166 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:03:59.659166 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:03:59.659166 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:03:59.659166 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:03:59.659166 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:03:59.659166 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:03:59.659166 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 10:03:59.659166 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 10:03:59.659166 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 22 10:03:59.659166 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:03:59.662245 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 490/985] 10.222.0.43 () {56 vars in 1126 bytes} [Wed Jun 22 10:03:59 2022] GET /identity/v3/services/object-store => generated 93 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:03:59.667803 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3257f3-cae6-4f96-b607-0efc9d0944ae None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:59.771017 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3257f3-cae6-4f96-b607-0efc9d0944ae None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:59.794788 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:59.809251 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab025591-5f6f-4e7f-9f06-967e37d317ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:59.809965 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab025591-5f6f-4e7f-9f06-967e37d317ab None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:59.810251 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab025591-5f6f-4e7f-9f06-967e37d317ab None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:59.810525 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab025591-5f6f-4e7f-9f06-967e37d317ab None admin] PATH_INFO: `/v3/services` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:59.811226 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab025591-5f6f-4e7f-9f06-967e37d317ab None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:59.811529 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab025591-5f6f-4e7f-9f06-967e37d317ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:59.812934 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab025591-5f6f-4e7f-9f06-967e37d317ab None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:59.823365 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 496/986] 10.222.0.43 () {56 vars in 1122 bytes} [Wed Jun 22 10:03:59 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:03:59.824565 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbccc5e-456f-44b8-85ee-0084c2c248c2 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:03:59.910748 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:03:59.930786 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbccc5e-456f-44b8-85ee-0084c2c248c2 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:03:59.965722 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea43091-d86e-4d8a-bb1e-b5513b5c56f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:03:59.966404 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea43091-d86e-4d8a-bb1e-b5513b5c56f8 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:03:59.966691 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea43091-d86e-4d8a-bb1e-b5513b5c56f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:03:59.966981 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea43091-d86e-4d8a-bb1e-b5513b5c56f8 None admin] PATH_INFO: `/v3/services` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:03:59.967692 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea43091-d86e-4d8a-bb1e-b5513b5c56f8 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:03:59.968005 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea43091-d86e-4d8a-bb1e-b5513b5c56f8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:03:59.969380 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea43091-d86e-4d8a-bb1e-b5513b5c56f8 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:03:59.975231 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 491/987] 10.222.0.43 () {56 vars in 1122 bytes} [Wed Jun 22 10:03:59 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:03:59.981017 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab025591-5f6f-4e7f-9f06-967e37d317ab None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:04:00.083186 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab025591-5f6f-4e7f-9f06-967e37d317ab None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:04:00.091283 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2607ae6f-5cc1-40c3-8919-a4ba537596ff None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:00.091979 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2607ae6f-5cc1-40c3-8919-a4ba537596ff None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:00.091979 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2607ae6f-5cc1-40c3-8919-a4ba537596ff None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:00.093362 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 492/988] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:04:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:04:00.099309 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ee43eb-dee2-42e4-94c9-b7f6a9edfbd8 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:00.099609 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ee43eb-dee2-42e4-94c9-b7f6a9edfbd8 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:00.099897 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ee43eb-dee2-42e4-94c9-b7f6a9edfbd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:00.117102 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-04ee43eb-dee2-42e4-94c9-b7f6a9edfbd8 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:04:00.118321 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-04ee43eb-dee2-42e4-94c9-b7f6a9edfbd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:04:00.127813 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a93a49a-410d-45cb-9544-53b8b7e5d9d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:04:00.128482 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a93a49a-410d-45cb-9544-53b8b7e5d9d0 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:00.129340 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a93a49a-410d-45cb-9544-53b8b7e5d9d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:00.129963 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a93a49a-410d-45cb-9544-53b8b7e5d9d0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:00.130455 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a93a49a-410d-45cb-9544-53b8b7e5d9d0 None admin] RBAC: Adding query filter params (interface=admin, service_id=9db69f4b463f45a79295817b63029fc0, region_id=RegionOne) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:04:00.130774 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a93a49a-410d-45cb-9544-53b8b7e5d9d0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:04:00.132250 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a93a49a-410d-45cb-9544-53b8b7e5d9d0 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:04:00.137707 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 497/989] 10.222.0.43 () {56 vars in 1249 bytes} [Wed Jun 22 10:03:59 2022] GET /identity/v3/endpoints?service_id=9db69f4b463f45a79295817b63029fc0&interface=admin®ion_id=RegionOne => generated 193 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:04:00.142890 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a93a49a-410d-45cb-9544-53b8b7e5d9d0 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:04:00.197152 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:04:00.201890 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 493/990] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:04:00 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 10:04:00.225055 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ee43eb-dee2-42e4-94c9-b7f6a9edfbd8 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:04:00.252093 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a93a49a-410d-45cb-9544-53b8b7e5d9d0 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:04:00.290048 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4456b071-7d23-4a84-b34d-23b9d08e2bfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:04:00.290717 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4456b071-7d23-4a84-b34d-23b9d08e2bfa None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:00.291008 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4456b071-7d23-4a84-b34d-23b9d08e2bfa None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:00.291288 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4456b071-7d23-4a84-b34d-23b9d08e2bfa None admin] PATH_INFO: `/v3/services` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:00.291971 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4456b071-7d23-4a84-b34d-23b9d08e2bfa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:04:00.293346 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4456b071-7d23-4a84-b34d-23b9d08e2bfa None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:04:00.300443 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 498/991] 10.222.0.43 () {56 vars in 1087 bytes} [Wed Jun 22 10:04:00 2022] GET /identity/v3/services => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 10:04:00.302911 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:04:00.333056 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ee43eb-dee2-42e4-94c9-b7f6a9edfbd8 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:04:00.373119 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1972f83f-0815-4fad-93ae-79201407918a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:04:00.373964 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1972f83f-0815-4fad-93ae-79201407918a None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:00.374249 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1972f83f-0815-4fad-93ae-79201407918a None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:00.374528 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1972f83f-0815-4fad-93ae-79201407918a None admin] PATH_INFO: `/v3/services/image` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:00.375191 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1972f83f-0815-4fad-93ae-79201407918a None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:04:00.376599 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1972f83f-0815-4fad-93ae-79201407918a None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:04:00.389363 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-1972f83f-0815-4fad-93ae-79201407918a None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 22 10:04:00.389363 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:04:00.389363 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 10:04:00.389363 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 10:04:00.389363 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 10:04:00.389363 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 10:04:00.389363 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 10:04:00.389363 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 10:04:00.389363 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 22 10:04:00.389363 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:04:00.389363 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 10:04:00.389363 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:04:00.389363 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:04:00.389363 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:04:00.389363 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:04:00.389363 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:04:00.389363 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:04:00.390464 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:04:00.390464 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:04:00.390464 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:04:00.390464 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:04:00.390464 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:04:00.390464 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:04:00.390464 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 10:04:00.390464 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 10:04:00.390464 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 10:04:00.390464 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 10:04:00.390464 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:04:00.390464 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:04:00.390464 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:04:00.390464 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:04:00.390464 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:04:00.390464 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:04:00.391308 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:04:00.391308 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jun 22 10:04:00.391308 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:04:00.391308 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:04:00.391308 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:04:00.391308 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:04:00.391308 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:04:00.391308 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:04:00.391308 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:04:00.391308 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:04:00.391308 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 10:04:00.391308 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 10:04:00.391308 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 22 10:04:00.391308 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:04:00.391308 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 494/992] 10.222.0.43 () {56 vars in 1105 bytes} [Wed Jun 22 10:04:00 2022] GET /identity/v3/services/image => generated 86 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 10:04:00.397331 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4456b071-7d23-4a84-b34d-23b9d08e2bfa None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:04:00.471045 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e795d637-ad7a-4809-b622-6fbf05ff9b08 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:00.471663 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e795d637-ad7a-4809-b622-6fbf05ff9b08 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:00.472182 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e795d637-ad7a-4809-b622-6fbf05ff9b08 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:00.475235 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 495/993] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:04:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 10:04:00.480574 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d061fe02-5f49-4259-88fd-9a3899a4b763 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:00.480880 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d061fe02-5f49-4259-88fd-9a3899a4b763 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:00.481267 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d061fe02-5f49-4259-88fd-9a3899a4b763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:00.499494 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-d061fe02-5f49-4259-88fd-9a3899a4b763 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:04:00.500695 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-d061fe02-5f49-4259-88fd-9a3899a4b763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:04:00.513334 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4456b071-7d23-4a84-b34d-23b9d08e2bfa None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:04:00.529752 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:04:00.554537 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41e43d3-2a34-4cdc-b2b6-e47d88c5bee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:04:00.555210 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41e43d3-2a34-4cdc-b2b6-e47d88c5bee9 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:00.555500 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41e43d3-2a34-4cdc-b2b6-e47d88c5bee9 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:00.555785 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41e43d3-2a34-4cdc-b2b6-e47d88c5bee9 None admin] PATH_INFO: `/v3/services` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:00.556944 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41e43d3-2a34-4cdc-b2b6-e47d88c5bee9 None admin] RBAC: Adding query filter params (name=image) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:04:00.557111 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41e43d3-2a34-4cdc-b2b6-e47d88c5bee9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:04:00.558472 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41e43d3-2a34-4cdc-b2b6-e47d88c5bee9 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:04:00.564413 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 499/994] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jun 22 10:04:00 2022] GET /identity/v3/services?name=image => generated 122 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:04:00.570105 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41e43d3-2a34-4cdc-b2b6-e47d88c5bee9 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:04:00.579131 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 496/995] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:04:00 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 10:04:00.604133 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d061fe02-5f49-4259-88fd-9a3899a4b763 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:04:00.679236 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:04:00.680562 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41e43d3-2a34-4cdc-b2b6-e47d88c5bee9 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:04:00.713868 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d061fe02-5f49-4259-88fd-9a3899a4b763 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:04:00.723503 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4601847-7356-4354-bbde-95ee7078a28b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:04:00.724725 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4601847-7356-4354-bbde-95ee7078a28b None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:00.725484 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4601847-7356-4354-bbde-95ee7078a28b None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:00.725952 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4601847-7356-4354-bbde-95ee7078a28b None admin] PATH_INFO: `/v3/services` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:00.727331 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4601847-7356-4354-bbde-95ee7078a28b None admin] RBAC: Adding query filter params (type=image) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:04:00.727792 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4601847-7356-4354-bbde-95ee7078a28b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:04:00.730261 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4601847-7356-4354-bbde-95ee7078a28b None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:04:00.736626 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 500/996] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jun 22 10:04:00 2022] GET /identity/v3/services?type=image => generated 122 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:04:00.750521 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d064ecc-4b13-4103-bc0b-e39e453e460c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:04:00.751355 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d064ecc-4b13-4103-bc0b-e39e453e460c None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:00.751635 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d064ecc-4b13-4103-bc0b-e39e453e460c None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:00.751909 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d064ecc-4b13-4103-bc0b-e39e453e460c None admin] PATH_INFO: `/v3/services/compute` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:00.752579 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d064ecc-4b13-4103-bc0b-e39e453e460c None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:04:00.754243 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d064ecc-4b13-4103-bc0b-e39e453e460c None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:04:00.767255 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-7d064ecc-4b13-4103-bc0b-e39e453e460c None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 22 10:04:00.767255 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:04:00.767255 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 10:04:00.767255 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 10:04:00.767255 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 10:04:00.767255 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 10:04:00.767255 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 10:04:00.767255 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 10:04:00.767255 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 22 10:04:00.767255 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:04:00.767255 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 10:04:00.767255 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:04:00.767255 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:04:00.767255 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:04:00.767255 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:04:00.767255 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:04:00.767255 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:04:00.768382 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:04:00.768382 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:04:00.768382 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:04:00.768382 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:04:00.768382 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:04:00.768382 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:04:00.768382 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 10:04:00.768382 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 10:04:00.768382 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 10:04:00.768382 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 10:04:00.768382 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:04:00.768382 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:04:00.768382 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:04:00.768382 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:04:00.768382 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:04:00.768382 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:04:00.770089 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:04:00.770089 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jun 22 10:04:00.770089 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:04:00.770089 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:04:00.770089 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:04:00.770089 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:04:00.770089 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:04:00.770089 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:04:00.770089 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:04:00.770089 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:04:00.770089 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 10:04:00.770089 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 10:04:00.770089 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 22 10:04:00.770089 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:04:00.770089 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 497/997] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Jun 22 10:04:00 2022] GET /identity/v3/services/compute => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 10:04:00.775390 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4601847-7356-4354-bbde-95ee7078a28b None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:04:00.829984 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:04:00.910167 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4601847-7356-4354-bbde-95ee7078a28b None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:04:00.952300 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668c72b2-1d83-441a-b5ff-3f7eec267f9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:04:00.952974 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668c72b2-1d83-441a-b5ff-3f7eec267f9e None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:00.953258 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668c72b2-1d83-441a-b5ff-3f7eec267f9e None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:00.953535 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668c72b2-1d83-441a-b5ff-3f7eec267f9e None admin] PATH_INFO: `/v3/services` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:00.954282 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668c72b2-1d83-441a-b5ff-3f7eec267f9e None admin] RBAC: Adding query filter params (name=compute) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:04:00.954594 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668c72b2-1d83-441a-b5ff-3f7eec267f9e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:04:00.956843 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668c72b2-1d83-441a-b5ff-3f7eec267f9e None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:04:00.962913 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 501/998] 10.222.0.43 () {56 vars in 1112 bytes} [Wed Jun 22 10:04:00 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:04:00.968604 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d064ecc-4b13-4103-bc0b-e39e453e460c None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:04:01.072514 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d064ecc-4b13-4103-bc0b-e39e453e460c None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:04:01.109572 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:04:01.116365 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15965dc5-3942-4bf2-adbe-534b0de1c454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:04:01.117038 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15965dc5-3942-4bf2-adbe-534b0de1c454 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:01.117326 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15965dc5-3942-4bf2-adbe-534b0de1c454 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:01.117601 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15965dc5-3942-4bf2-adbe-534b0de1c454 None admin] PATH_INFO: `/v3/services` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:01.118343 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15965dc5-3942-4bf2-adbe-534b0de1c454 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:04:01.118650 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15965dc5-3942-4bf2-adbe-534b0de1c454 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:04:01.120008 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15965dc5-3942-4bf2-adbe-534b0de1c454 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:04:01.130440 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 498/999] 10.222.0.43 () {56 vars in 1112 bytes} [Wed Jun 22 10:04:00 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:04:01.131613 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668c72b2-1d83-441a-b5ff-3f7eec267f9e None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:04:01.232918 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668c72b2-1d83-441a-b5ff-3f7eec267f9e None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:04:01.245318 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:04:01.278547 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45ef09e-0283-47ce-9326-e1db4de875ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:04:01.279212 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45ef09e-0283-47ce-9326-e1db4de875ff None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:01.279498 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45ef09e-0283-47ce-9326-e1db4de875ff None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:01.279771 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45ef09e-0283-47ce-9326-e1db4de875ff None admin] PATH_INFO: `/v3/endpoints` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:01.280561 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45ef09e-0283-47ce-9326-e1db4de875ff None admin] RBAC: Adding query filter params (interface=public, service_id=84dc464969db498f9832f85608d5ba00, region_id=RegionOne) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:04:01.280875 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45ef09e-0283-47ce-9326-e1db4de875ff None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:04:01.282282 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45ef09e-0283-47ce-9326-e1db4de875ff None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:04:01.292209 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 502/1000] 10.222.0.43 () {56 vars in 1251 bytes} [Wed Jun 22 10:04:01 2022] GET /identity/v3/endpoints?service_id=84dc464969db498f9832f85608d5ba00&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:04:01.293010 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15965dc5-3942-4bf2-adbe-534b0de1c454 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:04:01.395394 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15965dc5-3942-4bf2-adbe-534b0de1c454 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:04:01.429303 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4dbe10-1651-449e-b018-9a076eb64681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:04:01.430002 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4dbe10-1651-449e-b018-9a076eb64681 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:01.430292 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4dbe10-1651-449e-b018-9a076eb64681 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:01.430575 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4dbe10-1651-449e-b018-9a076eb64681 None admin] PATH_INFO: `/v3/services` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:01.431264 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4dbe10-1651-449e-b018-9a076eb64681 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:04:01.432632 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4dbe10-1651-449e-b018-9a076eb64681 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:04:01.445750 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 499/1001] 10.222.0.43 () {56 vars in 1087 bytes} [Wed Jun 22 10:04:01 2022] GET /identity/v3/services => generated 1727 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 10:04:02.409330 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6188b8-3372-44ad-b282-62019dabad86 None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:02.410422 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6188b8-3372-44ad-b282-62019dabad86 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:02.410422 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6188b8-3372-44ad-b282-62019dabad86 None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:02.411913 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 503/1002] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:04:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:04:02.417007 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c099290c-8b8d-4f77-a104-039ebb1ceca0 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:02.417406 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c099290c-8b8d-4f77-a104-039ebb1ceca0 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:02.417581 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c099290c-8b8d-4f77-a104-039ebb1ceca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:02.434360 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-c099290c-8b8d-4f77-a104-039ebb1ceca0 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:04:02.435543 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-c099290c-8b8d-4f77-a104-039ebb1ceca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:04:02.494912 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:04:02.507823 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 500/1003] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:04:02 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 10:04:02.530594 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6188b8-3372-44ad-b282-62019dabad86 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:04:02.637856 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6188b8-3372-44ad-b282-62019dabad86 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:04:02.671457 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396bbde5-b1b9-419c-8f7e-e22d795387eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:04:02.672309 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396bbde5-b1b9-419c-8f7e-e22d795387eb None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:02.672596 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396bbde5-b1b9-419c-8f7e-e22d795387eb None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:02.672872 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396bbde5-b1b9-419c-8f7e-e22d795387eb None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:02.673517 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396bbde5-b1b9-419c-8f7e-e22d795387eb None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:04:02.674915 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396bbde5-b1b9-419c-8f7e-e22d795387eb None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:04:02.687634 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-396bbde5-b1b9-419c-8f7e-e22d795387eb None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 22 10:04:02.687634 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:04:02.687634 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 10:04:02.687634 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 10:04:02.687634 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 10:04:02.687634 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 10:04:02.687634 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 10:04:02.687634 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 10:04:02.687634 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 22 10:04:02.687634 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:04:02.687634 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 10:04:02.687634 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:04:02.687634 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:04:02.687634 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:04:02.687634 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:04:02.687634 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:04:02.687634 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:04:02.688645 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:04:02.688645 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:04:02.688645 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:04:02.688645 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:04:02.688645 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:04:02.688645 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:04:02.688645 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 10:04:02.688645 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 10:04:02.688645 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 10:04:02.688645 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 10:04:02.688645 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:04:02.688645 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:04:02.688645 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:04:02.688645 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:04:02.688645 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:04:02.688645 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:04:02.689514 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:04:02.689514 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( Jun 22 10:04:02.689514 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:04:02.689514 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:04:02.689514 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:04:02.689514 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:04:02.689514 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:04:02.689514 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:04:02.689514 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:04:02.689514 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:04:02.689514 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 10:04:02.689514 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 10:04:02.689514 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 22 10:04:02.689514 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:04:02.693966 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 504/1004] 10.222.0.43 () {56 vars in 1126 bytes} [Wed Jun 22 10:04:02 2022] GET /identity/v3/services/object-store => generated 93 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:04:02.695527 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c099290c-8b8d-4f77-a104-039ebb1ceca0 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:04:02.793077 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c099290c-8b8d-4f77-a104-039ebb1ceca0 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:04:02.832865 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbb5bc7-1b98-4cbb-9c71-85d5cc598484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:04:02.833529 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbb5bc7-1b98-4cbb-9c71-85d5cc598484 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:02.833840 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbb5bc7-1b98-4cbb-9c71-85d5cc598484 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:02.834116 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbb5bc7-1b98-4cbb-9c71-85d5cc598484 None admin] PATH_INFO: `/v3/services` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:02.834819 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbb5bc7-1b98-4cbb-9c71-85d5cc598484 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:04:02.835126 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbb5bc7-1b98-4cbb-9c71-85d5cc598484 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:04:02.836480 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbb5bc7-1b98-4cbb-9c71-85d5cc598484 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:04:02.846174 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 501/1005] 10.222.0.43 () {56 vars in 1122 bytes} [Wed Jun 22 10:04:02 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:04:02.846947 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396bbde5-b1b9-419c-8f7e-e22d795387eb None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:04:02.850634 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3e5e49-d215-4704-9305-d0d260272756 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:02.850927 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3e5e49-d215-4704-9305-d0d260272756 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:02.851204 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3e5e49-d215-4704-9305-d0d260272756 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:02.852926 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 502/1006] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:04:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 10:04:02.857540 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fca31f-fa9d-4241-aa7a-97e8919dad1b None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:02.857876 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fca31f-fa9d-4241-aa7a-97e8919dad1b None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:02.858157 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fca31f-fa9d-4241-aa7a-97e8919dad1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:02.875700 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-10fca31f-fa9d-4241-aa7a-97e8919dad1b None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:04:02.876865 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-10fca31f-fa9d-4241-aa7a-97e8919dad1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:04:02.884645 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:04:02.930022 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:04:02.953719 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 503/1007] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:04:02 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 10:04:02.953945 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396bbde5-b1b9-419c-8f7e-e22d795387eb None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:04:02.977127 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fca31f-fa9d-4241-aa7a-97e8919dad1b None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:04:02.993263 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e024af-1325-41dd-9489-08ab1c5c98e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:04:02.994241 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e024af-1325-41dd-9489-08ab1c5c98e5 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:02.994694 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e024af-1325-41dd-9489-08ab1c5c98e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:02.995133 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e024af-1325-41dd-9489-08ab1c5c98e5 None admin] PATH_INFO: `/v3/services` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:02.996061 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e024af-1325-41dd-9489-08ab1c5c98e5 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:04:02.996528 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e024af-1325-41dd-9489-08ab1c5c98e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:04:02.998063 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e024af-1325-41dd-9489-08ab1c5c98e5 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:04:03.003128 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 505/1008] 10.222.0.43 () {56 vars in 1122 bytes} [Wed Jun 22 10:04:02 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:04:03.010007 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e024af-1325-41dd-9489-08ab1c5c98e5 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:04:03.090703 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fca31f-fa9d-4241-aa7a-97e8919dad1b None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:04:03.122917 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:04:03.127622 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e024af-1325-41dd-9489-08ab1c5c98e5 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:04:03.131239 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f179df4f-6887-42de-add2-786ef2fb64d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:04:03.131907 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f179df4f-6887-42de-add2-786ef2fb64d6 None admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:03.132190 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f179df4f-6887-42de-add2-786ef2fb64d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:03.132472 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f179df4f-6887-42de-add2-786ef2fb64d6 None admin] PATH_INFO: `/v3/services` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:03.133202 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f179df4f-6887-42de-add2-786ef2fb64d6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:04:03.134681 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f179df4f-6887-42de-add2-786ef2fb64d6 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:04:03.150312 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 504/1009] 10.222.0.43 () {60 vars in 1141 bytes} [Wed Jun 22 10:04:02 2022] POST /identity/v3/services => generated 242 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 10:04:03.179739 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bac7671-ba39-45c4-8a30-d5cf28a4d505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:04:03.180473 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bac7671-ba39-45c4-8a30-d5cf28a4d505 None admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:03.180700 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bac7671-ba39-45c4-8a30-d5cf28a4d505 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:03.180970 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bac7671-ba39-45c4-8a30-d5cf28a4d505 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:03.181762 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bac7671-ba39-45c4-8a30-d5cf28a4d505 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:04:03.183179 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bac7671-ba39-45c4-8a30-d5cf28a4d505 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:04:03.201854 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 506/1010] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Jun 22 10:04:03 2022] POST /identity/v3/endpoints => generated 325 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 10:04:03.515635 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f3f0ee-e29c-405e-a3e9-f0c1279d1a1b None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:03.516159 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f3f0ee-e29c-405e-a3e9-f0c1279d1a1b None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:03.516159 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f3f0ee-e29c-405e-a3e9-f0c1279d1a1b None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:03.517765 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 505/1011] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:04:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:04:03.523619 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f367014-3893-4c75-8895-4f08e97aebe7 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:03.524082 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f367014-3893-4c75-8895-4f08e97aebe7 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:03.524177 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f367014-3893-4c75-8895-4f08e97aebe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:03.541235 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-4f367014-3893-4c75-8895-4f08e97aebe7 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:04:03.542477 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-4f367014-3893-4c75-8895-4f08e97aebe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:04:03.625054 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 507/1012] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:04:03 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 10:04:03.649997 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f3f0ee-e29c-405e-a3e9-f0c1279d1a1b None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:04:03.699555 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:04:03.759954 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f3f0ee-e29c-405e-a3e9-f0c1279d1a1b None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:04:03.794632 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d73fc7-c92f-456c-9269-ad7769b9909e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:04:03.795433 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d73fc7-c92f-456c-9269-ad7769b9909e None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:03.795672 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d73fc7-c92f-456c-9269-ad7769b9909e None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:03.795933 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d73fc7-c92f-456c-9269-ad7769b9909e None admin] PATH_INFO: `/v3/services/compute` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:03.796813 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d73fc7-c92f-456c-9269-ad7769b9909e None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:04:03.798247 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d73fc7-c92f-456c-9269-ad7769b9909e None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:04:03.811214 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-e6d73fc7-c92f-456c-9269-ad7769b9909e None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 22 10:04:03.811214 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:04:03.811214 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 10:04:03.811214 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 10:04:03.811214 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 10:04:03.811214 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 10:04:03.811214 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 10:04:03.811214 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 10:04:03.811214 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 22 10:04:03.811214 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:04:03.811214 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 10:04:03.811214 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:04:03.811214 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:04:03.811214 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:04:03.811214 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:04:03.811214 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:04:03.811214 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:04:03.812248 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:04:03.812248 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:04:03.812248 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:04:03.812248 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:04:03.812248 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:04:03.812248 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:04:03.812248 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 10:04:03.812248 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 10:04:03.812248 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 10:04:03.812248 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 10:04:03.812248 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:04:03.812248 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:04:03.812248 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:04:03.812248 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:04:03.812248 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:04:03.812248 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:04:03.818456 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:04:03.818456 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jun 22 10:04:03.818456 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:04:03.818456 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:04:03.818456 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:04:03.818456 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:04:03.818456 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:04:03.818456 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:04:03.818456 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:04:03.818456 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:04:03.818456 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 10:04:03.818456 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 10:04:03.818456 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 22 10:04:03.818456 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:04:03.818456 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 506/1013] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Jun 22 10:04:03 2022] GET /identity/v3/services/compute => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:04:03.819624 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f367014-3893-4c75-8895-4f08e97aebe7 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:04:03.900754 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:04:03.922624 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f367014-3893-4c75-8895-4f08e97aebe7 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:04:03.957379 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d1d1be-3298-4781-b217-69d4b21263fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:04:03.958071 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d1d1be-3298-4781-b217-69d4b21263fb None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:03.958355 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d1d1be-3298-4781-b217-69d4b21263fb None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:03.958628 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d1d1be-3298-4781-b217-69d4b21263fb None admin] PATH_INFO: `/v3/services` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:03.959329 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d1d1be-3298-4781-b217-69d4b21263fb None admin] RBAC: Adding query filter params (name=compute) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:04:03.959632 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d1d1be-3298-4781-b217-69d4b21263fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:04:03.960996 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d1d1be-3298-4781-b217-69d4b21263fb None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:04:03.970533 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 508/1014] 10.222.0.43 () {56 vars in 1112 bytes} [Wed Jun 22 10:04:03 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:04:03.971787 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d73fc7-c92f-456c-9269-ad7769b9909e None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:04:04.075891 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d73fc7-c92f-456c-9269-ad7769b9909e None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:04:04.084971 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:04:04.118620 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6400f0-fae7-4875-89fa-146aec324ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:04:04.119298 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6400f0-fae7-4875-89fa-146aec324ea7 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:04.119583 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6400f0-fae7-4875-89fa-146aec324ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:04.119921 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6400f0-fae7-4875-89fa-146aec324ea7 None admin] PATH_INFO: `/v3/services` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:04.120572 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6400f0-fae7-4875-89fa-146aec324ea7 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:04:04.120891 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6400f0-fae7-4875-89fa-146aec324ea7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:04:04.122288 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6400f0-fae7-4875-89fa-146aec324ea7 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:04:04.128643 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 507/1015] 10.222.0.43 () {56 vars in 1112 bytes} [Wed Jun 22 10:04:03 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:04:04.133885 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d1d1be-3298-4781-b217-69d4b21263fb None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:04:04.240592 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d1d1be-3298-4781-b217-69d4b21263fb None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:04:04.274770 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcaf1c0-035f-497b-a5d5-fe1965dfac8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:04:04.275425 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcaf1c0-035f-497b-a5d5-fe1965dfac8b None admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:04.275705 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcaf1c0-035f-497b-a5d5-fe1965dfac8b None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:04.275978 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcaf1c0-035f-497b-a5d5-fe1965dfac8b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:04.276709 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcaf1c0-035f-497b-a5d5-fe1965dfac8b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:04:04.278101 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcaf1c0-035f-497b-a5d5-fe1965dfac8b None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:04:04.292244 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:04:04.298944 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 509/1016] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Jun 22 10:04:04 2022] POST /identity/v3/endpoints => generated 334 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 10:04:05.288095 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4253e1-745d-43ae-bd14-d135c6787f75 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:05.288656 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4253e1-745d-43ae-bd14-d135c6787f75 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:05.289063 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4253e1-745d-43ae-bd14-d135c6787f75 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:05.291886 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 508/1017] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:04:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:04:05.298188 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01864a7a-8337-4be8-9c2e-9b4200759476 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:05.298727 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01864a7a-8337-4be8-9c2e-9b4200759476 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:05.299527 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01864a7a-8337-4be8-9c2e-9b4200759476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:05.300095 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda2e2b2-b75c-452d-a1b7-4e35708fdca5 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:05.300385 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda2e2b2-b75c-452d-a1b7-4e35708fdca5 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:05.301383 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda2e2b2-b75c-452d-a1b7-4e35708fdca5 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:05.303774 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 509/1018] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:04:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:04:05.308998 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a917dc-3923-4ad6-a93a-ef108842c868 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:05.309425 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a917dc-3923-4ad6-a93a-ef108842c868 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:05.309878 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a917dc-3923-4ad6-a93a-ef108842c868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:05.320747 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-01864a7a-8337-4be8-9c2e-9b4200759476 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:04:05.322060 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-01864a7a-8337-4be8-9c2e-9b4200759476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:04:05.328272 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-f5a917dc-3923-4ad6-a93a-ef108842c868 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:04:05.329528 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-f5a917dc-3923-4ad6-a93a-ef108842c868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:04:05.420231 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 510/1019] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:04:05 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 10:04:05.426402 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 510/1020] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:04:05 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 10:04:05.444148 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01864a7a-8337-4be8-9c2e-9b4200759476 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:04:05.450941 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a917dc-3923-4ad6-a93a-ef108842c868 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:04:05.570188 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:04:05.574997 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a917dc-3923-4ad6-a93a-ef108842c868 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:04:05.585127 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01864a7a-8337-4be8-9c2e-9b4200759476 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:04:05.612594 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12f968b-5582-4512-9951-d957dd51dade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:04:05.613360 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12f968b-5582-4512-9951-d957dd51dade None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:05.613652 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12f968b-5582-4512-9951-d957dd51dade None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:05.613961 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12f968b-5582-4512-9951-d957dd51dade None admin] PATH_INFO: `/v3/services/image` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:05.614245 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:04:05.614614 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12f968b-5582-4512-9951-d957dd51dade None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:04:05.616059 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12f968b-5582-4512-9951-d957dd51dade None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:04:05.624503 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8eea91-021f-4bfc-8cbc-fda79d005b85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:04:05.625299 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8eea91-021f-4bfc-8cbc-fda79d005b85 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:05.625586 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8eea91-021f-4bfc-8cbc-fda79d005b85 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:05.625895 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8eea91-021f-4bfc-8cbc-fda79d005b85 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:05.627069 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8eea91-021f-4bfc-8cbc-fda79d005b85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:04:05.628024 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-b12f968b-5582-4512-9951-d957dd51dade None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 22 10:04:05.628024 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:04:05.628024 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 10:04:05.628024 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 10:04:05.628024 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 10:04:05.628024 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 10:04:05.628024 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 10:04:05.628024 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 10:04:05.628024 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 22 10:04:05.628024 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:04:05.628024 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 10:04:05.628024 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:04:05.628024 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:04:05.628024 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:04:05.628024 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:04:05.628024 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:04:05.628024 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:04:05.629192 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:04:05.629192 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:04:05.629192 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:04:05.629192 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:04:05.629192 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:04:05.629192 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:04:05.629192 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 10:04:05.629192 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 10:04:05.629192 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 10:04:05.629192 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 10:04:05.629192 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:04:05.629192 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:04:05.629192 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:04:05.629192 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:04:05.629192 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:04:05.629192 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:04:05.630789 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:04:05.630789 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jun 22 10:04:05.630789 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:04:05.630789 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:04:05.630789 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:04:05.630789 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:04:05.630789 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:04:05.630789 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:04:05.630789 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:04:05.630789 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:04:05.630789 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 10:04:05.630789 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 10:04:05.630789 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 22 10:04:05.630789 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:04:05.631709 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8eea91-021f-4bfc-8cbc-fda79d005b85 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:04:05.631792 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 511/1021] 10.222.0.43 () {56 vars in 1105 bytes} [Wed Jun 22 10:04:05 2022] GET /identity/v3/services/image => generated 86 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 10:04:05.634735 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 511/1022] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jun 22 10:04:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:04:05.636176 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12f968b-5582-4512-9951-d957dd51dade None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:04:05.640157 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8eea91-021f-4bfc-8cbc-fda79d005b85 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:04:05.749895 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12f968b-5582-4512-9951-d957dd51dade None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:04:05.754565 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8eea91-021f-4bfc-8cbc-fda79d005b85 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:04:05.784875 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b071dc-ab36-4123-8a69-1869a132a5c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:04:05.786394 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b071dc-ab36-4123-8a69-1869a132a5c8 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:05.786686 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b071dc-ab36-4123-8a69-1869a132a5c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:05.786971 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b071dc-ab36-4123-8a69-1869a132a5c8 None admin] PATH_INFO: `/v3/services` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:05.787678 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b071dc-ab36-4123-8a69-1869a132a5c8 None admin] RBAC: Adding query filter params (name=image) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:04:05.787993 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b071dc-ab36-4123-8a69-1869a132a5c8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:04:05.789376 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b071dc-ab36-4123-8a69-1869a132a5c8 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:04:05.792200 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537b372d-095a-4033-81d0-f621206f2619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:04:05.793098 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537b372d-095a-4033-81d0-f621206f2619 None admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:05.793582 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537b372d-095a-4033-81d0-f621206f2619 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:05.794037 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537b372d-095a-4033-81d0-f621206f2619 None admin] PATH_INFO: `/v3/projects` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:05.794251 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 512/1023] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jun 22 10:04:05 2022] GET /identity/v3/services?name=image => generated 122 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:04:05.795062 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537b372d-095a-4033-81d0-f621206f2619 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:04:05.796688 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537b372d-095a-4033-81d0-f621206f2619 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:04:05.800332 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b071dc-ab36-4123-8a69-1869a132a5c8 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:04:05.827934 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 512/1024] 10.222.0.43 () {60 vars in 1141 bytes} [Wed Jun 22 10:04:05 2022] POST /identity/v3/projects => generated 311 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 10:04:05.831425 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:04:05.916731 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b071dc-ab36-4123-8a69-1869a132a5c8 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:04:05.967419 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a117a7-9092-428e-986c-0e70fd8d4b07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:04:05.968099 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a117a7-9092-428e-986c-0e70fd8d4b07 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:05.968381 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a117a7-9092-428e-986c-0e70fd8d4b07 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:05.968655 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a117a7-9092-428e-986c-0e70fd8d4b07 None admin] PATH_INFO: `/v3/services` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:05.969374 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a117a7-9092-428e-986c-0e70fd8d4b07 None admin] RBAC: Adding query filter params (type=image) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:04:05.969681 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a117a7-9092-428e-986c-0e70fd8d4b07 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:04:05.971097 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a117a7-9092-428e-986c-0e70fd8d4b07 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:04:05.977393 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 513/1025] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jun 22 10:04:05 2022] GET /identity/v3/services?type=image => generated 350 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:04:05.983235 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537b372d-095a-4033-81d0-f621206f2619 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:04:06.036054 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:04:06.095809 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537b372d-095a-4033-81d0-f621206f2619 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:04:06.135937 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdf678b-d4da-46bf-8a55-7fe1bc6d9bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:04:06.136609 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdf678b-d4da-46bf-8a55-7fe1bc6d9bff None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:06.136912 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdf678b-d4da-46bf-8a55-7fe1bc6d9bff None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:06.137178 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdf678b-d4da-46bf-8a55-7fe1bc6d9bff None admin] PATH_INFO: `/v3/endpoints` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:06.138014 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdf678b-d4da-46bf-8a55-7fe1bc6d9bff None admin] RBAC: Adding query filter params (interface=public, service_id=4b3e992e337e468c8c6a8b8914254060, region_id=RegionOne) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:04:06.138332 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdf678b-d4da-46bf-8a55-7fe1bc6d9bff None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:04:06.139726 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdf678b-d4da-46bf-8a55-7fe1bc6d9bff None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:04:06.150378 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 513/1026] 10.222.0.43 () {56 vars in 1251 bytes} [Wed Jun 22 10:04:05 2022] GET /identity/v3/endpoints?service_id=4b3e992e337e468c8c6a8b8914254060&interface=public®ion_id=RegionOne => generated 194 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:04:06.151457 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a117a7-9092-428e-986c-0e70fd8d4b07 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:04:06.251371 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:04:06.262478 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a117a7-9092-428e-986c-0e70fd8d4b07 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:04:06.297239 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f33df8-d566-4826-9a55-fc2018de60ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:04:06.298021 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f33df8-d566-4826-9a55-fc2018de60ea None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:06.298222 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f33df8-d566-4826-9a55-fc2018de60ea None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:06.298565 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f33df8-d566-4826-9a55-fc2018de60ea None admin] PATH_INFO: `/v3/services` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:06.299258 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f33df8-d566-4826-9a55-fc2018de60ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:04:06.300702 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f33df8-d566-4826-9a55-fc2018de60ea None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:04:06.313134 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 514/1027] 10.222.0.43 () {56 vars in 1087 bytes} [Wed Jun 22 10:04:06 2022] GET /identity/v3/services => generated 1957 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 10:04:06.520616 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0bf976-49f6-46e0-9537-9147bfb0d9ff None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:06.521140 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0bf976-49f6-46e0-9537-9147bfb0d9ff None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:06.521253 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0bf976-49f6-46e0-9537-9147bfb0d9ff None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:06.522743 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 514/1028] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:04:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:04:06.527718 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802b1c85-c207-492e-8e25-566c81e475cc None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:06.528016 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802b1c85-c207-492e-8e25-566c81e475cc None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:06.528302 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802b1c85-c207-492e-8e25-566c81e475cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:06.546136 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-802b1c85-c207-492e-8e25-566c81e475cc None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:04:06.547367 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-802b1c85-c207-492e-8e25-566c81e475cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:04:06.618037 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 515/1029] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:04:06 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 10:04:06.642181 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0bf976-49f6-46e0-9537-9147bfb0d9ff None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:04:06.746759 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0bf976-49f6-46e0-9537-9147bfb0d9ff None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:04:06.757791 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:04:06.783451 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfe9af9-1829-4adb-b946-381b00f5a832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:04:06.784267 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfe9af9-1829-4adb-b946-381b00f5a832 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:06.784552 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfe9af9-1829-4adb-b946-381b00f5a832 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:06.784876 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfe9af9-1829-4adb-b946-381b00f5a832 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:06.795631 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfe9af9-1829-4adb-b946-381b00f5a832 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:04:06.804437 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-1dfe9af9-1829-4adb-b946-381b00f5a832 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 22 10:04:06.804437 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:04:06.804437 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:04:06.804437 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:04:06.804437 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:04:06.804437 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:04:06.804437 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:04:06.804437 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:04:06.804437 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:04:06.804437 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:04:06.804437 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:04:06.804437 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:04:06.804437 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:04:06.804437 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:04:06.804437 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:04:06.804437 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:04:06.805430 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:04:06.805430 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:04:06.805430 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:04:06.805430 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:04:06.805430 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:04:06.805430 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:04:06.805430 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:04:06.805430 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:04:06.805430 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:04:06.805430 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:04:06.805430 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:04:06.805430 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( Jun 22 10:04:06.805430 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:04:06.805430 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:04:06.805430 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:04:06.805430 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:04:06.810541 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:04:06.810541 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:04:06.810541 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:04:06.810541 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:04:06.810541 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:04:06.810541 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:04:06.810541 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:04:06.810541 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:04:06.810541 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:04:06.810541 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:04:06.810541 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 22 10:04:06.810541 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:04:06.810541 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 515/1030] 10.222.0.43 () {56 vars in 1120 bytes} [Wed Jun 22 10:04:06 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:04:06.813082 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802b1c85-c207-492e-8e25-566c81e475cc None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:04:06.899021 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:04:06.916066 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802b1c85-c207-492e-8e25-566c81e475cc None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:04:06.950136 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cb063a-e923-4953-953b-d2ff26fbcc67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:04:06.950812 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cb063a-e923-4953-953b-d2ff26fbcc67 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:06.951096 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cb063a-e923-4953-953b-d2ff26fbcc67 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:06.951374 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cb063a-e923-4953-953b-d2ff26fbcc67 None admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:06.952212 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cb063a-e923-4953-953b-d2ff26fbcc67 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:04:06.952528 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cb063a-e923-4953-953b-d2ff26fbcc67 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:04:06.953987 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cb063a-e923-4953-953b-d2ff26fbcc67 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:04:06.963172 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 516/1031] 10.222.0.43 () {56 vars in 1115 bytes} [Wed Jun 22 10:04:06 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:04:06.968981 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfe9af9-1829-4adb-b946-381b00f5a832 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:04:07.072166 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfe9af9-1829-4adb-b946-381b00f5a832 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:04:07.114174 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1a47e4-e75e-49c7-9e4f-6bab7cbcea13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:04:07.114970 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1a47e4-e75e-49c7-9e4f-6bab7cbcea13 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:07.115248 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1a47e4-e75e-49c7-9e4f-6bab7cbcea13 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:07.115518 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1a47e4-e75e-49c7-9e4f-6bab7cbcea13 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:07.125861 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1a47e4-e75e-49c7-9e4f-6bab7cbcea13 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:04:07.127308 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1a47e4-e75e-49c7-9e4f-6bab7cbcea13 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:04:07.145413 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-fa1a47e4-e75e-49c7-9e4f-6bab7cbcea13 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:04:07.145413 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:04:07.145413 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:04:07.145413 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:04:07.145413 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:04:07.145413 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:04:07.145413 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:04:07.145413 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:04:07.145413 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:04:07.145413 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:04:07.145413 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:04:07.145413 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:04:07.145413 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:04:07.145413 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:04:07.145413 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:04:07.146359 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:04:07.146359 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:04:07.146359 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:04:07.146359 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:04:07.146359 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:04:07.146359 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:04:07.146359 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:04:07.146359 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:04:07.146359 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( Jun 22 10:04:07.146359 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:04:07.146359 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:04:07.146359 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:04:07.146359 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:04:07.146359 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:04:07.146359 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:04:07.146359 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:04:07.146359 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:04:07.147252 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:04:07.147252 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:04:07.147252 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:04:07.147252 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:04:07.150005 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 516/1032] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jun 22 10:04:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 10:04:07.152187 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cb063a-e923-4953-953b-d2ff26fbcc67 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:04:07.262998 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cb063a-e923-4953-953b-d2ff26fbcc67 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:04:07.297998 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc960a8b-4cdd-4b3d-a8b2-5bb26925f67b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:04:07.298755 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc960a8b-4cdd-4b3d-a8b2-5bb26925f67b None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:07.298964 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc960a8b-4cdd-4b3d-a8b2-5bb26925f67b None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:07.299228 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc960a8b-4cdd-4b3d-a8b2-5bb26925f67b None admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:07.299950 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc960a8b-4cdd-4b3d-a8b2-5bb26925f67b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:04:07.300262 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc960a8b-4cdd-4b3d-a8b2-5bb26925f67b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:04:07.303100 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc960a8b-4cdd-4b3d-a8b2-5bb26925f67b None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:04:07.321122 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 517/1033] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Jun 22 10:04:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:04:07.322644 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1a47e4-e75e-49c7-9e4f-6bab7cbcea13 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:04:07.348569 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:04:07.430725 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1a47e4-e75e-49c7-9e4f-6bab7cbcea13 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:04:07.466526 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1e7fbc-3c35-43c2-ab88-4ce47e57ffb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:04:07.467330 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1e7fbc-3c35-43c2-ab88-4ce47e57ffb0 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:07.467619 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1e7fbc-3c35-43c2-ab88-4ce47e57ffb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:07.467899 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1e7fbc-3c35-43c2-ab88-4ce47e57ffb0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:07.476926 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1e7fbc-3c35-43c2-ab88-4ce47e57ffb0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:04:07.478418 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1e7fbc-3c35-43c2-ab88-4ce47e57ffb0 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:04:07.493515 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-6a1e7fbc-3c35-43c2-ab88-4ce47e57ffb0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 22 10:04:07.493515 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:04:07.493515 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:04:07.493515 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:04:07.493515 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:04:07.493515 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:04:07.493515 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:04:07.493515 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:04:07.493515 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:04:07.493515 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:04:07.493515 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:04:07.493515 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:04:07.493515 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 10:04:07.493515 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 10:04:07.493515 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 10:04:07.493515 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 10:04:07.494531 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:04:07.494531 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:04:07.494531 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 10:04:07.494531 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:04:07.494531 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 10:04:07.494531 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:04:07.494531 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:04:07.494531 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:04:07.494531 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:04:07.494531 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:04:07.494531 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:04:07.494531 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( Jun 22 10:04:07.494531 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:04:07.494531 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:04:07.494531 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:04:07.494531 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:04:07.494531 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:04:07.494531 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:04:07.500476 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:04:07.500476 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:04:07.500476 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 10:04:07.500476 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 10:04:07.500476 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 10:04:07.500476 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 10:04:07.500476 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 10:04:07.500476 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 10:04:07.500476 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 22 10:04:07.500476 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:04:07.500476 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 517/1034] 10.222.0.43 () {56 vars in 1093 bytes} [Wed Jun 22 10:04:07 2022] GET /identity/v3/users/nova => generated 82 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 10:04:07.501086 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc960a8b-4cdd-4b3d-a8b2-5bb26925f67b None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:04:07.510487 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:04:07.608542 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc960a8b-4cdd-4b3d-a8b2-5bb26925f67b None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:04:07.643007 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76923494-a5ea-4d7f-91f5-7c472c128b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:04:07.643687 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76923494-a5ea-4d7f-91f5-7c472c128b8c None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:07.643973 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76923494-a5ea-4d7f-91f5-7c472c128b8c None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:07.644881 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76923494-a5ea-4d7f-91f5-7c472c128b8c None admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:07.645762 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76923494-a5ea-4d7f-91f5-7c472c128b8c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:04:07.646081 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76923494-a5ea-4d7f-91f5-7c472c128b8c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:04:07.647526 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76923494-a5ea-4d7f-91f5-7c472c128b8c None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:04:07.669745 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 518/1035] 10.222.0.43 () {56 vars in 1133 bytes} [Wed Jun 22 10:04:07 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:04:07.671430 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1e7fbc-3c35-43c2-ab88-4ce47e57ffb0 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:04:07.758805 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:04:07.778450 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1e7fbc-3c35-43c2-ab88-4ce47e57ffb0 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:04:07.813556 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aed4bd-7c4f-43cb-a45d-e8e4ce1f19d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:04:07.814302 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aed4bd-7c4f-43cb-a45d-e8e4ce1f19d5 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:07.814574 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aed4bd-7c4f-43cb-a45d-e8e4ce1f19d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:07.814855 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aed4bd-7c4f-43cb-a45d-e8e4ce1f19d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:07.887075 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9aed4bd-7c4f-43cb-a45d-e8e4ce1f19d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:04:07.888465 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9aed4bd-7c4f-43cb-a45d-e8e4ce1f19d5 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:04:07.955330 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0084c6a0-7b03-4ac5-bd78-d296596126c4 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:07.955708 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0084c6a0-7b03-4ac5-bd78-d296596126c4 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:07.955893 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0084c6a0-7b03-4ac5-bd78-d296596126c4 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:07.957996 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 519/1036] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:04:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 10:04:07.963124 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73611e4f-1ffa-4b95-82d4-69c2f91f4bd7 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:07.963421 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73611e4f-1ffa-4b95-82d4-69c2f91f4bd7 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:07.963707 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73611e4f-1ffa-4b95-82d4-69c2f91f4bd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:07.975130 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:04:07.982992 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-73611e4f-1ffa-4b95-82d4-69c2f91f4bd7 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:04:07.984311 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-73611e4f-1ffa-4b95-82d4-69c2f91f4bd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:04:08.004079 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 518/1037] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Jun 22 10:04:07 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 10:04:08.005991 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aed4bd-7c4f-43cb-a45d-e8e4ce1f19d5 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:04:08.047947 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:04:08.058908 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 520/1038] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:04:07 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 10:04:08.084318 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73611e4f-1ffa-4b95-82d4-69c2f91f4bd7 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:04:08.119841 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aed4bd-7c4f-43cb-a45d-e8e4ce1f19d5 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:04:08.156187 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3652d5c3-c513-4866-a9f9-5a53438c8ba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:04:08.156901 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3652d5c3-c513-4866-a9f9-5a53438c8ba9 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:08.157281 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3652d5c3-c513-4866-a9f9-5a53438c8ba9 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:08.157462 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3652d5c3-c513-4866-a9f9-5a53438c8ba9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:08.169364 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3652d5c3-c513-4866-a9f9-5a53438c8ba9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:04:08.170858 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3652d5c3-c513-4866-a9f9-5a53438c8ba9 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:04:08.190908 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-3652d5c3-c513-4866-a9f9-5a53438c8ba9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:04:08.190908 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:04:08.190908 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:04:08.190908 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:04:08.190908 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:04:08.190908 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:04:08.190908 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:04:08.190908 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:04:08.190908 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:04:08.190908 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:04:08.190908 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:04:08.190908 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:04:08.190908 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:04:08.190908 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:04:08.190908 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:04:08.192146 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:04:08.192146 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:04:08.192146 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:04:08.192146 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:04:08.192146 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:04:08.192146 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:04:08.192146 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:04:08.192146 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:04:08.192146 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( Jun 22 10:04:08.192146 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:04:08.192146 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:04:08.192146 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:04:08.192146 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:04:08.192146 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:04:08.192146 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:04:08.192146 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:04:08.192146 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:04:08.193050 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:04:08.193050 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:04:08.193050 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:04:08.193050 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:04:08.193050 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 519/1039] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jun 22 10:04:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 10:04:08.195830 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73611e4f-1ffa-4b95-82d4-69c2f91f4bd7 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:04:08.197605 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3652d5c3-c513-4866-a9f9-5a53438c8ba9 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:04:08.232589 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a91daa2-1661-4b1a-8929-698eb2eae814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:04:08.232913 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:04:08.233387 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a91daa2-1661-4b1a-8929-698eb2eae814 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:08.233899 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a91daa2-1661-4b1a-8929-698eb2eae814 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:08.234160 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a91daa2-1661-4b1a-8929-698eb2eae814 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:08.235492 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a91daa2-1661-4b1a-8929-698eb2eae814 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:04:08.237161 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a91daa2-1661-4b1a-8929-698eb2eae814 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:04:08.239028 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 521/1040] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jun 22 10:04:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:04:08.244444 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a91daa2-1661-4b1a-8929-698eb2eae814 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:04:08.307416 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:04:08.309271 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3652d5c3-c513-4866-a9f9-5a53438c8ba9 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:04:08.348214 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107556e0-b3ec-4a58-8330-9bcfa02c1c85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:04:08.348705 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a91daa2-1661-4b1a-8929-698eb2eae814 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:04:08.348884 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107556e0-b3ec-4a58-8330-9bcfa02c1c85 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:08.349152 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107556e0-b3ec-4a58-8330-9bcfa02c1c85 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:08.349426 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107556e0-b3ec-4a58-8330-9bcfa02c1c85 None admin] PATH_INFO: `/v3/domains` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:08.350290 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107556e0-b3ec-4a58-8330-9bcfa02c1c85 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:04:08.350599 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107556e0-b3ec-4a58-8330-9bcfa02c1c85 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:04:08.352354 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107556e0-b3ec-4a58-8330-9bcfa02c1c85 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:04:08.365208 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 520/1041] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Jun 22 10:04:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:04:08.370641 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107556e0-b3ec-4a58-8330-9bcfa02c1c85 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:04:08.387494 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012d72cc-4f64-4c42-b523-962bf90e7928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:04:08.388168 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012d72cc-4f64-4c42-b523-962bf90e7928 None admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:08.388450 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012d72cc-4f64-4c42-b523-962bf90e7928 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:08.388724 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012d72cc-4f64-4c42-b523-962bf90e7928 None admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:08.389435 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012d72cc-4f64-4c42-b523-962bf90e7928 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:04:08.390897 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012d72cc-4f64-4c42-b523-962bf90e7928 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:04:08.413106 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 522/1042] 10.222.0.43 () {60 vars in 1132 bytes} [Wed Jun 22 10:04:08 2022] POST /identity/v3/users => generated 285 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 10:04:08.414438 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b4b83e-3587-408b-a7a6-617ced3796e6 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:08.414726 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b4b83e-3587-408b-a7a6-617ced3796e6 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:08.415004 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b4b83e-3587-408b-a7a6-617ced3796e6 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:08.416242 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 523/1043] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:04:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:04:08.421937 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253ab7cf-29b4-402a-b94c-cf06b6dab137 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:08.422227 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253ab7cf-29b4-402a-b94c-cf06b6dab137 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:08.422509 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253ab7cf-29b4-402a-b94c-cf06b6dab137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:08.440194 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-253ab7cf-29b4-402a-b94c-cf06b6dab137 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:04:08.442224 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-253ab7cf-29b4-402a-b94c-cf06b6dab137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:04:08.497257 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:04:08.507597 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107556e0-b3ec-4a58-8330-9bcfa02c1c85 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:04:08.524546 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 524/1044] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:04:08 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 10:04:08.548405 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253ab7cf-29b4-402a-b94c-cf06b6dab137 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:04:08.548724 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94e1f56-009e-4213-9d72-0c400b84ec4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:04:08.549537 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94e1f56-009e-4213-9d72-0c400b84ec4a None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:08.549853 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94e1f56-009e-4213-9d72-0c400b84ec4a None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:08.550131 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94e1f56-009e-4213-9d72-0c400b84ec4a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:08.559843 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94e1f56-009e-4213-9d72-0c400b84ec4a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:04:08.560617 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94e1f56-009e-4213-9d72-0c400b84ec4a None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:04:08.579516 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-f94e1f56-009e-4213-9d72-0c400b84ec4a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:04:08.579516 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:04:08.579516 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:04:08.579516 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:04:08.579516 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:04:08.579516 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:04:08.579516 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:04:08.579516 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:04:08.579516 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:04:08.579516 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:04:08.579516 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:04:08.579516 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:04:08.579516 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 10:04:08.579516 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 10:04:08.579516 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 10:04:08.580996 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 10:04:08.580996 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:04:08.580996 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:04:08.580996 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:04:08.580996 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:04:08.580996 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:04:08.580996 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:04:08.580996 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:04:08.580996 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( Jun 22 10:04:08.580996 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:04:08.580996 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:04:08.580996 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:04:08.580996 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:04:08.580996 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:04:08.580996 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:04:08.580996 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:04:08.580996 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:04:08.582078 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 10:04:08.582078 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 10:04:08.582078 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 10:04:08.582078 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 10:04:08.582078 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 10:04:08.582078 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 10:04:08.582078 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:04:08.582078 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:04:08.582078 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 521/1045] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Jun 22 10:04:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 10:04:08.587336 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94e1f56-009e-4213-9d72-0c400b84ec4a None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:04:08.612119 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:04:08.679571 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253ab7cf-29b4-402a-b94c-cf06b6dab137 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:04:08.708307 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94e1f56-009e-4213-9d72-0c400b84ec4a None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:04:08.718343 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6132b9f1-32e9-4da6-ae54-46a2d7094afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:04:08.719137 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6132b9f1-32e9-4da6-ae54-46a2d7094afb None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:08.719424 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6132b9f1-32e9-4da6-ae54-46a2d7094afb None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:08.719704 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6132b9f1-32e9-4da6-ae54-46a2d7094afb None admin] PATH_INFO: `/v3/services/image` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:08.720354 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6132b9f1-32e9-4da6-ae54-46a2d7094afb None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:04:08.721737 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6132b9f1-32e9-4da6-ae54-46a2d7094afb None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:04:08.734030 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-6132b9f1-32e9-4da6-ae54-46a2d7094afb None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 22 10:04:08.734030 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:04:08.734030 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 10:04:08.734030 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 10:04:08.734030 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 10:04:08.734030 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 10:04:08.734030 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 10:04:08.734030 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 10:04:08.734030 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 22 10:04:08.734030 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:04:08.734030 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 10:04:08.734030 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:04:08.734030 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:04:08.734030 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:04:08.734030 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:04:08.734030 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:04:08.734030 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:04:08.735035 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:04:08.735035 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:04:08.735035 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:04:08.735035 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:04:08.735035 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:04:08.735035 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:04:08.735035 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 10:04:08.735035 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 10:04:08.735035 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 10:04:08.735035 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 10:04:08.735035 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:04:08.735035 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:04:08.735035 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:04:08.735035 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:04:08.735035 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:04:08.735035 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:04:08.735882 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:04:08.735882 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jun 22 10:04:08.735882 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:04:08.735882 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:04:08.735882 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:04:08.735882 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:04:08.735882 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:04:08.735882 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:04:08.735882 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:04:08.735882 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:04:08.735882 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 10:04:08.735882 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 10:04:08.735882 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 22 10:04:08.735882 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:04:08.735882 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 525/1046] 10.222.0.43 () {56 vars in 1105 bytes} [Wed Jun 22 10:04:08 2022] GET /identity/v3/services/image => generated 86 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 10:04:08.741558 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6132b9f1-32e9-4da6-ae54-46a2d7094afb None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:04:08.749638 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b103389e-ffc3-476c-b593-dc4d0b5c11b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:04:08.750335 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b103389e-ffc3-476c-b593-dc4d0b5c11b3 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:08.750960 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b103389e-ffc3-476c-b593-dc4d0b5c11b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:08.750960 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b103389e-ffc3-476c-b593-dc4d0b5c11b3 None admin] PATH_INFO: `/v3/projects` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:08.751663 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b103389e-ffc3-476c-b593-dc4d0b5c11b3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:04:08.751972 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b103389e-ffc3-476c-b593-dc4d0b5c11b3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:04:08.753405 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b103389e-ffc3-476c-b593-dc4d0b5c11b3 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:04:08.771468 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 522/1047] 10.222.0.43 () {56 vars in 1148 bytes} [Wed Jun 22 10:04:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:04:08.772346 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b103389e-ffc3-476c-b593-dc4d0b5c11b3 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:04:08.790044 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:04:08.849565 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6132b9f1-32e9-4da6-ae54-46a2d7094afb None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:04:08.864490 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:04:08.882387 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b103389e-ffc3-476c-b593-dc4d0b5c11b3 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:04:08.887799 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce99c8c-b725-498b-90df-1e218d842339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:04:08.888468 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce99c8c-b725-498b-90df-1e218d842339 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:08.888765 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce99c8c-b725-498b-90df-1e218d842339 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:08.889034 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce99c8c-b725-498b-90df-1e218d842339 None admin] PATH_INFO: `/v3/services` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:08.889869 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce99c8c-b725-498b-90df-1e218d842339 None admin] RBAC: Adding query filter params (name=image) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:04:08.890186 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce99c8c-b725-498b-90df-1e218d842339 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:04:08.891685 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce99c8c-b725-498b-90df-1e218d842339 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:04:08.901912 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 526/1048] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jun 22 10:04:08 2022] GET /identity/v3/services?name=image => generated 122 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:04:08.902614 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce99c8c-b725-498b-90df-1e218d842339 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:04:08.924171 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78daf36-2b93-4afc-9445-01d3c3810edc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:04:08.924836 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78daf36-2b93-4afc-9445-01d3c3810edc None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:08.926123 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78daf36-2b93-4afc-9445-01d3c3810edc None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:08.926414 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78daf36-2b93-4afc-9445-01d3c3810edc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:08.927261 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78daf36-2b93-4afc-9445-01d3c3810edc None admin] RBAC: Adding query filter params (role.id=23300d26129048399321250a40367eb7, scope.project.id=e03f1c17e0884f188231d2949dc6f956, user.id=158a49aa3750478a84bf71b9aad24397) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:04:08.927578 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78daf36-2b93-4afc-9445-01d3c3810edc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:04:08.929033 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78daf36-2b93-4afc-9445-01d3c3810edc None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:04:08.946324 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 523/1049] 10.222.0.43 () {56 vars in 1374 bytes} [Wed Jun 22 10:04:08 2022] GET /identity/v3/role_assignments?user.id=158a49aa3750478a84bf71b9aad24397&scope.project.id=e03f1c17e0884f188231d2949dc6f956&role.id=23300d26129048399321250a40367eb7 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:04:09.030952 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce99c8c-b725-498b-90df-1e218d842339 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:04:09.067397 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903fa9fb-003e-4a5f-8ef0-94136570e303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:04:09.068083 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903fa9fb-003e-4a5f-8ef0-94136570e303 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:09.068373 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903fa9fb-003e-4a5f-8ef0-94136570e303 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:09.068659 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903fa9fb-003e-4a5f-8ef0-94136570e303 None admin] PATH_INFO: `/v3/services` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:09.069460 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903fa9fb-003e-4a5f-8ef0-94136570e303 None admin] RBAC: Adding query filter params (type=image) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:04:09.069805 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903fa9fb-003e-4a5f-8ef0-94136570e303 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:04:09.071218 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903fa9fb-003e-4a5f-8ef0-94136570e303 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:04:09.076972 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 527/1050] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jun 22 10:04:08 2022] GET /identity/v3/services?type=image => generated 350 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:04:09.083220 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78daf36-2b93-4afc-9445-01d3c3810edc None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:04:09.172152 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:04:09.195739 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78daf36-2b93-4afc-9445-01d3c3810edc None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:04:09.231011 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6778403-b84e-41fa-8882-6710d1b4f750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:04:09.231594 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6778403-b84e-41fa-8882-6710d1b4f750 None admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:09.231885 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6778403-b84e-41fa-8882-6710d1b4f750 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:09.232168 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6778403-b84e-41fa-8882-6710d1b4f750 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:09.232919 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6778403-b84e-41fa-8882-6710d1b4f750 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:04:09.234330 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6778403-b84e-41fa-8882-6710d1b4f750 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:04:09.255466 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 524/1051] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Jun 22 10:04:09 2022] POST /identity/v3/endpoints => generated 327 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:04:10.536690 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e88fc6-866d-4c70-9708-a921244481b5 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:10.537309 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e88fc6-866d-4c70-9708-a921244481b5 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:10.537309 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e88fc6-866d-4c70-9708-a921244481b5 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:10.538764 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 528/1052] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:04:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:04:10.543841 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134a23a6-cbf3-4970-aed6-3af651fa6a63 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:10.544295 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134a23a6-cbf3-4970-aed6-3af651fa6a63 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:10.544394 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134a23a6-cbf3-4970-aed6-3af651fa6a63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:10.560876 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-134a23a6-cbf3-4970-aed6-3af651fa6a63 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:04:10.562075 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-134a23a6-cbf3-4970-aed6-3af651fa6a63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:04:10.638092 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 525/1053] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:04:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 10:04:10.661280 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e88fc6-866d-4c70-9708-a921244481b5 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:04:10.704472 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:04:10.764909 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e88fc6-866d-4c70-9708-a921244481b5 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:04:10.800157 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb2dbea-8140-4fe9-aa40-ccf7b0dbc244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:04:10.801333 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb2dbea-8140-4fe9-aa40-ccf7b0dbc244 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:10.801641 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb2dbea-8140-4fe9-aa40-ccf7b0dbc244 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:10.801991 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb2dbea-8140-4fe9-aa40-ccf7b0dbc244 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:10.812779 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb2dbea-8140-4fe9-aa40-ccf7b0dbc244 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:04:10.820395 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-7cb2dbea-8140-4fe9-aa40-ccf7b0dbc244 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 10:04:10.820395 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:04:10.820395 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:04:10.820395 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:04:10.820395 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:04:10.820395 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:04:10.820395 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:04:10.820395 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:04:10.820395 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:04:10.820395 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:04:10.820395 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:04:10.820395 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:04:10.820395 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:04:10.820395 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:04:10.820395 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:04:10.820395 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:04:10.821304 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:04:10.821304 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:04:10.821304 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:04:10.821304 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:04:10.821304 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:04:10.821304 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:04:10.821304 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:04:10.821304 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:04:10.821304 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:04:10.821304 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:04:10.821304 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:04:10.821304 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jun 22 10:04:10.821304 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:04:10.821304 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:04:10.821304 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:04:10.821304 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:04:10.822492 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:04:10.822492 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:04:10.822492 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:04:10.822492 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:04:10.822492 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:04:10.822492 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:04:10.822492 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:04:10.822492 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:04:10.822492 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:04:10.822492 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:04:10.822492 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 10:04:10.822492 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:04:10.826029 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 529/1054] 10.222.0.43 () {56 vars in 1096 bytes} [Wed Jun 22 10:04:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:04:10.827449 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134a23a6-cbf3-4970-aed6-3af651fa6a63 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:04:10.886339 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:04:10.930060 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134a23a6-cbf3-4970-aed6-3af651fa6a63 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:04:10.965197 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5ed60b-6be2-420c-8768-d6c9701623ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:04:10.965526 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5ed60b-6be2-420c-8768-d6c9701623ce None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:10.965769 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5ed60b-6be2-420c-8768-d6c9701623ce None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:10.966050 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5ed60b-6be2-420c-8768-d6c9701623ce None admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:10.966807 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5ed60b-6be2-420c-8768-d6c9701623ce None admin] RBAC: Adding query filter params (name=admin) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:04:10.967113 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5ed60b-6be2-420c-8768-d6c9701623ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:04:10.968689 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5ed60b-6be2-420c-8768-d6c9701623ce None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:04:10.982879 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 526/1055] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Jun 22 10:04:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:04:10.984461 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb2dbea-8140-4fe9-aa40-ccf7b0dbc244 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:04:11.052266 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9342a230-1bb1-40bd-a097-db40865c2185 None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:11.052585 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9342a230-1bb1-40bd-a097-db40865c2185 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:11.052874 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9342a230-1bb1-40bd-a097-db40865c2185 None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:11.054598 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 527/1056] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:04:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 10:04:11.059284 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec130282-1227-45da-85f3-63eb91fe6be0 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:11.059582 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec130282-1227-45da-85f3-63eb91fe6be0 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:11.059870 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec130282-1227-45da-85f3-63eb91fe6be0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:11.076755 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-ec130282-1227-45da-85f3-63eb91fe6be0 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:04:11.077962 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-ec130282-1227-45da-85f3-63eb91fe6be0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:04:11.105212 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:04:11.108040 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb2dbea-8140-4fe9-aa40-ccf7b0dbc244 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:04:11.144374 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf24f735-95f3-45c4-b83b-3e01cff91348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:04:11.145246 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf24f735-95f3-45c4-b83b-3e01cff91348 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:11.145530 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf24f735-95f3-45c4-b83b-3e01cff91348 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:11.145837 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf24f735-95f3-45c4-b83b-3e01cff91348 None admin] PATH_INFO: `/v3/users/4fc3c8bf65dd4af5b155b0d53d0cd9ba` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:11.152652 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 528/1057] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:04:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 10:04:11.160435 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf24f735-95f3-45c4-b83b-3e01cff91348 None admin] RBAC: Authorizing `identity:get_user(user_id=4fc3c8bf65dd4af5b155b0d53d0cd9ba)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:04:11.161853 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf24f735-95f3-45c4-b83b-3e01cff91348 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:04:11.168344 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 530/1058] 10.222.0.43 () {56 vars in 1177 bytes} [Wed Jun 22 10:04:10 2022] GET /identity/v3/users/4fc3c8bf65dd4af5b155b0d53d0cd9ba => generated 285 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:04:11.169127 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec130282-1227-45da-85f3-63eb91fe6be0 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:04:11.175029 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf24f735-95f3-45c4-b83b-3e01cff91348 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:04:11.228689 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:04:11.281622 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec130282-1227-45da-85f3-63eb91fe6be0 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:04:11.289135 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf24f735-95f3-45c4-b83b-3e01cff91348 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:04:11.323539 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e889398-9879-4b7f-8f8a-2a625b1e902e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:04:11.324075 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e889398-9879-4b7f-8f8a-2a625b1e902e None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:11.324364 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e889398-9879-4b7f-8f8a-2a625b1e902e None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:11.324648 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e889398-9879-4b7f-8f8a-2a625b1e902e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:11.340958 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb2afd6-fd2f-4bdf-a038-5b31a5fef6bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:04:11.341812 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb2afd6-fd2f-4bdf-a038-5b31a5fef6bb None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:11.342098 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb2afd6-fd2f-4bdf-a038-5b31a5fef6bb None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:11.342381 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb2afd6-fd2f-4bdf-a038-5b31a5fef6bb None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:11.356648 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb2afd6-fd2f-4bdf-a038-5b31a5fef6bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:04:11.366154 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-dcb2afd6-fd2f-4bdf-a038-5b31a5fef6bb None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 22 10:04:11.366154 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:04:11.366154 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:04:11.366154 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:04:11.366154 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:04:11.366154 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:04:11.366154 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:04:11.366154 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:04:11.366154 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:04:11.366154 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:04:11.366154 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:04:11.366154 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:04:11.366154 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:04:11.366154 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:04:11.366154 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:04:11.366154 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:04:11.367112 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:04:11.367112 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:04:11.367112 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:04:11.367112 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:04:11.367112 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:04:11.367112 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:04:11.367112 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:04:11.367112 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:04:11.367112 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:04:11.367112 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:04:11.367112 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:04:11.367112 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jun 22 10:04:11.367112 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:04:11.367112 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:04:11.367112 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:04:11.367112 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:04:11.367953 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:04:11.367953 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:04:11.367953 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:04:11.367953 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:04:11.367953 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:04:11.367953 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:04:11.367953 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:04:11.367953 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:04:11.367953 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:04:11.367953 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:04:11.367953 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 22 10:04:11.367953 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:04:11.367953 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 531/1059] 10.222.0.43 () {56 vars in 1120 bytes} [Wed Jun 22 10:04:11 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 10:04:11.373399 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb2afd6-fd2f-4bdf-a038-5b31a5fef6bb None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:04:11.393152 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:04:11.402815 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e889398-9879-4b7f-8f8a-2a625b1e902e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:04:11.404295 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e889398-9879-4b7f-8f8a-2a625b1e902e None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:04:11.456293 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:04:11.474834 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb2afd6-fd2f-4bdf-a038-5b31a5fef6bb None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:04:11.504358 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 529/1060] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Jun 22 10:04:11 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 22 10:04:11.505883 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdab091c-0c1f-433c-ae39-1f8fb592b287 None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:11.506124 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdab091c-0c1f-433c-ae39-1f8fb592b287 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:11.506406 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdab091c-0c1f-433c-ae39-1f8fb592b287 None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:11.507672 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 530/1061] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:04:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:04:11.510008 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdab091c-0c1f-433c-ae39-1f8fb592b287 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:04:11.513285 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3613d780-7810-43f8-8f7c-c523c806ee78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:04:11.514000 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3613d780-7810-43f8-8f7c-c523c806ee78 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:11.514288 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3613d780-7810-43f8-8f7c-c523c806ee78 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:11.514571 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3613d780-7810-43f8-8f7c-c523c806ee78 None admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:11.515327 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3613d780-7810-43f8-8f7c-c523c806ee78 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:04:11.515640 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3613d780-7810-43f8-8f7c-c523c806ee78 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:04:11.517010 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3613d780-7810-43f8-8f7c-c523c806ee78 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:04:11.525995 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 532/1062] 10.222.0.43 () {56 vars in 1115 bytes} [Wed Jun 22 10:04:11 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:04:11.527172 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd2de5c-26c7-4014-bfc7-4a816908345f None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:11.527463 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd2de5c-26c7-4014-bfc7-4a816908345f None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:11.527748 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd2de5c-26c7-4014-bfc7-4a816908345f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:11.544033 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-2bd2de5c-26c7-4014-bfc7-4a816908345f None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:04:11.545234 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-2bd2de5c-26c7-4014-bfc7-4a816908345f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:04:11.611472 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 533/1063] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:04:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 10:04:11.612686 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd2de5c-26c7-4014-bfc7-4a816908345f None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:04:11.621413 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdab091c-0c1f-433c-ae39-1f8fb592b287 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:04:11.624080 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:04:11.656378 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26695bed-e130-40a9-9398-cb0d5bdb44b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:04:11.657248 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26695bed-e130-40a9-9398-cb0d5bdb44b9 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:11.657535 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26695bed-e130-40a9-9398-cb0d5bdb44b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:11.657846 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26695bed-e130-40a9-9398-cb0d5bdb44b9 None admin] PATH_INFO: `/v3/projects/7da10dc3a22248f5afb7f75f10ae0a64` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:11.659020 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26695bed-e130-40a9-9398-cb0d5bdb44b9 None admin] RBAC: Authorizing `identity:get_project(project_id=7da10dc3a22248f5afb7f75f10ae0a64)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:04:11.660601 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26695bed-e130-40a9-9398-cb0d5bdb44b9 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:04:11.662350 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 531/1064] 10.222.0.43 () {56 vars in 1186 bytes} [Wed Jun 22 10:04:11 2022] GET /identity/v3/projects/7da10dc3a22248f5afb7f75f10ae0a64 => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:04:11.663115 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26695bed-e130-40a9-9398-cb0d5bdb44b9 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:04:11.686829 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:04:11.713092 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd2de5c-26c7-4014-bfc7-4a816908345f None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:04:11.747017 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9edfce-4736-416b-8e2c-06e6313b709d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:04:11.747816 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9edfce-4736-416b-8e2c-06e6313b709d None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:11.748381 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9edfce-4736-416b-8e2c-06e6313b709d None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:11.748381 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9edfce-4736-416b-8e2c-06e6313b709d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:11.759070 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9edfce-4736-416b-8e2c-06e6313b709d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:04:11.760551 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9edfce-4736-416b-8e2c-06e6313b709d None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:04:11.767116 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26695bed-e130-40a9-9398-cb0d5bdb44b9 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:04:11.779834 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-6c9edfce-4736-416b-8e2c-06e6313b709d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:04:11.779834 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:04:11.779834 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:04:11.779834 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:04:11.779834 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:04:11.779834 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:04:11.779834 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:04:11.779834 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:04:11.779834 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:04:11.779834 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:04:11.779834 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:04:11.779834 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:04:11.779834 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:04:11.779834 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:04:11.779834 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:04:11.780723 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:04:11.780723 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:04:11.780723 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:04:11.780723 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:04:11.780723 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:04:11.780723 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:04:11.780723 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:04:11.780723 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:04:11.780723 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jun 22 10:04:11.780723 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:04:11.780723 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:04:11.780723 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:04:11.780723 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:04:11.780723 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:04:11.780723 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:04:11.780723 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:04:11.780723 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:04:11.781620 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:04:11.781620 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:04:11.781620 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:04:11.781620 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:04:11.781620 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 534/1065] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jun 22 10:04:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:04:11.782481 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9edfce-4736-416b-8e2c-06e6313b709d None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:04:11.805683 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d41a08e-d3b0-4698-8e27-6b0e785ffade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:04:11.806362 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d41a08e-d3b0-4698-8e27-6b0e785ffade None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:11.806659 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d41a08e-d3b0-4698-8e27-6b0e785ffade None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:11.806941 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d41a08e-d3b0-4698-8e27-6b0e785ffade None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:11.843969 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:04:11.875318 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d41a08e-d3b0-4698-8e27-6b0e785ffade None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:04:11.876713 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d41a08e-d3b0-4698-8e27-6b0e785ffade None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:04:11.882743 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9edfce-4736-416b-8e2c-06e6313b709d None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:04:11.897253 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:04:11.917479 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7502dd-e50e-446c-bdac-2da0ebfb7359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:04:11.918260 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7502dd-e50e-446c-bdac-2da0ebfb7359 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:11.918550 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7502dd-e50e-446c-bdac-2da0ebfb7359 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:11.918833 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7502dd-e50e-446c-bdac-2da0ebfb7359 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:11.919674 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7502dd-e50e-446c-bdac-2da0ebfb7359 None admin] RBAC: Adding query filter params (role.id=26d9c2ab5dfc4e6d9ca80c6014123906, scope.project.id=7da10dc3a22248f5afb7f75f10ae0a64, user.id=4fc3c8bf65dd4af5b155b0d53d0cd9ba) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:04:11.919988 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7502dd-e50e-446c-bdac-2da0ebfb7359 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:04:11.921429 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7502dd-e50e-446c-bdac-2da0ebfb7359 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:04:11.927072 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 535/1066] 10.222.0.43 () {56 vars in 1374 bytes} [Wed Jun 22 10:04:11 2022] GET /identity/v3/role_assignments?user.id=4fc3c8bf65dd4af5b155b0d53d0cd9ba&scope.project.id=7da10dc3a22248f5afb7f75f10ae0a64&role.id=26d9c2ab5dfc4e6d9ca80c6014123906 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:04:11.927853 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7502dd-e50e-446c-bdac-2da0ebfb7359 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:04:11.996016 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 532/1067] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Jun 22 10:04:11 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 10:04:12.002444 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d41a08e-d3b0-4698-8e27-6b0e785ffade None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:04:12.048166 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7502dd-e50e-446c-bdac-2da0ebfb7359 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:04:12.080122 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:04:12.092070 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6d450e-aa15-42ff-a701-6717a812ccb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:04:12.092758 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6d450e-aa15-42ff-a701-6717a812ccb2 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:12.093080 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6d450e-aa15-42ff-a701-6717a812ccb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:12.093323 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6d450e-aa15-42ff-a701-6717a812ccb2 None admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:12.094169 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6d450e-aa15-42ff-a701-6717a812ccb2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:04:12.094386 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6d450e-aa15-42ff-a701-6717a812ccb2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:04:12.095787 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6d450e-aa15-42ff-a701-6717a812ccb2 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:04:12.115596 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 536/1068] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Jun 22 10:04:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:04:12.116679 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6d450e-aa15-42ff-a701-6717a812ccb2 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:04:12.119963 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d41a08e-d3b0-4698-8e27-6b0e785ffade None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:04:12.142858 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:04:12.160523 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d4b5f6-06f0-46e9-94e3-d1bfb369aa74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:04:12.161387 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d4b5f6-06f0-46e9-94e3-d1bfb369aa74 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:12.161678 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d4b5f6-06f0-46e9-94e3-d1bfb369aa74 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:12.162357 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d4b5f6-06f0-46e9-94e3-d1bfb369aa74 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:12.173017 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d4b5f6-06f0-46e9-94e3-d1bfb369aa74 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:04:12.174559 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d4b5f6-06f0-46e9-94e3-d1bfb369aa74 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:04:12.193521 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-66d4b5f6-06f0-46e9-94e3-d1bfb369aa74 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:04:12.193521 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:04:12.193521 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:04:12.193521 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:04:12.193521 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:04:12.193521 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:04:12.193521 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:04:12.193521 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:04:12.193521 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:04:12.193521 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:04:12.193521 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:04:12.193521 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:04:12.193521 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:04:12.193521 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:04:12.193521 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:04:12.195075 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:04:12.195075 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:04:12.195075 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:04:12.195075 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:04:12.195075 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:04:12.195075 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:04:12.195075 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:04:12.195075 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:04:12.195075 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( Jun 22 10:04:12.195075 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:04:12.195075 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:04:12.195075 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:04:12.195075 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:04:12.195075 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:04:12.195075 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:04:12.195075 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:04:12.195075 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:04:12.196244 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:04:12.196244 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:04:12.196244 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:04:12.196244 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:04:12.196244 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 533/1069] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jun 22 10:04:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 10:04:12.200438 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d4b5f6-06f0-46e9-94e3-d1bfb369aa74 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:04:12.226753 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6d450e-aa15-42ff-a701-6717a812ccb2 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:04:12.265475 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741953e5-e4aa-4ccd-ac58-709b6d3eb55e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:04:12.266296 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741953e5-e4aa-4ccd-ac58-709b6d3eb55e None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:12.266614 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741953e5-e4aa-4ccd-ac58-709b6d3eb55e None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:12.266852 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741953e5-e4aa-4ccd-ac58-709b6d3eb55e None admin] PATH_INFO: `/v3/users/nova` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:12.275236 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741953e5-e4aa-4ccd-ac58-709b6d3eb55e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:04:12.276685 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741953e5-e4aa-4ccd-ac58-709b6d3eb55e None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:04:12.291874 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-741953e5-e4aa-4ccd-ac58-709b6d3eb55e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 22 10:04:12.291874 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:04:12.291874 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:04:12.291874 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:04:12.291874 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:04:12.291874 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:04:12.291874 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:04:12.291874 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:04:12.291874 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:04:12.291874 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:04:12.291874 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:04:12.291874 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:04:12.291874 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 10:04:12.291874 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 10:04:12.291874 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 10:04:12.291874 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 10:04:12.292878 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:04:12.292878 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:04:12.292878 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 10:04:12.292878 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:04:12.292878 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 10:04:12.292878 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:04:12.292878 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:04:12.292878 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:04:12.292878 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:04:12.292878 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:04:12.292878 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:04:12.292878 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jun 22 10:04:12.292878 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:04:12.292878 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:04:12.292878 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:04:12.292878 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:04:12.292878 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:04:12.292878 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:04:12.293879 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:04:12.293879 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:04:12.293879 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 10:04:12.293879 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 10:04:12.293879 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 10:04:12.293879 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 10:04:12.293879 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 10:04:12.293879 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 10:04:12.293879 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 22 10:04:12.293879 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:04:12.293879 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 537/1070] 10.222.0.43 () {56 vars in 1093 bytes} [Wed Jun 22 10:04:12 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 10:04:12.298841 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741953e5-e4aa-4ccd-ac58-709b6d3eb55e None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:04:12.316639 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d4b5f6-06f0-46e9-94e3-d1bfb369aa74 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:04:12.349074 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:04:12.355161 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d79f37-9e91-44f5-9e08-751b37fcf5ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:04:12.355838 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d79f37-9e91-44f5-9e08-751b37fcf5ab None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:12.356124 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d79f37-9e91-44f5-9e08-751b37fcf5ab None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:12.356849 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d79f37-9e91-44f5-9e08-751b37fcf5ab None admin] PATH_INFO: `/v3/domains` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:12.357599 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d79f37-9e91-44f5-9e08-751b37fcf5ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:04:12.357940 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d79f37-9e91-44f5-9e08-751b37fcf5ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:04:12.359335 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d79f37-9e91-44f5-9e08-751b37fcf5ab None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:04:12.372399 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 534/1071] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Jun 22 10:04:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:04:12.412257 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741953e5-e4aa-4ccd-ac58-709b6d3eb55e None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:04:12.452760 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72385fc-24c6-4816-bf91-e1fe5959acba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:04:12.453806 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72385fc-24c6-4816-bf91-e1fe5959acba None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:12.454281 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72385fc-24c6-4816-bf91-e1fe5959acba None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:12.454743 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72385fc-24c6-4816-bf91-e1fe5959acba None admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:12.455838 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72385fc-24c6-4816-bf91-e1fe5959acba None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:04:12.456356 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72385fc-24c6-4816-bf91-e1fe5959acba None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:04:12.458696 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72385fc-24c6-4816-bf91-e1fe5959acba None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:04:12.479932 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 538/1072] 10.222.0.43 () {56 vars in 1133 bytes} [Wed Jun 22 10:04:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:04:12.485544 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d79f37-9e91-44f5-9e08-751b37fcf5ab None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:04:12.521125 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:04:12.595935 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d79f37-9e91-44f5-9e08-751b37fcf5ab None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:04:12.639923 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4989338b-ec04-4251-900c-6eae43972b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:04:12.640718 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4989338b-ec04-4251-900c-6eae43972b1a None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:12.641005 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4989338b-ec04-4251-900c-6eae43972b1a None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:12.641281 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4989338b-ec04-4251-900c-6eae43972b1a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:12.659313 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4989338b-ec04-4251-900c-6eae43972b1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:04:12.661716 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4989338b-ec04-4251-900c-6eae43972b1a None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:04:12.682292 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-4989338b-ec04-4251-900c-6eae43972b1a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:04:12.682292 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:04:12.682292 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:04:12.682292 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:04:12.682292 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:04:12.682292 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:04:12.682292 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:04:12.682292 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:04:12.682292 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:04:12.682292 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:04:12.682292 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:04:12.682292 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:04:12.682292 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:04:12.682292 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:04:12.682292 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:04:12.684003 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:04:12.684003 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:04:12.684003 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:04:12.684003 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:04:12.684003 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:04:12.684003 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:04:12.684003 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:04:12.684003 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:04:12.684003 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( Jun 22 10:04:12.684003 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:04:12.684003 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:04:12.684003 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:04:12.684003 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:04:12.684003 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:04:12.684003 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:04:12.684003 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:04:12.684003 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:04:12.685463 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:04:12.685463 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:04:12.685463 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:04:12.685463 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:04:12.685463 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 535/1073] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jun 22 10:04:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:04:12.693385 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72385fc-24c6-4816-bf91-e1fe5959acba None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:04:12.793357 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72385fc-24c6-4816-bf91-e1fe5959acba None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:04:12.795765 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:04:12.829627 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6581da40-6fa7-44a8-bf0d-d1846bba6c2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:04:12.830319 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6581da40-6fa7-44a8-bf0d-d1846bba6c2a None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:12.830603 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6581da40-6fa7-44a8-bf0d-d1846bba6c2a None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:12.830883 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6581da40-6fa7-44a8-bf0d-d1846bba6c2a None admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:12.831702 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6581da40-6fa7-44a8-bf0d-d1846bba6c2a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:04:12.832037 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6581da40-6fa7-44a8-bf0d-d1846bba6c2a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:04:12.833476 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6581da40-6fa7-44a8-bf0d-d1846bba6c2a None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:04:12.844413 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 539/1074] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Jun 22 10:04:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:04:12.850877 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4989338b-ec04-4251-900c-6eae43972b1a None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:04:12.935315 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:04:12.951453 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4989338b-ec04-4251-900c-6eae43972b1a None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:04:12.993740 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3412978b-051a-4306-b8d6-1e2d4eeaf0ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:04:12.994542 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3412978b-051a-4306-b8d6-1e2d4eeaf0ab None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:12.994823 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3412978b-051a-4306-b8d6-1e2d4eeaf0ab None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:12.995101 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3412978b-051a-4306-b8d6-1e2d4eeaf0ab None admin] PATH_INFO: `/v3/projects/service` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:13.001786 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3412978b-051a-4306-b8d6-1e2d4eeaf0ab None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:04:13.003234 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3412978b-051a-4306-b8d6-1e2d4eeaf0ab None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:04:13.017607 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-3412978b-051a-4306-b8d6-1e2d4eeaf0ab None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:04:13.017607 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:04:13.017607 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:04:13.017607 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:04:13.017607 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:04:13.017607 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:04:13.017607 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:04:13.017607 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:04:13.017607 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:04:13.017607 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:04:13.017607 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:04:13.017607 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:04:13.017607 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 10:04:13.017607 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 10:04:13.017607 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 10:04:13.018606 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 10:04:13.018606 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:04:13.018606 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:04:13.018606 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:04:13.018606 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:04:13.018606 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:04:13.018606 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:04:13.018606 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:04:13.018606 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( Jun 22 10:04:13.018606 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:04:13.018606 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:04:13.018606 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:04:13.018606 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:04:13.018606 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:04:13.018606 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:04:13.018606 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:04:13.018606 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:04:13.020120 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 10:04:13.020120 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 10:04:13.020120 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 10:04:13.020120 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 10:04:13.020120 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 10:04:13.020120 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 10:04:13.020120 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:04:13.020120 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:04:13.020120 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 536/1075] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Jun 22 10:04:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:04:13.025164 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6581da40-6fa7-44a8-bf0d-d1846bba6c2a None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:04:13.130875 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6581da40-6fa7-44a8-bf0d-d1846bba6c2a None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:04:13.163044 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79b7f3e-cbb0-4b05-b33d-488bc4a8ad18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:04:13.163697 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79b7f3e-cbb0-4b05-b33d-488bc4a8ad18 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:13.163981 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79b7f3e-cbb0-4b05-b33d-488bc4a8ad18 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:13.164260 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79b7f3e-cbb0-4b05-b33d-488bc4a8ad18 None admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:13.165044 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79b7f3e-cbb0-4b05-b33d-488bc4a8ad18 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:04:13.165356 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79b7f3e-cbb0-4b05-b33d-488bc4a8ad18 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:04:13.166820 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79b7f3e-cbb0-4b05-b33d-488bc4a8ad18 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:04:13.179233 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 540/1076] 10.222.0.43 () {56 vars in 1148 bytes} [Wed Jun 22 10:04:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:04:13.184987 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3412978b-051a-4306-b8d6-1e2d4eeaf0ab None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:04:13.283758 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3412978b-051a-4306-b8d6-1e2d4eeaf0ab None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:04:13.316874 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd739b3-0d8c-4081-8730-f0a58a873ba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:04:13.317766 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd739b3-0d8c-4081-8730-f0a58a873ba9 None admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:13.318054 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd739b3-0d8c-4081-8730-f0a58a873ba9 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:13.318328 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd739b3-0d8c-4081-8730-f0a58a873ba9 None admin] PATH_INFO: `/v3/projects/e03f1c17e0884f188231d2949dc6f956/users/158a49aa3750478a84bf71b9aad24397/roles/23300d26129048399321250a40367eb7` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:13.320468 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd739b3-0d8c-4081-8730-f0a58a873ba9 None admin] RBAC: Authorizing `identity:create_grant(project_id=e03f1c17e0884f188231d2949dc6f956, user_id=158a49aa3750478a84bf71b9aad24397, role_id=23300d26129048399321250a40367eb7)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:04:13.321935 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd739b3-0d8c-4081-8730-f0a58a873ba9 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:04:13.335564 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 537/1077] 10.222.0.43 () {58 vars in 1439 bytes} [Wed Jun 22 10:04:13 2022] PUT /identity/v3/projects/e03f1c17e0884f188231d2949dc6f956/users/158a49aa3750478a84bf71b9aad24397/roles/23300d26129048399321250a40367eb7 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:04:14.012024 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea474269-369e-4882-b239-3613d8aa60c9 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:14.012556 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea474269-369e-4882-b239-3613d8aa60c9 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:14.012644 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea474269-369e-4882-b239-3613d8aa60c9 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:14.013984 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 541/1078] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:04:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:04:14.019789 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00378ef-2b20-4db4-838e-72934176ec26 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:14.020200 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00378ef-2b20-4db4-838e-72934176ec26 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:14.020338 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00378ef-2b20-4db4-838e-72934176ec26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:14.026384 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:04:14.038216 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-a00378ef-2b20-4db4-838e-72934176ec26 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:04:14.039405 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-a00378ef-2b20-4db4-838e-72934176ec26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:04:14.107599 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 538/1079] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:04:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 10:04:14.130396 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea474269-369e-4882-b239-3613d8aa60c9 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:04:14.155010 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:04:14.232501 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea474269-369e-4882-b239-3613d8aa60c9 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:04:14.265566 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adb2a55-552d-4dfb-93b7-bb7b1aa7c0c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:04:14.266293 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adb2a55-552d-4dfb-93b7-bb7b1aa7c0c5 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:14.266578 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adb2a55-552d-4dfb-93b7-bb7b1aa7c0c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:14.266855 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adb2a55-552d-4dfb-93b7-bb7b1aa7c0c5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:14.276748 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adb2a55-552d-4dfb-93b7-bb7b1aa7c0c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:04:14.284375 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-9adb2a55-552d-4dfb-93b7-bb7b1aa7c0c5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 10:04:14.284375 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:04:14.284375 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:04:14.284375 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:04:14.284375 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:04:14.284375 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:04:14.284375 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:04:14.284375 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:04:14.284375 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:04:14.284375 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:04:14.284375 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:04:14.284375 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:04:14.284375 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:04:14.284375 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:04:14.284375 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:04:14.284375 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:04:14.286039 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:04:14.286039 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:04:14.286039 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:04:14.286039 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:04:14.286039 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:04:14.286039 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:04:14.286039 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:04:14.286039 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:04:14.286039 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:04:14.286039 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:04:14.286039 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:04:14.286039 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jun 22 10:04:14.286039 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:04:14.286039 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:04:14.286039 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:04:14.286039 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:04:14.287040 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:04:14.287040 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:04:14.287040 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:04:14.287040 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:04:14.287040 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:04:14.287040 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:04:14.287040 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:04:14.287040 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:04:14.287040 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:04:14.287040 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:04:14.287040 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 10:04:14.287040 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:04:14.287040 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 542/1080] 10.222.0.43 () {56 vars in 1096 bytes} [Wed Jun 22 10:04:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:04:14.292287 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00378ef-2b20-4db4-838e-72934176ec26 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:04:14.389306 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00378ef-2b20-4db4-838e-72934176ec26 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:04:14.424960 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d614e32d-0d13-418d-8b3a-a9dc7ebf2684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:04:14.425673 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d614e32d-0d13-418d-8b3a-a9dc7ebf2684 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:14.425986 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d614e32d-0d13-418d-8b3a-a9dc7ebf2684 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:14.426269 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d614e32d-0d13-418d-8b3a-a9dc7ebf2684 None admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:14.427030 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d614e32d-0d13-418d-8b3a-a9dc7ebf2684 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:04:14.427343 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d614e32d-0d13-418d-8b3a-a9dc7ebf2684 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:04:14.428729 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d614e32d-0d13-418d-8b3a-a9dc7ebf2684 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:04:14.430176 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:04:14.438197 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 539/1081] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Jun 22 10:04:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:04:14.444361 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adb2a55-552d-4dfb-93b7-bb7b1aa7c0c5 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:04:14.526571 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:04:14.541628 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adb2a55-552d-4dfb-93b7-bb7b1aa7c0c5 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:04:14.573878 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45822280-7432-4bb0-854e-9872d4ffb9aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:04:14.574738 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45822280-7432-4bb0-854e-9872d4ffb9aa None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:14.575021 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45822280-7432-4bb0-854e-9872d4ffb9aa None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:14.575296 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45822280-7432-4bb0-854e-9872d4ffb9aa None admin] PATH_INFO: `/v3/users/4fc3c8bf65dd4af5b155b0d53d0cd9ba` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:14.576456 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45822280-7432-4bb0-854e-9872d4ffb9aa None admin] RBAC: Authorizing `identity:get_user(user_id=4fc3c8bf65dd4af5b155b0d53d0cd9ba)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:04:14.577894 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45822280-7432-4bb0-854e-9872d4ffb9aa None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:04:14.579501 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 543/1082] 10.222.0.43 () {56 vars in 1177 bytes} [Wed Jun 22 10:04:14 2022] GET /identity/v3/users/4fc3c8bf65dd4af5b155b0d53d0cd9ba => generated 285 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:04:14.585958 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d614e32d-0d13-418d-8b3a-a9dc7ebf2684 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:04:14.684877 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d614e32d-0d13-418d-8b3a-a9dc7ebf2684 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:04:14.718134 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22c1932-a73c-4283-8e5c-bc9c5a3ba751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:04:14.718986 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22c1932-a73c-4283-8e5c-bc9c5a3ba751 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:14.719271 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22c1932-a73c-4283-8e5c-bc9c5a3ba751 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:14.719549 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22c1932-a73c-4283-8e5c-bc9c5a3ba751 None admin] PATH_INFO: `/v3/projects/7da10dc3a22248f5afb7f75f10ae0a64` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:14.720716 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22c1932-a73c-4283-8e5c-bc9c5a3ba751 None admin] RBAC: Authorizing `identity:get_project(project_id=7da10dc3a22248f5afb7f75f10ae0a64)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:04:14.722895 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22c1932-a73c-4283-8e5c-bc9c5a3ba751 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:04:14.725144 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 540/1083] 10.222.0.43 () {56 vars in 1186 bytes} [Wed Jun 22 10:04:14 2022] GET /identity/v3/projects/7da10dc3a22248f5afb7f75f10ae0a64 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:04:14.731366 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45822280-7432-4bb0-854e-9872d4ffb9aa None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:04:14.830406 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45822280-7432-4bb0-854e-9872d4ffb9aa None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:04:14.864145 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53b24be-73e0-409b-b624-617a7d73399c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:04:14.865024 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53b24be-73e0-409b-b624-617a7d73399c None admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:14.865301 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53b24be-73e0-409b-b624-617a7d73399c None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:14.865571 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53b24be-73e0-409b-b624-617a7d73399c None admin] PATH_INFO: `/v3/projects/7da10dc3a22248f5afb7f75f10ae0a64/users/4fc3c8bf65dd4af5b155b0d53d0cd9ba/roles/26d9c2ab5dfc4e6d9ca80c6014123906` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:14.867532 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53b24be-73e0-409b-b624-617a7d73399c None admin] RBAC: Authorizing `identity:create_grant(project_id=7da10dc3a22248f5afb7f75f10ae0a64, user_id=4fc3c8bf65dd4af5b155b0d53d0cd9ba, role_id=26d9c2ab5dfc4e6d9ca80c6014123906)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:04:14.868956 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53b24be-73e0-409b-b624-617a7d73399c None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:04:14.882429 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 544/1084] 10.222.0.43 () {58 vars in 1439 bytes} [Wed Jun 22 10:04:14 2022] PUT /identity/v3/projects/7da10dc3a22248f5afb7f75f10ae0a64/users/4fc3c8bf65dd4af5b155b0d53d0cd9ba/roles/26d9c2ab5dfc4e6d9ca80c6014123906 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:04:15.351789 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7635bf64-6b2e-4d2b-b5b2-8fa68df61ea3 None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:15.352318 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7635bf64-6b2e-4d2b-b5b2-8fa68df61ea3 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:15.352437 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7635bf64-6b2e-4d2b-b5b2-8fa68df61ea3 None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:15.353820 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 541/1085] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:04:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:04:15.361572 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8220970c-853c-42ed-a56d-da551d8d596e None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:15.362105 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8220970c-853c-42ed-a56d-da551d8d596e None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:15.362530 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8220970c-853c-42ed-a56d-da551d8d596e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:15.380354 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-8220970c-853c-42ed-a56d-da551d8d596e None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:04:15.381544 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-8220970c-853c-42ed-a56d-da551d8d596e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:04:15.388845 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:04:15.451739 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 545/1086] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:04:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 10:04:15.475643 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7635bf64-6b2e-4d2b-b5b2-8fa68df61ea3 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:04:15.538597 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:04:15.578098 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7635bf64-6b2e-4d2b-b5b2-8fa68df61ea3 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:04:15.612569 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bc3bf5-61e7-4cbe-80d2-d5eeb6c74498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:04:15.613512 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bc3bf5-61e7-4cbe-80d2-d5eeb6c74498 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:15.613832 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bc3bf5-61e7-4cbe-80d2-d5eeb6c74498 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:15.614110 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bc3bf5-61e7-4cbe-80d2-d5eeb6c74498 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:15.624519 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bc3bf5-61e7-4cbe-80d2-d5eeb6c74498 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:04:15.633194 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-29bc3bf5-61e7-4cbe-80d2-d5eeb6c74498 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 22 10:04:15.633194 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:04:15.633194 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:04:15.633194 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:04:15.633194 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:04:15.633194 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:04:15.633194 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:04:15.633194 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:04:15.633194 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:04:15.633194 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:04:15.633194 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:04:15.633194 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:04:15.633194 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:04:15.633194 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:04:15.633194 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:04:15.633194 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:04:15.634302 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:04:15.634302 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:04:15.634302 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:04:15.634302 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:04:15.634302 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:04:15.634302 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:04:15.634302 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:04:15.634302 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:04:15.634302 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:04:15.634302 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:04:15.634302 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:04:15.634302 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( Jun 22 10:04:15.634302 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:04:15.634302 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:04:15.634302 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:04:15.634302 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:04:15.635164 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:04:15.635164 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:04:15.635164 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:04:15.635164 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:04:15.635164 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:04:15.635164 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:04:15.635164 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:04:15.635164 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:04:15.635164 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:04:15.635164 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:04:15.635164 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 22 10:04:15.635164 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:04:15.635164 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 542/1087] 10.222.0.43 () {56 vars in 1120 bytes} [Wed Jun 22 10:04:15 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:04:15.640222 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8220970c-853c-42ed-a56d-da551d8d596e None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:04:15.735550 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8220970c-853c-42ed-a56d-da551d8d596e None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:04:15.768334 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51d1a55-4f55-4ced-95fc-a119edd93104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:04:15.769055 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51d1a55-4f55-4ced-95fc-a119edd93104 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:15.772493 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51d1a55-4f55-4ced-95fc-a119edd93104 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:15.772493 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51d1a55-4f55-4ced-95fc-a119edd93104 None admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:15.772493 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51d1a55-4f55-4ced-95fc-a119edd93104 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:04:15.772493 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51d1a55-4f55-4ced-95fc-a119edd93104 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:04:15.772856 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51d1a55-4f55-4ced-95fc-a119edd93104 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:04:15.780755 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 546/1088] 10.222.0.43 () {56 vars in 1115 bytes} [Wed Jun 22 10:04:15 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:04:15.786239 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bc3bf5-61e7-4cbe-80d2-d5eeb6c74498 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:04:15.886358 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bc3bf5-61e7-4cbe-80d2-d5eeb6c74498 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:04:15.909252 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:04:15.920104 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0d390c-8f32-42ec-94d8-d0759940d07d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:04:15.920889 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0d390c-8f32-42ec-94d8-d0759940d07d None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:15.921173 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0d390c-8f32-42ec-94d8-d0759940d07d None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:15.921452 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0d390c-8f32-42ec-94d8-d0759940d07d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:15.931455 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0d390c-8f32-42ec-94d8-d0759940d07d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:04:15.932907 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0d390c-8f32-42ec-94d8-d0759940d07d None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:04:15.950610 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-8b0d390c-8f32-42ec-94d8-d0759940d07d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:04:15.950610 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:04:15.950610 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:04:15.950610 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:04:15.950610 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:04:15.950610 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:04:15.950610 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:04:15.950610 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:04:15.950610 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:04:15.950610 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:04:15.950610 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:04:15.950610 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:04:15.950610 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:04:15.950610 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:04:15.950610 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:04:15.951493 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:04:15.951493 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:04:15.951493 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:04:15.951493 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:04:15.951493 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:04:15.951493 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:04:15.951493 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:04:15.951493 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:04:15.951493 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( Jun 22 10:04:15.951493 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:04:15.951493 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:04:15.951493 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:04:15.951493 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:04:15.951493 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:04:15.951493 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:04:15.951493 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:04:15.951493 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:04:15.952368 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:04:15.952368 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:04:15.952368 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:04:15.952368 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:04:15.952368 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 543/1089] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jun 22 10:04:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:04:15.958882 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51d1a55-4f55-4ced-95fc-a119edd93104 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:04:15.962809 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:04:16.061840 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51d1a55-4f55-4ced-95fc-a119edd93104 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:04:16.094742 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cacce25-8013-495b-8dff-7abe83bccbde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:04:16.095403 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cacce25-8013-495b-8dff-7abe83bccbde None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:16.095689 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cacce25-8013-495b-8dff-7abe83bccbde None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:16.095968 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cacce25-8013-495b-8dff-7abe83bccbde None admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:16.096684 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cacce25-8013-495b-8dff-7abe83bccbde None admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:04:16.096991 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cacce25-8013-495b-8dff-7abe83bccbde None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:04:16.099309 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cacce25-8013-495b-8dff-7abe83bccbde None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:04:16.112324 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 547/1090] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Jun 22 10:04:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:04:16.118461 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0d390c-8f32-42ec-94d8-d0759940d07d None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:04:16.215134 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0d390c-8f32-42ec-94d8-d0759940d07d None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:04:16.250312 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6440fd1a-9514-4cb5-9707-1805317f3ae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:04:16.251088 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6440fd1a-9514-4cb5-9707-1805317f3ae7 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:16.251371 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6440fd1a-9514-4cb5-9707-1805317f3ae7 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:16.251647 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6440fd1a-9514-4cb5-9707-1805317f3ae7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:16.259529 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6440fd1a-9514-4cb5-9707-1805317f3ae7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:04:16.260986 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6440fd1a-9514-4cb5-9707-1805317f3ae7 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:04:16.275774 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-6440fd1a-9514-4cb5-9707-1805317f3ae7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 22 10:04:16.275774 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:04:16.275774 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:04:16.275774 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:04:16.275774 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:04:16.275774 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:04:16.275774 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:04:16.275774 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:04:16.275774 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:04:16.275774 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:04:16.275774 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:04:16.275774 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:04:16.275774 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 10:04:16.275774 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 10:04:16.275774 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 10:04:16.275774 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 10:04:16.276937 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:04:16.276937 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:04:16.276937 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 10:04:16.276937 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:04:16.276937 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 10:04:16.276937 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:04:16.276937 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:04:16.276937 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:04:16.276937 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:04:16.276937 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:04:16.276937 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:04:16.276937 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( Jun 22 10:04:16.276937 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:04:16.276937 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:04:16.276937 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:04:16.276937 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:04:16.276937 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:04:16.276937 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:04:16.278073 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:04:16.278073 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:04:16.278073 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 10:04:16.278073 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 10:04:16.278073 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 10:04:16.278073 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 10:04:16.278073 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 10:04:16.278073 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 10:04:16.278073 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 22 10:04:16.278073 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:04:16.278073 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 544/1091] 10.222.0.43 () {56 vars in 1093 bytes} [Wed Jun 22 10:04:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:04:16.282690 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cacce25-8013-495b-8dff-7abe83bccbde None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:04:16.345138 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:04:16.383085 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cacce25-8013-495b-8dff-7abe83bccbde None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:04:16.418916 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b0ebad-6f5d-4fdd-862c-6b5dc1a99577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:04:16.419595 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b0ebad-6f5d-4fdd-862c-6b5dc1a99577 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:16.419884 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b0ebad-6f5d-4fdd-862c-6b5dc1a99577 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:16.420168 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b0ebad-6f5d-4fdd-862c-6b5dc1a99577 None admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:16.421016 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b0ebad-6f5d-4fdd-862c-6b5dc1a99577 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:04:16.421335 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b0ebad-6f5d-4fdd-862c-6b5dc1a99577 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:04:16.422797 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b0ebad-6f5d-4fdd-862c-6b5dc1a99577 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:04:16.446652 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 548/1092] 10.222.0.43 () {56 vars in 1133 bytes} [Wed Jun 22 10:04:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:04:16.452242 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6440fd1a-9514-4cb5-9707-1805317f3ae7 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:04:16.487019 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:04:16.551703 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6440fd1a-9514-4cb5-9707-1805317f3ae7 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:04:16.585829 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421119b9-4182-4969-b178-1552bc6f1af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:04:16.586479 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421119b9-4182-4969-b178-1552bc6f1af1 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:16.586761 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421119b9-4182-4969-b178-1552bc6f1af1 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:16.587034 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421119b9-4182-4969-b178-1552bc6f1af1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:16.652357 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421119b9-4182-4969-b178-1552bc6f1af1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:04:16.653836 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421119b9-4182-4969-b178-1552bc6f1af1 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:04:16.685315 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:04:16.764312 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 545/1093] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Jun 22 10:04:16 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 10:04:16.770450 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b0ebad-6f5d-4fdd-862c-6b5dc1a99577 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:04:16.870840 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b0ebad-6f5d-4fdd-862c-6b5dc1a99577 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:04:16.892803 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:04:16.905007 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f188d8-dcfb-4a3b-8f52-97a31036eece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:04:16.905835 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f188d8-dcfb-4a3b-8f52-97a31036eece None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:16.906122 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f188d8-dcfb-4a3b-8f52-97a31036eece None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:16.906402 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f188d8-dcfb-4a3b-8f52-97a31036eece None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:16.917061 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f188d8-dcfb-4a3b-8f52-97a31036eece None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:04:16.918590 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f188d8-dcfb-4a3b-8f52-97a31036eece None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:04:16.935716 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-21f188d8-dcfb-4a3b-8f52-97a31036eece None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:04:16.935716 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:04:16.935716 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:04:16.935716 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:04:16.935716 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:04:16.935716 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:04:16.935716 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:04:16.935716 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:04:16.935716 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:04:16.935716 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:04:16.935716 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:04:16.935716 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:04:16.935716 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:04:16.935716 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:04:16.935716 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:04:16.936799 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:04:16.936799 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:04:16.936799 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:04:16.936799 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:04:16.936799 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:04:16.936799 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:04:16.936799 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:04:16.936799 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:04:16.936799 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jun 22 10:04:16.936799 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:04:16.936799 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:04:16.936799 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:04:16.936799 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:04:16.936799 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:04:16.936799 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:04:16.936799 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:04:16.936799 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:04:16.937724 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:04:16.937724 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:04:16.937724 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:04:16.937724 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:04:16.937724 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 549/1094] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jun 22 10:04:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 10:04:16.942518 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421119b9-4182-4969-b178-1552bc6f1af1 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:04:16.943030 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2068c2de-3868-482d-9b80-b82793066e96 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:16.943329 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2068c2de-3868-482d-9b80-b82793066e96 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:16.943618 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2068c2de-3868-482d-9b80-b82793066e96 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:16.944950 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 550/1095] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:04:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 10:04:16.950010 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb4d07c-ed3b-498e-b27c-bf3020e8b56c None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:16.950303 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb4d07c-ed3b-498e-b27c-bf3020e8b56c None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:16.950586 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb4d07c-ed3b-498e-b27c-bf3020e8b56c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:16.967160 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-fbb4d07c-ed3b-498e-b27c-bf3020e8b56c None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:04:16.968463 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-fbb4d07c-ed3b-498e-b27c-bf3020e8b56c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:04:17.036627 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 551/1096] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:04:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 10:04:17.042069 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421119b9-4182-4969-b178-1552bc6f1af1 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:04:17.058746 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb4d07c-ed3b-498e-b27c-bf3020e8b56c None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:04:17.075846 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583550d3-32bf-4c38-93b0-c7b182f29b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:04:17.076504 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583550d3-32bf-4c38-93b0-c7b182f29b42 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:17.076783 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583550d3-32bf-4c38-93b0-c7b182f29b42 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:17.077061 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583550d3-32bf-4c38-93b0-c7b182f29b42 None admin] PATH_INFO: `/v3/domains` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:17.077816 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583550d3-32bf-4c38-93b0-c7b182f29b42 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:04:17.078123 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583550d3-32bf-4c38-93b0-c7b182f29b42 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:04:17.079499 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583550d3-32bf-4c38-93b0-c7b182f29b42 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:04:17.082309 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:04:17.092659 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 546/1097] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Jun 22 10:04:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:04:17.098001 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583550d3-32bf-4c38-93b0-c7b182f29b42 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:04:17.158491 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb4d07c-ed3b-498e-b27c-bf3020e8b56c None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:04:17.162053 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:04:17.195099 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a7643e-9d4c-496d-b857-6d68f4948c34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:04:17.195897 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a7643e-9d4c-496d-b857-6d68f4948c34 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:17.196171 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a7643e-9d4c-496d-b857-6d68f4948c34 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:17.196445 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a7643e-9d4c-496d-b857-6d68f4948c34 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:17.198604 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583550d3-32bf-4c38-93b0-c7b182f29b42 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:04:17.206357 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a7643e-9d4c-496d-b857-6d68f4948c34 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:04:17.214042 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-55a7643e-9d4c-496d-b857-6d68f4948c34 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 10:04:17.214042 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:04:17.214042 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:04:17.214042 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:04:17.214042 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:04:17.214042 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:04:17.214042 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:04:17.214042 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:04:17.214042 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:04:17.214042 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:04:17.214042 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:04:17.214042 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:04:17.214042 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:04:17.214042 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:04:17.214042 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:04:17.214042 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:04:17.220323 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:04:17.220323 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:04:17.220323 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:04:17.220323 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:04:17.220323 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:04:17.220323 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:04:17.220323 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:04:17.220323 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:04:17.220323 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:04:17.220323 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:04:17.220323 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:04:17.220323 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jun 22 10:04:17.220323 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:04:17.220323 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:04:17.220323 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:04:17.220323 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:04:17.221232 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:04:17.221232 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:04:17.221232 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:04:17.221232 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:04:17.221232 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:04:17.221232 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:04:17.221232 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:04:17.221232 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:04:17.221232 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:04:17.221232 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:04:17.221232 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 10:04:17.221232 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:04:17.221232 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 552/1098] 10.222.0.43 () {56 vars in 1096 bytes} [Wed Jun 22 10:04:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 10:04:17.221232 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a7643e-9d4c-496d-b857-6d68f4948c34 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:04:17.233184 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfea0de-f15e-4ed8-9d0b-27de2cda4ac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:04:17.234003 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfea0de-f15e-4ed8-9d0b-27de2cda4ac8 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:17.234291 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfea0de-f15e-4ed8-9d0b-27de2cda4ac8 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:17.234577 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfea0de-f15e-4ed8-9d0b-27de2cda4ac8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:17.242093 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfea0de-f15e-4ed8-9d0b-27de2cda4ac8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:04:17.243544 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfea0de-f15e-4ed8-9d0b-27de2cda4ac8 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:04:17.260084 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-7dfea0de-f15e-4ed8-9d0b-27de2cda4ac8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:04:17.260084 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:04:17.260084 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:04:17.260084 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:04:17.260084 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:04:17.260084 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:04:17.260084 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:04:17.260084 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:04:17.260084 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:04:17.260084 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:04:17.260084 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:04:17.260084 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:04:17.260084 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 10:04:17.260084 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 10:04:17.260084 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 10:04:17.260997 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 10:04:17.260997 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:04:17.260997 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:04:17.260997 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:04:17.260997 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:04:17.260997 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:04:17.260997 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:04:17.260997 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:04:17.260997 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( Jun 22 10:04:17.260997 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:04:17.260997 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:04:17.260997 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:04:17.260997 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:04:17.260997 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:04:17.260997 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:04:17.260997 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:04:17.260997 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:04:17.261918 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 10:04:17.261918 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 10:04:17.261918 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 10:04:17.261918 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 10:04:17.261918 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 10:04:17.261918 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 10:04:17.261918 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:04:17.261918 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:04:17.261918 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 547/1099] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Jun 22 10:04:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 10:04:17.266911 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfea0de-f15e-4ed8-9d0b-27de2cda4ac8 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:04:17.320958 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a7643e-9d4c-496d-b857-6d68f4948c34 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:04:17.323990 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:04:17.354292 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf007e8-5bf1-4b52-8906-5f9dc935754e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:04:17.354951 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf007e8-5bf1-4b52-8906-5f9dc935754e None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:17.355234 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf007e8-5bf1-4b52-8906-5f9dc935754e None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:17.355511 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf007e8-5bf1-4b52-8906-5f9dc935754e None admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:17.356280 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf007e8-5bf1-4b52-8906-5f9dc935754e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:04:17.356586 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf007e8-5bf1-4b52-8906-5f9dc935754e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:04:17.357981 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf007e8-5bf1-4b52-8906-5f9dc935754e None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:04:17.367118 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 553/1100] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Jun 22 10:04:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:04:17.369649 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfea0de-f15e-4ed8-9d0b-27de2cda4ac8 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:04:17.372723 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf007e8-5bf1-4b52-8906-5f9dc935754e None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:04:17.399879 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:04:17.405576 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fd145e-ab9b-453e-a4d8-4ceb5163b262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:04:17.406266 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fd145e-ab9b-453e-a4d8-4ceb5163b262 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:17.406552 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fd145e-ab9b-453e-a4d8-4ceb5163b262 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:17.406830 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fd145e-ab9b-453e-a4d8-4ceb5163b262 None admin] PATH_INFO: `/v3/projects` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:17.407612 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fd145e-ab9b-453e-a4d8-4ceb5163b262 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:04:17.407919 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fd145e-ab9b-453e-a4d8-4ceb5163b262 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:04:17.409360 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fd145e-ab9b-453e-a4d8-4ceb5163b262 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:04:17.423202 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 548/1101] 10.222.0.43 () {56 vars in 1148 bytes} [Wed Jun 22 10:04:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:04:17.430118 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fd145e-ab9b-453e-a4d8-4ceb5163b262 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:04:17.477805 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf007e8-5bf1-4b52-8906-5f9dc935754e None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:04:17.511621 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ccc2ab-1570-4836-887b-a4443bddfd9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:04:17.512494 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ccc2ab-1570-4836-887b-a4443bddfd9d None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:17.512781 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ccc2ab-1570-4836-887b-a4443bddfd9d None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:17.513062 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ccc2ab-1570-4836-887b-a4443bddfd9d None admin] PATH_INFO: `/v3/users/4fc3c8bf65dd4af5b155b0d53d0cd9ba` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:17.514443 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ccc2ab-1570-4836-887b-a4443bddfd9d None admin] RBAC: Authorizing `identity:get_user(user_id=4fc3c8bf65dd4af5b155b0d53d0cd9ba)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:04:17.515944 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ccc2ab-1570-4836-887b-a4443bddfd9d None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:04:17.517828 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 554/1102] 10.222.0.43 () {56 vars in 1177 bytes} [Wed Jun 22 10:04:17 2022] GET /identity/v3/users/4fc3c8bf65dd4af5b155b0d53d0cd9ba => generated 285 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:04:17.523910 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ccc2ab-1570-4836-887b-a4443bddfd9d None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:04:17.531542 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fd145e-ab9b-453e-a4d8-4ceb5163b262 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:04:17.547426 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:04:17.565845 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2192754-2b68-4d00-8ffd-511e9bc32603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:04:17.567107 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2192754-2b68-4d00-8ffd-511e9bc32603 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:17.567397 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2192754-2b68-4d00-8ffd-511e9bc32603 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:17.567688 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2192754-2b68-4d00-8ffd-511e9bc32603 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:17.568512 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2192754-2b68-4d00-8ffd-511e9bc32603 None admin] RBAC: Adding query filter params (role.id=23300d26129048399321250a40367eb7, scope.project.id=e03f1c17e0884f188231d2949dc6f956, user.id=158a49aa3750478a84bf71b9aad24397) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:04:17.568826 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2192754-2b68-4d00-8ffd-511e9bc32603 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:04:17.570301 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2192754-2b68-4d00-8ffd-511e9bc32603 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:04:17.576143 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 549/1103] 10.222.0.43 () {56 vars in 1374 bytes} [Wed Jun 22 10:04:17 2022] GET /identity/v3/role_assignments?user.id=158a49aa3750478a84bf71b9aad24397&scope.project.id=e03f1c17e0884f188231d2949dc6f956&role.id=23300d26129048399321250a40367eb7 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:04:17.622360 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:04:17.631167 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ccc2ab-1570-4836-887b-a4443bddfd9d None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:04:17.666940 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412aa676-36da-4faf-a0d3-f490aa76f7ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:04:17.667606 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412aa676-36da-4faf-a0d3-f490aa76f7ac None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:17.667896 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412aa676-36da-4faf-a0d3-f490aa76f7ac None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:17.668181 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412aa676-36da-4faf-a0d3-f490aa76f7ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:17.743473 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412aa676-36da-4faf-a0d3-f490aa76f7ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:04:17.744944 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412aa676-36da-4faf-a0d3-f490aa76f7ac None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:04:17.842008 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:04:17.850561 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 555/1104] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Jun 22 10:04:17 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 10:04:17.856945 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2192754-2b68-4d00-8ffd-511e9bc32603 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:04:17.960459 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2192754-2b68-4d00-8ffd-511e9bc32603 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:04:17.996073 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c74de63-f98e-4c6c-963a-37a42dbec954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:04:17.996981 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c74de63-f98e-4c6c-963a-37a42dbec954 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:17.997269 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c74de63-f98e-4c6c-963a-37a42dbec954 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:17.997552 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c74de63-f98e-4c6c-963a-37a42dbec954 None admin] PATH_INFO: `/v3/projects/7da10dc3a22248f5afb7f75f10ae0a64` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:17.998912 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c74de63-f98e-4c6c-963a-37a42dbec954 None admin] RBAC: Authorizing `identity:get_project(project_id=7da10dc3a22248f5afb7f75f10ae0a64)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:04:18.000358 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c74de63-f98e-4c6c-963a-37a42dbec954 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:04:18.002262 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 550/1105] 10.222.0.43 () {56 vars in 1186 bytes} [Wed Jun 22 10:04:17 2022] GET /identity/v3/projects/7da10dc3a22248f5afb7f75f10ae0a64 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:04:18.008475 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412aa676-36da-4faf-a0d3-f490aa76f7ac None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:04:18.118351 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412aa676-36da-4faf-a0d3-f490aa76f7ac None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:04:18.153121 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7870d2e2-97fa-4da1-b410-cbbdb305bca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:04:18.153809 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7870d2e2-97fa-4da1-b410-cbbdb305bca1 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:18.154097 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7870d2e2-97fa-4da1-b410-cbbdb305bca1 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:18.154377 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7870d2e2-97fa-4da1-b410-cbbdb305bca1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:18.155214 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7870d2e2-97fa-4da1-b410-cbbdb305bca1 None admin] RBAC: Adding query filter params (role.id=26d9c2ab5dfc4e6d9ca80c6014123906, scope.project.id=7da10dc3a22248f5afb7f75f10ae0a64, user.id=4fc3c8bf65dd4af5b155b0d53d0cd9ba) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:04:18.155528 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7870d2e2-97fa-4da1-b410-cbbdb305bca1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:04:18.156955 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7870d2e2-97fa-4da1-b410-cbbdb305bca1 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:04:18.163725 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 556/1106] 10.222.0.43 () {56 vars in 1374 bytes} [Wed Jun 22 10:04:18 2022] GET /identity/v3/role_assignments?user.id=4fc3c8bf65dd4af5b155b0d53d0cd9ba&scope.project.id=7da10dc3a22248f5afb7f75f10ae0a64&role.id=26d9c2ab5dfc4e6d9ca80c6014123906 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:04:20.204516 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069e5ff2-cf72-4ead-8b41-66c72522fe7b None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:20.205089 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069e5ff2-cf72-4ead-8b41-66c72522fe7b None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:20.205089 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069e5ff2-cf72-4ead-8b41-66c72522fe7b None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:20.206513 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 551/1107] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:04:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:04:20.211618 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa4b9c7-24ae-43b7-b7f5-fc5821ac7ce8 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:20.212022 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa4b9c7-24ae-43b7-b7f5-fc5821ac7ce8 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:20.212190 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa4b9c7-24ae-43b7-b7f5-fc5821ac7ce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:20.230117 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-5fa4b9c7-24ae-43b7-b7f5-fc5821ac7ce8 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:04:20.231305 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-5fa4b9c7-24ae-43b7-b7f5-fc5821ac7ce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:04:20.283539 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:04:20.297955 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 557/1108] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:04:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 10:04:20.323337 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069e5ff2-cf72-4ead-8b41-66c72522fe7b None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:04:20.378860 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:04:20.430497 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069e5ff2-cf72-4ead-8b41-66c72522fe7b None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:04:20.463882 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c02ddd4-ad4e-4269-b24b-c58a6d0ae030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:04:20.464660 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c02ddd4-ad4e-4269-b24b-c58a6d0ae030 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:20.464941 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c02ddd4-ad4e-4269-b24b-c58a6d0ae030 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:20.465215 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c02ddd4-ad4e-4269-b24b-c58a6d0ae030 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:20.466376 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c02ddd4-ad4e-4269-b24b-c58a6d0ae030 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:04:20.467820 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c02ddd4-ad4e-4269-b24b-c58a6d0ae030 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:04:20.469419 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 552/1109] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jun 22 10:04:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:04:20.475348 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa4b9c7-24ae-43b7-b7f5-fc5821ac7ce8 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:04:20.570834 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa4b9c7-24ae-43b7-b7f5-fc5821ac7ce8 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:04:20.602781 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14cfa65-2b64-493d-8db7-be6daf3b08ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:04:20.603433 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14cfa65-2b64-493d-8db7-be6daf3b08ee None admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:20.603714 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14cfa65-2b64-493d-8db7-be6daf3b08ee None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:20.603991 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14cfa65-2b64-493d-8db7-be6daf3b08ee None admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:20.604694 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14cfa65-2b64-493d-8db7-be6daf3b08ee None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:04:20.606137 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14cfa65-2b64-493d-8db7-be6daf3b08ee None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:04:20.625599 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 558/1110] 10.222.0.43 () {60 vars in 1132 bytes} [Wed Jun 22 10:04:20 2022] POST /identity/v3/users => generated 286 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:04:22.726739 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2878bc0-9eb2-45dc-b2d5-7538e5bd0fa9 None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:22.727307 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2878bc0-9eb2-45dc-b2d5-7538e5bd0fa9 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:22.727606 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2878bc0-9eb2-45dc-b2d5-7538e5bd0fa9 None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:22.729718 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 553/1111] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:04:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:04:22.735577 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f1bfcd-dc8e-454b-8bb8-a26cdc7f0a09 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:22.736055 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f1bfcd-dc8e-454b-8bb8-a26cdc7f0a09 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:22.736148 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f1bfcd-dc8e-454b-8bb8-a26cdc7f0a09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:22.754574 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-06f1bfcd-dc8e-454b-8bb8-a26cdc7f0a09 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:04:22.755758 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-06f1bfcd-dc8e-454b-8bb8-a26cdc7f0a09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:04:22.808966 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:04:22.840958 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 559/1112] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:04:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 10:04:22.868156 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2878bc0-9eb2-45dc-b2d5-7538e5bd0fa9 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:04:22.987544 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2878bc0-9eb2-45dc-b2d5-7538e5bd0fa9 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:04:23.004578 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:04:23.027683 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739e4514-1719-400b-80b3-4c99cdf19402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:04:23.028571 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739e4514-1719-400b-80b3-4c99cdf19402 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:23.028859 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739e4514-1719-400b-80b3-4c99cdf19402 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:23.029139 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739e4514-1719-400b-80b3-4c99cdf19402 None admin] PATH_INFO: `/v3/roles/23a6a1fcd69d4210a8f2b45559b65aea` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:23.030723 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739e4514-1719-400b-80b3-4c99cdf19402 None admin] RBAC: Authorizing `identity:get_role(role_id=23a6a1fcd69d4210a8f2b45559b65aea)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:04:23.032152 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739e4514-1719-400b-80b3-4c99cdf19402 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:04:23.033614 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 554/1113] 10.222.0.43 () {56 vars in 1177 bytes} [Wed Jun 22 10:04:22 2022] GET /identity/v3/roles/23a6a1fcd69d4210a8f2b45559b65aea => generated 223 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:04:23.040668 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f1bfcd-dc8e-454b-8bb8-a26cdc7f0a09 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:04:23.157403 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f1bfcd-dc8e-454b-8bb8-a26cdc7f0a09 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:04:23.191277 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f862b3-5c5e-44cb-b578-98de5274a0a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:04:23.192138 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f862b3-5c5e-44cb-b578-98de5274a0a3 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:23.192421 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f862b3-5c5e-44cb-b578-98de5274a0a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:23.192698 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f862b3-5c5e-44cb-b578-98de5274a0a3 None admin] PATH_INFO: `/v3/users/3f7da504b1864bfca547b4fadd7cbc23` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:23.205382 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f862b3-5c5e-44cb-b578-98de5274a0a3 None admin] RBAC: Authorizing `identity:get_user(user_id=3f7da504b1864bfca547b4fadd7cbc23)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:04:23.206971 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f862b3-5c5e-44cb-b578-98de5274a0a3 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:04:23.208660 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 560/1114] 10.222.0.43 () {56 vars in 1177 bytes} [Wed Jun 22 10:04:23 2022] GET /identity/v3/users/3f7da504b1864bfca547b4fadd7cbc23 => generated 286 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:04:23.214411 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739e4514-1719-400b-80b3-4c99cdf19402 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:04:23.311525 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739e4514-1719-400b-80b3-4c99cdf19402 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:04:23.344400 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4072bc4-48b4-4a6a-859e-02e85846a524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:04:23.345034 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4072bc4-48b4-4a6a-859e-02e85846a524 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:23.345316 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4072bc4-48b4-4a6a-859e-02e85846a524 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:23.345594 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4072bc4-48b4-4a6a-859e-02e85846a524 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:23.404158 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:04:23.425533 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4072bc4-48b4-4a6a-859e-02e85846a524 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:04:23.427037 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4072bc4-48b4-4a6a-859e-02e85846a524 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:04:23.523303 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 555/1115] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Jun 22 10:04:23 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 10:04:23.529166 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f862b3-5c5e-44cb-b578-98de5274a0a3 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:04:23.560076 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:04:23.627336 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f862b3-5c5e-44cb-b578-98de5274a0a3 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:04:23.661294 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549f5958-f038-4916-80ef-b231d482d8ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:04:23.662169 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549f5958-f038-4916-80ef-b231d482d8ef None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:23.662459 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549f5958-f038-4916-80ef-b231d482d8ef None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:23.662741 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549f5958-f038-4916-80ef-b231d482d8ef None admin] PATH_INFO: `/v3/projects/7da10dc3a22248f5afb7f75f10ae0a64` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:23.663913 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549f5958-f038-4916-80ef-b231d482d8ef None admin] RBAC: Authorizing `identity:get_project(project_id=7da10dc3a22248f5afb7f75f10ae0a64)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:04:23.665369 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549f5958-f038-4916-80ef-b231d482d8ef None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:04:23.667094 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 561/1116] 10.222.0.43 () {56 vars in 1186 bytes} [Wed Jun 22 10:04:23 2022] GET /identity/v3/projects/7da10dc3a22248f5afb7f75f10ae0a64 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:04:23.673107 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4072bc4-48b4-4a6a-859e-02e85846a524 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:04:23.753538 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:04:23.769199 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4072bc4-48b4-4a6a-859e-02e85846a524 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:04:23.802419 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78de4c3d-c112-419b-9964-01541053644b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:04:23.803059 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78de4c3d-c112-419b-9964-01541053644b None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:23.803342 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78de4c3d-c112-419b-9964-01541053644b None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:23.803618 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78de4c3d-c112-419b-9964-01541053644b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:23.804440 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78de4c3d-c112-419b-9964-01541053644b None admin] RBAC: Adding query filter params (role.id=23a6a1fcd69d4210a8f2b45559b65aea, scope.project.id=7da10dc3a22248f5afb7f75f10ae0a64, user.id=3f7da504b1864bfca547b4fadd7cbc23) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:04:23.804750 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78de4c3d-c112-419b-9964-01541053644b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:04:23.806209 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78de4c3d-c112-419b-9964-01541053644b None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:04:23.811557 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 556/1117] 10.222.0.43 () {56 vars in 1374 bytes} [Wed Jun 22 10:04:23 2022] GET /identity/v3/role_assignments?user.id=3f7da504b1864bfca547b4fadd7cbc23&scope.project.id=7da10dc3a22248f5afb7f75f10ae0a64&role.id=23a6a1fcd69d4210a8f2b45559b65aea => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:04:25.845815 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf58506f-4a03-401e-9a4f-b34039a33128 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:25.846374 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf58506f-4a03-401e-9a4f-b34039a33128 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:25.846374 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf58506f-4a03-401e-9a4f-b34039a33128 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:25.847808 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 562/1118] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:04:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:04:25.854175 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a4b8c8-e89c-4bd7-817b-3d9c264a80fd None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:25.854607 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a4b8c8-e89c-4bd7-817b-3d9c264a80fd None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:25.854737 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a4b8c8-e89c-4bd7-817b-3d9c264a80fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:25.871581 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-a5a4b8c8-e89c-4bd7-817b-3d9c264a80fd None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:04:25.872741 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-a5a4b8c8-e89c-4bd7-817b-3d9c264a80fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:04:25.936866 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 557/1119] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:04:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 10:04:25.959633 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf58506f-4a03-401e-9a4f-b34039a33128 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:04:26.053991 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:04:26.058197 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf58506f-4a03-401e-9a4f-b34039a33128 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:04:26.092456 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cf4867-6b03-4970-a479-9f2351e605bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:04:26.093305 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cf4867-6b03-4970-a479-9f2351e605bf None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:26.093587 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cf4867-6b03-4970-a479-9f2351e605bf None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:26.093891 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cf4867-6b03-4970-a479-9f2351e605bf None admin] PATH_INFO: `/v3/roles/23a6a1fcd69d4210a8f2b45559b65aea` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:26.095663 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cf4867-6b03-4970-a479-9f2351e605bf None admin] RBAC: Authorizing `identity:get_role(role_id=23a6a1fcd69d4210a8f2b45559b65aea)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:04:26.097486 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cf4867-6b03-4970-a479-9f2351e605bf None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:04:26.098978 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 563/1120] 10.222.0.43 () {56 vars in 1177 bytes} [Wed Jun 22 10:04:25 2022] GET /identity/v3/roles/23a6a1fcd69d4210a8f2b45559b65aea => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:04:26.105191 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a4b8c8-e89c-4bd7-817b-3d9c264a80fd None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:04:26.183046 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:04:26.204370 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a4b8c8-e89c-4bd7-817b-3d9c264a80fd None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:04:26.238101 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049e2f61-0ad1-461c-af68-14b8b46b9358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:04:26.238972 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049e2f61-0ad1-461c-af68-14b8b46b9358 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:26.239254 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049e2f61-0ad1-461c-af68-14b8b46b9358 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:26.239531 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049e2f61-0ad1-461c-af68-14b8b46b9358 None admin] PATH_INFO: `/v3/users/3f7da504b1864bfca547b4fadd7cbc23` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:26.240687 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049e2f61-0ad1-461c-af68-14b8b46b9358 None admin] RBAC: Authorizing `identity:get_user(user_id=3f7da504b1864bfca547b4fadd7cbc23)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:04:26.242137 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049e2f61-0ad1-461c-af68-14b8b46b9358 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:04:26.243742 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 558/1121] 10.222.0.43 () {56 vars in 1177 bytes} [Wed Jun 22 10:04:26 2022] GET /identity/v3/users/3f7da504b1864bfca547b4fadd7cbc23 => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:04:26.249608 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cf4867-6b03-4970-a479-9f2351e605bf None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:04:26.344114 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cf4867-6b03-4970-a479-9f2351e605bf None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:04:26.377140 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6a27a0-778b-445b-9b2f-6f1cabcdf2f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:04:26.377972 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6a27a0-778b-445b-9b2f-6f1cabcdf2f1 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:26.378256 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6a27a0-778b-445b-9b2f-6f1cabcdf2f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:26.378529 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6a27a0-778b-445b-9b2f-6f1cabcdf2f1 None admin] PATH_INFO: `/v3/projects/7da10dc3a22248f5afb7f75f10ae0a64` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:26.379674 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6a27a0-778b-445b-9b2f-6f1cabcdf2f1 None admin] RBAC: Authorizing `identity:get_project(project_id=7da10dc3a22248f5afb7f75f10ae0a64)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:04:26.381087 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6a27a0-778b-445b-9b2f-6f1cabcdf2f1 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:04:26.382771 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 564/1122] 10.222.0.43 () {56 vars in 1186 bytes} [Wed Jun 22 10:04:26 2022] GET /identity/v3/projects/7da10dc3a22248f5afb7f75f10ae0a64 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:04:26.388546 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049e2f61-0ad1-461c-af68-14b8b46b9358 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:04:26.494279 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049e2f61-0ad1-461c-af68-14b8b46b9358 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:04:26.527903 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9221d8f3-325f-48a1-b2eb-79f1d5512c40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:04:26.528786 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9221d8f3-325f-48a1-b2eb-79f1d5512c40 None admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:26.529071 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9221d8f3-325f-48a1-b2eb-79f1d5512c40 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:26.529348 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9221d8f3-325f-48a1-b2eb-79f1d5512c40 None admin] PATH_INFO: `/v3/projects/7da10dc3a22248f5afb7f75f10ae0a64/users/3f7da504b1864bfca547b4fadd7cbc23/roles/23a6a1fcd69d4210a8f2b45559b65aea` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:26.531561 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9221d8f3-325f-48a1-b2eb-79f1d5512c40 None admin] RBAC: Authorizing `identity:create_grant(project_id=7da10dc3a22248f5afb7f75f10ae0a64, user_id=3f7da504b1864bfca547b4fadd7cbc23, role_id=23a6a1fcd69d4210a8f2b45559b65aea)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:04:26.533009 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9221d8f3-325f-48a1-b2eb-79f1d5512c40 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:04:26.546291 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 559/1123] 10.222.0.43 () {58 vars in 1439 bytes} [Wed Jun 22 10:04:26 2022] PUT /identity/v3/projects/7da10dc3a22248f5afb7f75f10ae0a64/users/3f7da504b1864bfca547b4fadd7cbc23/roles/23a6a1fcd69d4210a8f2b45559b65aea => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:04:28.578172 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acdeee6-bdeb-4921-823f-8d2c3b21a3ec None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:28.578739 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acdeee6-bdeb-4921-823f-8d2c3b21a3ec None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:28.578739 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acdeee6-bdeb-4921-823f-8d2c3b21a3ec None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:28.580087 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 565/1124] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:04:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:04:28.585873 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40bb5c2-af42-4ff2-a0b3-a0f1dcdf0585 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:28.586286 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40bb5c2-af42-4ff2-a0b3-a0f1dcdf0585 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:28.586421 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40bb5c2-af42-4ff2-a0b3-a0f1dcdf0585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:28.597437 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:04:28.603788 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-d40bb5c2-af42-4ff2-a0b3-a0f1dcdf0585 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:04:28.604954 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-d40bb5c2-af42-4ff2-a0b3-a0f1dcdf0585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:04:28.669573 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 560/1125] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:04:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 10:04:28.694414 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acdeee6-bdeb-4921-823f-8d2c3b21a3ec None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:04:28.729664 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:04:28.794131 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acdeee6-bdeb-4921-823f-8d2c3b21a3ec None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:04:28.826372 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a369374-ebac-4274-9b03-d583995528bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:04:28.827213 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a369374-ebac-4274-9b03-d583995528bf None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:28.827496 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a369374-ebac-4274-9b03-d583995528bf None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:28.827774 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a369374-ebac-4274-9b03-d583995528bf None admin] PATH_INFO: `/v3/roles/23a6a1fcd69d4210a8f2b45559b65aea` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:28.829275 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a369374-ebac-4274-9b03-d583995528bf None admin] RBAC: Authorizing `identity:get_role(role_id=23a6a1fcd69d4210a8f2b45559b65aea)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:04:28.830607 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a369374-ebac-4274-9b03-d583995528bf None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:04:28.832634 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 566/1126] 10.222.0.43 () {56 vars in 1177 bytes} [Wed Jun 22 10:04:28 2022] GET /identity/v3/roles/23a6a1fcd69d4210a8f2b45559b65aea => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:04:28.838323 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40bb5c2-af42-4ff2-a0b3-a0f1dcdf0585 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:04:28.933152 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40bb5c2-af42-4ff2-a0b3-a0f1dcdf0585 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:04:28.965378 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a1caf1-0ec5-4c5a-9435-35c3a4590cf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:04:28.966254 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a1caf1-0ec5-4c5a-9435-35c3a4590cf4 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:28.966537 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a1caf1-0ec5-4c5a-9435-35c3a4590cf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:28.966813 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a1caf1-0ec5-4c5a-9435-35c3a4590cf4 None admin] PATH_INFO: `/v3/users/3f7da504b1864bfca547b4fadd7cbc23` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:28.967968 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a1caf1-0ec5-4c5a-9435-35c3a4590cf4 None admin] RBAC: Authorizing `identity:get_user(user_id=3f7da504b1864bfca547b4fadd7cbc23)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:04:28.969391 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a1caf1-0ec5-4c5a-9435-35c3a4590cf4 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:04:28.971002 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 561/1127] 10.222.0.43 () {56 vars in 1177 bytes} [Wed Jun 22 10:04:28 2022] GET /identity/v3/users/3f7da504b1864bfca547b4fadd7cbc23 => generated 286 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:04:28.977227 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a369374-ebac-4274-9b03-d583995528bf None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:04:29.073492 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a369374-ebac-4274-9b03-d583995528bf None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:04:29.075753 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:04:29.106675 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100264a4-e0e0-4344-a860-3ebc3d0af692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:04:29.107347 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100264a4-e0e0-4344-a860-3ebc3d0af692 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:29.107635 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100264a4-e0e0-4344-a860-3ebc3d0af692 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:29.107911 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100264a4-e0e0-4344-a860-3ebc3d0af692 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:29.173189 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100264a4-e0e0-4344-a860-3ebc3d0af692 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:04:29.174651 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100264a4-e0e0-4344-a860-3ebc3d0af692 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:04:29.269511 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 567/1128] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Jun 22 10:04:28 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 10:04:29.275464 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a1caf1-0ec5-4c5a-9435-35c3a4590cf4 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:04:29.279179 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:04:29.376182 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a1caf1-0ec5-4c5a-9435-35c3a4590cf4 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:04:29.408936 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd6b6df-af26-4fdd-8bf3-acb19d4b814f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:04:29.410322 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd6b6df-af26-4fdd-8bf3-acb19d4b814f None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:29.410603 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd6b6df-af26-4fdd-8bf3-acb19d4b814f None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:29.410881 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd6b6df-af26-4fdd-8bf3-acb19d4b814f None admin] PATH_INFO: `/v3/projects/7da10dc3a22248f5afb7f75f10ae0a64` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:29.412055 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd6b6df-af26-4fdd-8bf3-acb19d4b814f None admin] RBAC: Authorizing `identity:get_project(project_id=7da10dc3a22248f5afb7f75f10ae0a64)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:04:29.413505 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd6b6df-af26-4fdd-8bf3-acb19d4b814f None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:04:29.415223 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 562/1129] 10.222.0.43 () {56 vars in 1186 bytes} [Wed Jun 22 10:04:29 2022] GET /identity/v3/projects/7da10dc3a22248f5afb7f75f10ae0a64 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:04:29.421424 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100264a4-e0e0-4344-a860-3ebc3d0af692 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:04:29.424521 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:04:29.519496 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100264a4-e0e0-4344-a860-3ebc3d0af692 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:04:29.552595 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca41266-1034-4b1b-bea5-4bb987435175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:04:29.553232 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca41266-1034-4b1b-bea5-4bb987435175 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:29.553516 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca41266-1034-4b1b-bea5-4bb987435175 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:29.553822 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca41266-1034-4b1b-bea5-4bb987435175 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:29.554644 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca41266-1034-4b1b-bea5-4bb987435175 None admin] RBAC: Adding query filter params (role.id=23a6a1fcd69d4210a8f2b45559b65aea, scope.project.id=7da10dc3a22248f5afb7f75f10ae0a64, user.id=3f7da504b1864bfca547b4fadd7cbc23) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:04:29.554957 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca41266-1034-4b1b-bea5-4bb987435175 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:04:29.556390 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca41266-1034-4b1b-bea5-4bb987435175 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:04:29.562207 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 568/1130] 10.222.0.43 () {56 vars in 1374 bytes} [Wed Jun 22 10:04:29 2022] GET /identity/v3/role_assignments?user.id=3f7da504b1864bfca547b4fadd7cbc23&scope.project.id=7da10dc3a22248f5afb7f75f10ae0a64&role.id=23a6a1fcd69d4210a8f2b45559b65aea => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:04:31.620723 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899478c7-2514-4618-9c80-27432d1f4d74 None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:31.621282 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899478c7-2514-4618-9c80-27432d1f4d74 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:31.621282 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899478c7-2514-4618-9c80-27432d1f4d74 None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:31.622685 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 563/1131] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:04:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:04:31.627840 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6ddf8a-0478-457d-8d32-e61b0fbef006 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:31.628286 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6ddf8a-0478-457d-8d32-e61b0fbef006 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:31.628419 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6ddf8a-0478-457d-8d32-e61b0fbef006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:31.645514 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-8d6ddf8a-0478-457d-8d32-e61b0fbef006 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:04:31.646828 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-8d6ddf8a-0478-457d-8d32-e61b0fbef006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:04:31.706517 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:04:31.712313 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 569/1132] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:04:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 10:04:31.736151 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899478c7-2514-4618-9c80-27432d1f4d74 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:04:31.807122 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:04:31.837335 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899478c7-2514-4618-9c80-27432d1f4d74 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:04:31.871357 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2ec2bf-471f-4b27-a604-5b740c0c8893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:04:31.872075 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2ec2bf-471f-4b27-a604-5b740c0c8893 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:31.872363 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2ec2bf-471f-4b27-a604-5b740c0c8893 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:31.872651 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2ec2bf-471f-4b27-a604-5b740c0c8893 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:31.873844 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2ec2bf-471f-4b27-a604-5b740c0c8893 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:04:31.875294 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2ec2bf-471f-4b27-a604-5b740c0c8893 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:04:31.876903 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 564/1133] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jun 22 10:04:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:04:31.882693 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6ddf8a-0478-457d-8d32-e61b0fbef006 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:04:31.999813 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6ddf8a-0478-457d-8d32-e61b0fbef006 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:04:32.032886 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039b785e-bcfc-4d76-bcf1-fc05c9e1b760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:04:32.033545 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039b785e-bcfc-4d76-bcf1-fc05c9e1b760 None admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:32.033864 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039b785e-bcfc-4d76-bcf1-fc05c9e1b760 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:32.034900 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039b785e-bcfc-4d76-bcf1-fc05c9e1b760 None admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:32.035648 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039b785e-bcfc-4d76-bcf1-fc05c9e1b760 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:04:32.037072 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039b785e-bcfc-4d76-bcf1-fc05c9e1b760 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:04:32.061091 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 570/1134] 10.222.0.43 () {60 vars in 1141 bytes} [Wed Jun 22 10:04:31 2022] POST /identity/v3/projects => generated 311 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:04:34.128321 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c59603-4218-4957-978e-15147c39af28 None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:34.128754 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c59603-4218-4957-978e-15147c39af28 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:34.128945 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c59603-4218-4957-978e-15147c39af28 None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:34.130300 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 565/1135] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:04:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:04:34.135456 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61dcc9f-e7ed-439c-911f-2d7295c773c3 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:34.135882 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61dcc9f-e7ed-439c-911f-2d7295c773c3 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:34.136015 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61dcc9f-e7ed-439c-911f-2d7295c773c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:34.152801 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-d61dcc9f-e7ed-439c-911f-2d7295c773c3 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:04:34.153997 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-d61dcc9f-e7ed-439c-911f-2d7295c773c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:04:34.197768 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:04:34.219397 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 571/1136] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:04:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 10:04:34.244300 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c59603-4218-4957-978e-15147c39af28 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:04:34.343223 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c59603-4218-4957-978e-15147c39af28 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:04:34.376138 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fff757-380c-4cc7-b5e9-1dfe34c311bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:04:34.376851 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fff757-380c-4cc7-b5e9-1dfe34c311bf None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:34.377133 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fff757-380c-4cc7-b5e9-1dfe34c311bf None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:34.377407 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fff757-380c-4cc7-b5e9-1dfe34c311bf None admin] PATH_INFO: `/v3/domains/default` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:34.379371 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fff757-380c-4cc7-b5e9-1dfe34c311bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:04:34.380797 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fff757-380c-4cc7-b5e9-1dfe34c311bf None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:04:34.382419 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 566/1137] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jun 22 10:04:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:04:34.388033 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61dcc9f-e7ed-439c-911f-2d7295c773c3 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:04:34.487702 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61dcc9f-e7ed-439c-911f-2d7295c773c3 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:04:34.520711 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dcf494-ef74-422e-877c-2d0c3b5a101c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:04:34.521362 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dcf494-ef74-422e-877c-2d0c3b5a101c None admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:34.521643 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dcf494-ef74-422e-877c-2d0c3b5a101c None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:34.521945 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dcf494-ef74-422e-877c-2d0c3b5a101c None admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:34.522650 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dcf494-ef74-422e-877c-2d0c3b5a101c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:04:34.524062 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dcf494-ef74-422e-877c-2d0c3b5a101c None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:04:34.544529 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 572/1138] 10.222.0.43 () {60 vars in 1132 bytes} [Wed Jun 22 10:04:34 2022] POST /identity/v3/users => generated 286 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 10:04:36.604706 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e145e1c-d11b-4cf9-ba5a-ff897d13556f None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:36.605243 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e145e1c-d11b-4cf9-ba5a-ff897d13556f None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:36.605243 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e145e1c-d11b-4cf9-ba5a-ff897d13556f None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:36.606643 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 567/1139] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:04:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:04:36.611825 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dbde6c-aa0d-473e-99a2-73fd8149bdcb None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:36.612326 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dbde6c-aa0d-473e-99a2-73fd8149bdcb None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:36.612526 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dbde6c-aa0d-473e-99a2-73fd8149bdcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:36.629342 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-c9dbde6c-aa0d-473e-99a2-73fd8149bdcb None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:04:36.630561 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-c9dbde6c-aa0d-473e-99a2-73fd8149bdcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:04:36.658704 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:04:36.696724 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 573/1140] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:04:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 10:04:36.720254 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e145e1c-d11b-4cf9-ba5a-ff897d13556f None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:04:36.731737 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:04:36.818972 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e145e1c-d11b-4cf9-ba5a-ff897d13556f None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:04:36.851182 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08573035-cd37-4925-a197-c59e2518ad25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:04:36.852204 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08573035-cd37-4925-a197-c59e2518ad25 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:36.852486 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08573035-cd37-4925-a197-c59e2518ad25 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:36.852759 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08573035-cd37-4925-a197-c59e2518ad25 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:36.862754 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08573035-cd37-4925-a197-c59e2518ad25 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:04:36.870303 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-08573035-cd37-4925-a197-c59e2518ad25 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 10:04:36.870303 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:04:36.870303 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:04:36.870303 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:04:36.870303 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:04:36.870303 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:04:36.870303 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:04:36.870303 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:04:36.870303 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:04:36.870303 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:04:36.870303 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:04:36.870303 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:04:36.870303 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:04:36.870303 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:04:36.870303 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:04:36.870303 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:04:36.871454 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:04:36.871454 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:04:36.871454 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:04:36.871454 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:04:36.871454 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:04:36.871454 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:04:36.871454 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:04:36.871454 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:04:36.871454 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:04:36.871454 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:04:36.871454 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:04:36.871454 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( Jun 22 10:04:36.871454 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:04:36.871454 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:04:36.871454 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:04:36.871454 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:04:36.872554 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:04:36.872554 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:04:36.872554 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:04:36.872554 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:04:36.872554 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:04:36.872554 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:04:36.872554 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:04:36.872554 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:04:36.872554 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:04:36.872554 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:04:36.872554 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 10:04:36.872554 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:04:36.872554 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 568/1141] 10.222.0.43 () {56 vars in 1096 bytes} [Wed Jun 22 10:04:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:04:36.877437 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dbde6c-aa0d-473e-99a2-73fd8149bdcb None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:04:36.974065 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dbde6c-aa0d-473e-99a2-73fd8149bdcb None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:04:37.006802 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70de6f4e-4ad0-49e0-91a9-399d14252a16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:04:37.007455 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70de6f4e-4ad0-49e0-91a9-399d14252a16 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:37.007735 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70de6f4e-4ad0-49e0-91a9-399d14252a16 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:37.008010 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70de6f4e-4ad0-49e0-91a9-399d14252a16 None admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:37.008747 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70de6f4e-4ad0-49e0-91a9-399d14252a16 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:04:37.009053 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70de6f4e-4ad0-49e0-91a9-399d14252a16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:04:37.010437 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70de6f4e-4ad0-49e0-91a9-399d14252a16 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:04:37.018210 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 574/1142] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Jun 22 10:04:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:04:37.024522 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08573035-cd37-4925-a197-c59e2518ad25 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:04:37.088936 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:04:37.124414 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08573035-cd37-4925-a197-c59e2518ad25 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:04:37.158189 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bdb77d-348e-4a41-8a27-f6e1f8b24ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:04:37.160119 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bdb77d-348e-4a41-8a27-f6e1f8b24ad1 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:37.160418 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bdb77d-348e-4a41-8a27-f6e1f8b24ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:37.160698 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bdb77d-348e-4a41-8a27-f6e1f8b24ad1 None admin] PATH_INFO: `/v3/users/5f0a432320cd4d0e994560066f0d4b06` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:37.173729 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bdb77d-348e-4a41-8a27-f6e1f8b24ad1 None admin] RBAC: Authorizing `identity:get_user(user_id=5f0a432320cd4d0e994560066f0d4b06)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:04:37.175689 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bdb77d-348e-4a41-8a27-f6e1f8b24ad1 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:04:37.177328 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 569/1143] 10.222.0.43 () {56 vars in 1177 bytes} [Wed Jun 22 10:04:37 2022] GET /identity/v3/users/5f0a432320cd4d0e994560066f0d4b06 => generated 286 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:04:37.183005 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70de6f4e-4ad0-49e0-91a9-399d14252a16 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:04:37.212796 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:04:37.282437 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70de6f4e-4ad0-49e0-91a9-399d14252a16 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:04:37.314771 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f58a23d-7392-4842-b775-7b4829b98794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:04:37.316135 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f58a23d-7392-4842-b775-7b4829b98794 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:37.316417 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f58a23d-7392-4842-b775-7b4829b98794 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:37.316693 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f58a23d-7392-4842-b775-7b4829b98794 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:37.381497 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f58a23d-7392-4842-b775-7b4829b98794 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:04:37.382983 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f58a23d-7392-4842-b775-7b4829b98794 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:04:37.408556 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:04:37.479933 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 575/1144] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Jun 22 10:04:37 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 10:04:37.485763 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bdb77d-348e-4a41-8a27-f6e1f8b24ad1 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:04:37.584833 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bdb77d-348e-4a41-8a27-f6e1f8b24ad1 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:04:37.610495 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:04:37.619862 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a041b666-d0b5-49a3-9434-20afe027671d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:04:37.620717 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a041b666-d0b5-49a3-9434-20afe027671d None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:37.621004 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a041b666-d0b5-49a3-9434-20afe027671d None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:37.621284 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a041b666-d0b5-49a3-9434-20afe027671d None admin] PATH_INFO: `/v3/projects/a733f7bbccb540a697593f2c3f89a17e` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:37.622488 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a041b666-d0b5-49a3-9434-20afe027671d None admin] RBAC: Authorizing `identity:get_project(project_id=a733f7bbccb540a697593f2c3f89a17e)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:04:37.623937 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a041b666-d0b5-49a3-9434-20afe027671d None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:04:37.625625 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 570/1145] 10.222.0.43 () {56 vars in 1186 bytes} [Wed Jun 22 10:04:37 2022] GET /identity/v3/projects/a733f7bbccb540a697593f2c3f89a17e => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:04:37.631947 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f58a23d-7392-4842-b775-7b4829b98794 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:04:37.730439 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f58a23d-7392-4842-b775-7b4829b98794 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:04:37.756256 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:04:37.764114 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f808c0b-8a41-4574-b8ef-3821456d3855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:04:37.764765 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f808c0b-8a41-4574-b8ef-3821456d3855 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:37.765053 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f808c0b-8a41-4574-b8ef-3821456d3855 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:37.765335 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f808c0b-8a41-4574-b8ef-3821456d3855 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:37.766194 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f808c0b-8a41-4574-b8ef-3821456d3855 None admin] RBAC: Adding query filter params (role.id=26d9c2ab5dfc4e6d9ca80c6014123906, scope.project.id=a733f7bbccb540a697593f2c3f89a17e, user.id=5f0a432320cd4d0e994560066f0d4b06) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:04:37.766512 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f808c0b-8a41-4574-b8ef-3821456d3855 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:04:37.767939 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f808c0b-8a41-4574-b8ef-3821456d3855 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:04:37.774187 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 576/1146] 10.222.0.43 () {56 vars in 1374 bytes} [Wed Jun 22 10:04:37 2022] GET /identity/v3/role_assignments?user.id=5f0a432320cd4d0e994560066f0d4b06&scope.project.id=a733f7bbccb540a697593f2c3f89a17e&role.id=26d9c2ab5dfc4e6d9ca80c6014123906 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:04:39.841810 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd517e09-7025-426e-804b-9d9082b6ff31 None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:39.842342 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd517e09-7025-426e-804b-9d9082b6ff31 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:39.842342 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd517e09-7025-426e-804b-9d9082b6ff31 None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:39.843730 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 571/1147] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:04:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:04:39.849682 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f5d55e-5df7-4c41-9035-b4580323db18 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:39.850062 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f5d55e-5df7-4c41-9035-b4580323db18 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:39.850274 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f5d55e-5df7-4c41-9035-b4580323db18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:39.867340 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-39f5d55e-5df7-4c41-9035-b4580323db18 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:04:39.868504 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-39f5d55e-5df7-4c41-9035-b4580323db18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:04:39.932157 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 577/1148] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:04:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 10:04:39.954102 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd517e09-7025-426e-804b-9d9082b6ff31 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:04:40.056383 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd517e09-7025-426e-804b-9d9082b6ff31 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:04:40.089271 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba6cfb0-ca10-4387-848c-99ca2a525628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:04:40.090077 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba6cfb0-ca10-4387-848c-99ca2a525628 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:40.090365 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba6cfb0-ca10-4387-848c-99ca2a525628 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:40.090642 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba6cfb0-ca10-4387-848c-99ca2a525628 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:40.101411 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba6cfb0-ca10-4387-848c-99ca2a525628 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:04:40.109241 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-8ba6cfb0-ca10-4387-848c-99ca2a525628 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 10:04:40.109241 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:04:40.109241 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:04:40.109241 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:04:40.109241 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:04:40.109241 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:04:40.109241 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:04:40.109241 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:04:40.109241 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:04:40.109241 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:04:40.109241 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:04:40.109241 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:04:40.109241 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:04:40.109241 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:04:40.109241 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:04:40.109241 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:04:40.110337 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:04:40.110337 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:04:40.110337 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:04:40.110337 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:04:40.110337 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:04:40.110337 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:04:40.110337 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:04:40.110337 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:04:40.110337 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:04:40.110337 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:04:40.110337 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:04:40.110337 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( Jun 22 10:04:40.110337 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:04:40.110337 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:04:40.110337 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:04:40.110337 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:04:40.111355 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:04:40.111355 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:04:40.111355 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:04:40.111355 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:04:40.111355 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:04:40.111355 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:04:40.111355 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:04:40.111355 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:04:40.111355 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:04:40.111355 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:04:40.111355 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 10:04:40.111355 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:04:40.111355 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 572/1149] 10.222.0.43 () {56 vars in 1096 bytes} [Wed Jun 22 10:04:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:04:40.116610 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f5d55e-5df7-4c41-9035-b4580323db18 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:04:40.211870 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f5d55e-5df7-4c41-9035-b4580323db18 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:04:40.234016 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:04:40.245883 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db59648-0665-4745-90b7-155528c7a99f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:04:40.246543 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db59648-0665-4745-90b7-155528c7a99f None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:40.246826 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db59648-0665-4745-90b7-155528c7a99f None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:40.247100 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db59648-0665-4745-90b7-155528c7a99f None admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:40.247839 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db59648-0665-4745-90b7-155528c7a99f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:04:40.248146 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db59648-0665-4745-90b7-155528c7a99f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:04:40.249500 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db59648-0665-4745-90b7-155528c7a99f None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:04:40.257480 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 578/1150] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Jun 22 10:04:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:04:40.263210 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba6cfb0-ca10-4387-848c-99ca2a525628 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:04:40.322122 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:04:40.368801 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba6cfb0-ca10-4387-848c-99ca2a525628 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:04:40.403150 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4227891a-ce69-46f4-8cf3-758d8cbc5409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:04:40.404018 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4227891a-ce69-46f4-8cf3-758d8cbc5409 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:40.404300 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4227891a-ce69-46f4-8cf3-758d8cbc5409 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:40.404577 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4227891a-ce69-46f4-8cf3-758d8cbc5409 None admin] PATH_INFO: `/v3/users/5f0a432320cd4d0e994560066f0d4b06` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:40.405780 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4227891a-ce69-46f4-8cf3-758d8cbc5409 None admin] RBAC: Authorizing `identity:get_user(user_id=5f0a432320cd4d0e994560066f0d4b06)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:04:40.407224 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4227891a-ce69-46f4-8cf3-758d8cbc5409 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:04:40.409079 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 573/1151] 10.222.0.43 () {56 vars in 1177 bytes} [Wed Jun 22 10:04:40 2022] GET /identity/v3/users/5f0a432320cd4d0e994560066f0d4b06 => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:04:40.414682 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db59648-0665-4745-90b7-155528c7a99f None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:04:40.512126 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db59648-0665-4745-90b7-155528c7a99f None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:04:40.545041 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f99be96-dab8-41a7-bd7e-baff503d5342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:04:40.545924 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f99be96-dab8-41a7-bd7e-baff503d5342 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:40.546211 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f99be96-dab8-41a7-bd7e-baff503d5342 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:40.546491 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f99be96-dab8-41a7-bd7e-baff503d5342 None admin] PATH_INFO: `/v3/projects/a733f7bbccb540a697593f2c3f89a17e` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:40.547661 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f99be96-dab8-41a7-bd7e-baff503d5342 None admin] RBAC: Authorizing `identity:get_project(project_id=a733f7bbccb540a697593f2c3f89a17e)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:04:40.549099 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f99be96-dab8-41a7-bd7e-baff503d5342 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:04:40.550855 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 579/1152] 10.222.0.43 () {56 vars in 1186 bytes} [Wed Jun 22 10:04:40 2022] GET /identity/v3/projects/a733f7bbccb540a697593f2c3f89a17e => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:04:40.556564 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4227891a-ce69-46f4-8cf3-758d8cbc5409 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:04:40.664023 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4227891a-ce69-46f4-8cf3-758d8cbc5409 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:04:40.690638 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:04:40.706984 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69793b1e-7fa7-4d3a-974e-a7b78dfdbed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:04:40.707870 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69793b1e-7fa7-4d3a-974e-a7b78dfdbed6 None admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:40.708150 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69793b1e-7fa7-4d3a-974e-a7b78dfdbed6 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:40.708423 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69793b1e-7fa7-4d3a-974e-a7b78dfdbed6 None admin] PATH_INFO: `/v3/projects/a733f7bbccb540a697593f2c3f89a17e/users/5f0a432320cd4d0e994560066f0d4b06/roles/26d9c2ab5dfc4e6d9ca80c6014123906` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:40.710368 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69793b1e-7fa7-4d3a-974e-a7b78dfdbed6 None admin] RBAC: Authorizing `identity:create_grant(project_id=a733f7bbccb540a697593f2c3f89a17e, user_id=5f0a432320cd4d0e994560066f0d4b06, role_id=26d9c2ab5dfc4e6d9ca80c6014123906)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:04:40.711806 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69793b1e-7fa7-4d3a-974e-a7b78dfdbed6 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:04:40.729040 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 574/1153] 10.222.0.43 () {58 vars in 1439 bytes} [Wed Jun 22 10:04:40 2022] PUT /identity/v3/projects/a733f7bbccb540a697593f2c3f89a17e/users/5f0a432320cd4d0e994560066f0d4b06/roles/26d9c2ab5dfc4e6d9ca80c6014123906 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:04:42.746536 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e30f410-2203-49ef-9975-638e403761e0 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:42.747074 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e30f410-2203-49ef-9975-638e403761e0 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:42.747074 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e30f410-2203-49ef-9975-638e403761e0 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:42.748461 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 580/1154] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:04:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:04:42.753837 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f439ca20-b181-4681-bd15-b836c533b4b1 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:42.754280 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f439ca20-b181-4681-bd15-b836c533b4b1 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:42.754404 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f439ca20-b181-4681-bd15-b836c533b4b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:42.770931 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-f439ca20-b181-4681-bd15-b836c533b4b1 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:04:42.772118 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-f439ca20-b181-4681-bd15-b836c533b4b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:04:42.837982 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 575/1155] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:04:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 10:04:42.862616 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e30f410-2203-49ef-9975-638e403761e0 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:04:42.914955 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:04:42.961954 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e30f410-2203-49ef-9975-638e403761e0 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:04:42.994838 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e4e0e5-c50b-4646-a45c-799fd57c681f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:04:42.995618 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e4e0e5-c50b-4646-a45c-799fd57c681f None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:42.995903 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e4e0e5-c50b-4646-a45c-799fd57c681f None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:42.996178 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e4e0e5-c50b-4646-a45c-799fd57c681f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:43.006634 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e4e0e5-c50b-4646-a45c-799fd57c681f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:04:43.014257 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-f1e4e0e5-c50b-4646-a45c-799fd57c681f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 10:04:43.014257 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:04:43.014257 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:04:43.014257 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:04:43.014257 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:04:43.014257 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:04:43.014257 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:04:43.014257 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:04:43.014257 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:04:43.014257 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:04:43.014257 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:04:43.014257 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:04:43.014257 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:04:43.014257 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:04:43.014257 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:04:43.014257 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:04:43.015308 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:04:43.015308 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:04:43.015308 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:04:43.015308 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:04:43.015308 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:04:43.015308 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:04:43.015308 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:04:43.015308 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:04:43.015308 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:04:43.015308 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:04:43.015308 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:04:43.015308 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jun 22 10:04:43.015308 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:04:43.015308 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:04:43.015308 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:04:43.015308 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:04:43.016164 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:04:43.016164 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:04:43.016164 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:04:43.016164 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:04:43.016164 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:04:43.016164 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:04:43.016164 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:04:43.016164 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:04:43.016164 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:04:43.016164 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:04:43.016164 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 10:04:43.016164 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:04:43.016164 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 581/1156] 10.222.0.43 () {56 vars in 1096 bytes} [Wed Jun 22 10:04:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:04:43.021677 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f439ca20-b181-4681-bd15-b836c533b4b1 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:04:43.118573 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f439ca20-b181-4681-bd15-b836c533b4b1 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:04:43.132132 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:04:43.153946 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87eebd0-52e2-43ca-b0b2-979dcde06cc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:04:43.154950 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87eebd0-52e2-43ca-b0b2-979dcde06cc2 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:43.155239 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87eebd0-52e2-43ca-b0b2-979dcde06cc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:43.155521 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87eebd0-52e2-43ca-b0b2-979dcde06cc2 None admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:43.156269 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87eebd0-52e2-43ca-b0b2-979dcde06cc2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:04:43.156578 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87eebd0-52e2-43ca-b0b2-979dcde06cc2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:04:43.157982 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87eebd0-52e2-43ca-b0b2-979dcde06cc2 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:04:43.165919 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 576/1157] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Jun 22 10:04:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:04:43.171612 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e4e0e5-c50b-4646-a45c-799fd57c681f None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:04:43.269639 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e4e0e5-c50b-4646-a45c-799fd57c681f None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:04:43.282005 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:04:43.303226 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84fe1e5-2389-44e9-80e1-521ed4455f8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:04:43.304083 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84fe1e5-2389-44e9-80e1-521ed4455f8c None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:43.304364 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84fe1e5-2389-44e9-80e1-521ed4455f8c None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:43.304639 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84fe1e5-2389-44e9-80e1-521ed4455f8c None admin] PATH_INFO: `/v3/users/5f0a432320cd4d0e994560066f0d4b06` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:43.305833 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84fe1e5-2389-44e9-80e1-521ed4455f8c None admin] RBAC: Authorizing `identity:get_user(user_id=5f0a432320cd4d0e994560066f0d4b06)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:04:43.307280 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84fe1e5-2389-44e9-80e1-521ed4455f8c None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:04:43.308886 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 582/1158] 10.222.0.43 () {56 vars in 1177 bytes} [Wed Jun 22 10:04:43 2022] GET /identity/v3/users/5f0a432320cd4d0e994560066f0d4b06 => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:04:43.314629 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87eebd0-52e2-43ca-b0b2-979dcde06cc2 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:04:43.421380 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87eebd0-52e2-43ca-b0b2-979dcde06cc2 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:04:43.454319 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9813f804-54d5-4a35-8cb4-3861e6610bfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:04:43.454974 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9813f804-54d5-4a35-8cb4-3861e6610bfc None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:43.455262 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9813f804-54d5-4a35-8cb4-3861e6610bfc None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:43.455598 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9813f804-54d5-4a35-8cb4-3861e6610bfc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:43.497256 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:04:43.522322 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9813f804-54d5-4a35-8cb4-3861e6610bfc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:04:43.523724 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9813f804-54d5-4a35-8cb4-3861e6610bfc None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:04:43.619594 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 577/1159] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Jun 22 10:04:43 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 10:04:43.625397 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84fe1e5-2389-44e9-80e1-521ed4455f8c None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:04:43.732054 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84fe1e5-2389-44e9-80e1-521ed4455f8c None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:04:43.768984 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13d38e6-4f21-48f9-a7c7-2836da68a730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:04:43.769955 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13d38e6-4f21-48f9-a7c7-2836da68a730 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:43.770239 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13d38e6-4f21-48f9-a7c7-2836da68a730 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:43.770517 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13d38e6-4f21-48f9-a7c7-2836da68a730 None admin] PATH_INFO: `/v3/projects/a733f7bbccb540a697593f2c3f89a17e` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:43.771689 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13d38e6-4f21-48f9-a7c7-2836da68a730 None admin] RBAC: Authorizing `identity:get_project(project_id=a733f7bbccb540a697593f2c3f89a17e)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:04:43.773174 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13d38e6-4f21-48f9-a7c7-2836da68a730 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:04:43.774844 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 583/1160] 10.222.0.43 () {56 vars in 1186 bytes} [Wed Jun 22 10:04:43 2022] GET /identity/v3/projects/a733f7bbccb540a697593f2c3f89a17e => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:04:43.781041 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9813f804-54d5-4a35-8cb4-3861e6610bfc None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:04:43.856190 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:04:43.881370 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9813f804-54d5-4a35-8cb4-3861e6610bfc None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:04:43.915843 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f58a63-afb1-4389-a02c-bb59387fae86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:04:43.916488 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f58a63-afb1-4389-a02c-bb59387fae86 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:43.916774 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f58a63-afb1-4389-a02c-bb59387fae86 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:43.917052 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f58a63-afb1-4389-a02c-bb59387fae86 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:43.917904 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f58a63-afb1-4389-a02c-bb59387fae86 None admin] RBAC: Adding query filter params (role.id=26d9c2ab5dfc4e6d9ca80c6014123906, scope.project.id=a733f7bbccb540a697593f2c3f89a17e, user.id=5f0a432320cd4d0e994560066f0d4b06) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:04:43.918221 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f58a63-afb1-4389-a02c-bb59387fae86 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:04:43.919656 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f58a63-afb1-4389-a02c-bb59387fae86 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:04:43.925835 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 578/1161] 10.222.0.43 () {56 vars in 1374 bytes} [Wed Jun 22 10:04:43 2022] GET /identity/v3/role_assignments?user.id=5f0a432320cd4d0e994560066f0d4b06&scope.project.id=a733f7bbccb540a697593f2c3f89a17e&role.id=26d9c2ab5dfc4e6d9ca80c6014123906 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:04:45.988495 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9665a85c-4f30-44d8-adeb-7540743dd25c None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:45.989083 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9665a85c-4f30-44d8-adeb-7540743dd25c None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:45.989083 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9665a85c-4f30-44d8-adeb-7540743dd25c None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:45.990437 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 584/1162] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:04:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:04:45.995626 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3b7a36-b302-417d-9986-fa64cf8dab8b None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:45.996049 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3b7a36-b302-417d-9986-fa64cf8dab8b None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:45.996182 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3b7a36-b302-417d-9986-fa64cf8dab8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:46.012435 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-af3b7a36-b302-417d-9986-fa64cf8dab8b None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:04:46.013622 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-af3b7a36-b302-417d-9986-fa64cf8dab8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:04:46.077975 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 579/1163] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:04:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 10:04:46.101121 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9665a85c-4f30-44d8-adeb-7540743dd25c None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:04:46.150738 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:04:46.202724 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9665a85c-4f30-44d8-adeb-7540743dd25c None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:04:46.235910 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6037bf6-bb4f-42e4-9271-0ec7a02aefaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:04:46.236552 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6037bf6-bb4f-42e4-9271-0ec7a02aefaa None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:46.237464 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6037bf6-bb4f-42e4-9271-0ec7a02aefaa None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:46.237771 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6037bf6-bb4f-42e4-9271-0ec7a02aefaa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:46.304087 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6037bf6-bb4f-42e4-9271-0ec7a02aefaa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:04:46.305475 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6037bf6-bb4f-42e4-9271-0ec7a02aefaa None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:04:46.352621 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:04:46.403278 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 585/1164] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Jun 22 10:04:46 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 10:04:46.409851 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3b7a36-b302-417d-9986-fa64cf8dab8b None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:04:46.474630 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:04:46.507200 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3b7a36-b302-417d-9986-fa64cf8dab8b None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:04:46.541076 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8f3fdf-53a2-4aec-ab7a-c8cde8a8d605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:04:46.541902 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8f3fdf-53a2-4aec-ab7a-c8cde8a8d605 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:46.542193 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8f3fdf-53a2-4aec-ab7a-c8cde8a8d605 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:46.542474 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8f3fdf-53a2-4aec-ab7a-c8cde8a8d605 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:46.548976 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8f3fdf-53a2-4aec-ab7a-c8cde8a8d605 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:04:46.550676 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8f3fdf-53a2-4aec-ab7a-c8cde8a8d605 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:04:46.564614 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-0b8f3fdf-53a2-4aec-ab7a-c8cde8a8d605 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 22 10:04:46.564614 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:04:46.564614 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 22 10:04:46.564614 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 22 10:04:46.564614 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 10:04:46.564614 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 10:04:46.564614 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 10:04:46.564614 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 10:04:46.564614 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jun 22 10:04:46.564614 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:04:46.564614 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 10:04:46.564614 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:04:46.564614 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:04:46.564614 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:04:46.564614 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:04:46.564614 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:04:46.564614 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:04:46.566396 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:04:46.566396 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:04:46.566396 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:04:46.566396 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:04:46.566396 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:04:46.566396 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:04:46.566396 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:04:46.566396 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:04:46.566396 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:04:46.566396 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:04:46.566396 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:04:46.566396 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:04:46.566396 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:04:46.566396 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:04:46.566396 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:04:46.566396 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:04:46.567715 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:04:46.567715 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( Jun 22 10:04:46.567715 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:04:46.567715 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:04:46.567715 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:04:46.567715 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:04:46.567715 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:04:46.567715 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:04:46.567715 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:04:46.567715 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:04:46.567715 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 22 10:04:46.567715 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:04:46.567715 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 22 10:04:46.567715 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:04:46.567715 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 580/1165] 10.222.0.43 () {56 vars in 1117 bytes} [Wed Jun 22 10:04:46 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:04:46.572273 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6037bf6-bb4f-42e4-9271-0ec7a02aefaa None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:04:46.668211 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6037bf6-bb4f-42e4-9271-0ec7a02aefaa None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:04:46.700860 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e6e7b2-8a4a-4ed9-b60e-fc3d87995590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:04:46.701509 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e6e7b2-8a4a-4ed9-b60e-fc3d87995590 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:46.701826 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e6e7b2-8a4a-4ed9-b60e-fc3d87995590 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:46.702107 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e6e7b2-8a4a-4ed9-b60e-fc3d87995590 None admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:46.702825 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e6e7b2-8a4a-4ed9-b60e-fc3d87995590 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:04:46.703133 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e6e7b2-8a4a-4ed9-b60e-fc3d87995590 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:04:46.704491 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e6e7b2-8a4a-4ed9-b60e-fc3d87995590 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:04:46.712215 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 586/1166] 10.222.0.43 () {56 vars in 1115 bytes} [Wed Jun 22 10:04:46 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:04:48.724136 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60719b76-0332-49db-80e3-db8d9687a8c1 None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:48.724674 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60719b76-0332-49db-80e3-db8d9687a8c1 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:48.724674 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60719b76-0332-49db-80e3-db8d9687a8c1 None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:48.726107 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 581/1167] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:04:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:04:48.731552 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0991b11-9dec-4783-ac6c-27b1d956463d None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:48.731993 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0991b11-9dec-4783-ac6c-27b1d956463d None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:48.732099 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0991b11-9dec-4783-ac6c-27b1d956463d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:48.748361 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-a0991b11-9dec-4783-ac6c-27b1d956463d None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:04:48.749538 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-a0991b11-9dec-4783-ac6c-27b1d956463d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:04:48.757199 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:04:48.814660 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 587/1168] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:04:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 10:04:48.839497 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60719b76-0332-49db-80e3-db8d9687a8c1 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:04:48.940228 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60719b76-0332-49db-80e3-db8d9687a8c1 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:04:48.966347 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:04:48.974578 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bda6fd5-d340-45d9-a17c-70eb3a2b5666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:04:48.975178 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bda6fd5-d340-45d9-a17c-70eb3a2b5666 None admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:48.975465 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bda6fd5-d340-45d9-a17c-70eb3a2b5666 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:48.975742 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bda6fd5-d340-45d9-a17c-70eb3a2b5666 None admin] PATH_INFO: `/v3/domains` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:48.976475 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bda6fd5-d340-45d9-a17c-70eb3a2b5666 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:04:48.978140 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bda6fd5-d340-45d9-a17c-70eb3a2b5666 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:04:48.993960 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 582/1169] 10.222.0.43 () {60 vars in 1138 bytes} [Wed Jun 22 10:04:48 2022] POST /identity/v3/domains => generated 267 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:04:51.051293 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba94879d-35a3-487c-8e84-b588391da445 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:51.051892 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba94879d-35a3-487c-8e84-b588391da445 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:51.051892 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba94879d-35a3-487c-8e84-b588391da445 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:51.053223 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 588/1170] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:04:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:04:51.058443 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a71528-deee-4eff-996a-927abbe46e42 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:51.058864 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a71528-deee-4eff-996a-927abbe46e42 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:51.059003 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a71528-deee-4eff-996a-927abbe46e42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:51.076821 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-f3a71528-deee-4eff-996a-927abbe46e42 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:04:51.078037 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-f3a71528-deee-4eff-996a-927abbe46e42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:04:51.144298 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 583/1171] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:04:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 10:04:51.167858 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba94879d-35a3-487c-8e84-b588391da445 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:04:51.268121 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba94879d-35a3-487c-8e84-b588391da445 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:04:51.300964 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bf8de4-7343-40c1-be74-64ca66f42527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:04:51.301891 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bf8de4-7343-40c1-be74-64ca66f42527 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:51.302131 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bf8de4-7343-40c1-be74-64ca66f42527 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:51.302416 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bf8de4-7343-40c1-be74-64ca66f42527 None admin] PATH_INFO: `/v3/domains/ddaa4a99605d4f7f900b5ffe21c50206` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:51.312522 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bf8de4-7343-40c1-be74-64ca66f42527 None admin] RBAC: Authorizing `identity:get_domain(domain_id=ddaa4a99605d4f7f900b5ffe21c50206)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:04:51.313992 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bf8de4-7343-40c1-be74-64ca66f42527 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:04:51.316207 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 589/1172] 10.222.0.43 () {56 vars in 1183 bytes} [Wed Jun 22 10:04:51 2022] GET /identity/v3/domains/ddaa4a99605d4f7f900b5ffe21c50206 => generated 267 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:04:51.322254 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a71528-deee-4eff-996a-927abbe46e42 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:04:51.418099 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a71528-deee-4eff-996a-927abbe46e42 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:04:51.436104 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:04:51.456291 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345f09ff-0d5a-4196-b31c-2779753a63ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:04:51.456955 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345f09ff-0d5a-4196-b31c-2779753a63ff None admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:51.457239 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345f09ff-0d5a-4196-b31c-2779753a63ff None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:51.457517 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345f09ff-0d5a-4196-b31c-2779753a63ff None admin] PATH_INFO: `/v3/projects` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:51.458252 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345f09ff-0d5a-4196-b31c-2779753a63ff None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:04:51.459689 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345f09ff-0d5a-4196-b31c-2779753a63ff None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:04:51.483620 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 584/1173] 10.222.0.43 () {60 vars in 1141 bytes} [Wed Jun 22 10:04:51 2022] POST /identity/v3/projects => generated 361 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:04:53.526509 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc097881-7a1d-4052-9174-8fb1b430c522 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:53.527063 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc097881-7a1d-4052-9174-8fb1b430c522 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:53.527063 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc097881-7a1d-4052-9174-8fb1b430c522 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:53.528441 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 590/1174] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:04:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:04:53.534625 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f20e52-3293-4e1c-909f-0dfd4c1a2d4d None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:53.535070 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f20e52-3293-4e1c-909f-0dfd4c1a2d4d None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:53.535199 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f20e52-3293-4e1c-909f-0dfd4c1a2d4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:53.551473 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-52f20e52-3293-4e1c-909f-0dfd4c1a2d4d None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:04:53.552641 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-52f20e52-3293-4e1c-909f-0dfd4c1a2d4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:04:53.617834 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 585/1175] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:04:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 10:04:53.642097 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc097881-7a1d-4052-9174-8fb1b430c522 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:04:53.645598 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:04:53.748050 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc097881-7a1d-4052-9174-8fb1b430c522 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:04:53.789760 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298e9478-0989-4c89-a3ab-4c98f0dbdcb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:04:53.790566 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298e9478-0989-4c89-a3ab-4c98f0dbdcb6 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:53.790853 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298e9478-0989-4c89-a3ab-4c98f0dbdcb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:53.791132 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298e9478-0989-4c89-a3ab-4c98f0dbdcb6 None admin] PATH_INFO: `/v3/domains/ddaa4a99605d4f7f900b5ffe21c50206` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:53.792301 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298e9478-0989-4c89-a3ab-4c98f0dbdcb6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=ddaa4a99605d4f7f900b5ffe21c50206)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:04:53.793767 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298e9478-0989-4c89-a3ab-4c98f0dbdcb6 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:04:53.795395 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 591/1176] 10.222.0.43 () {56 vars in 1183 bytes} [Wed Jun 22 10:04:53 2022] GET /identity/v3/domains/ddaa4a99605d4f7f900b5ffe21c50206 => generated 267 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:04:53.801525 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f20e52-3293-4e1c-909f-0dfd4c1a2d4d None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:04:53.899100 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:04:53.902135 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f20e52-3293-4e1c-909f-0dfd4c1a2d4d None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:04:53.937332 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d642f45c-1415-4fa4-a030-c8c30673e5d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:04:53.938027 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d642f45c-1415-4fa4-a030-c8c30673e5d0 None admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:53.938311 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d642f45c-1415-4fa4-a030-c8c30673e5d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:53.938589 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d642f45c-1415-4fa4-a030-c8c30673e5d0 None admin] PATH_INFO: `/v3/users` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:53.939282 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d642f45c-1415-4fa4-a030-c8c30673e5d0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:04:53.940717 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d642f45c-1415-4fa4-a030-c8c30673e5d0 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:04:53.960382 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 586/1177] 10.222.0.43 () {60 vars in 1132 bytes} [Wed Jun 22 10:04:53 2022] POST /identity/v3/users => generated 311 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:04:56.044930 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e99f860-2751-4bc5-a4e3-6feea547a31e None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:56.045499 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e99f860-2751-4bc5-a4e3-6feea547a31e None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:56.045499 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e99f860-2751-4bc5-a4e3-6feea547a31e None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:56.046890 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 592/1178] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:04:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:04:56.052659 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cfdad7-3b3d-4f27-9380-ed6383f85b46 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:56.053100 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cfdad7-3b3d-4f27-9380-ed6383f85b46 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:56.053201 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cfdad7-3b3d-4f27-9380-ed6383f85b46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:56.070132 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-15cfdad7-3b3d-4f27-9380-ed6383f85b46 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:04:56.071297 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-15cfdad7-3b3d-4f27-9380-ed6383f85b46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:04:56.146112 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 587/1179] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:04:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 10:04:56.174804 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e99f860-2751-4bc5-a4e3-6feea547a31e None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:04:56.244352 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:04:56.275161 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e99f860-2751-4bc5-a4e3-6feea547a31e None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:04:56.310253 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc2c3be-db94-4016-837b-d9b17c4b5d95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:04:56.310978 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc2c3be-db94-4016-837b-d9b17c4b5d95 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:56.311266 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc2c3be-db94-4016-837b-d9b17c4b5d95 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:56.311547 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc2c3be-db94-4016-837b-d9b17c4b5d95 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:56.321462 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc2c3be-db94-4016-837b-d9b17c4b5d95 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:04:56.329086 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-7dc2c3be-db94-4016-837b-d9b17c4b5d95 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 10:04:56.329086 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:04:56.329086 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:04:56.329086 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:04:56.329086 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:04:56.329086 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:04:56.329086 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:04:56.329086 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:04:56.329086 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:04:56.329086 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:04:56.329086 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:04:56.329086 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:04:56.329086 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:04:56.329086 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:04:56.329086 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:04:56.329086 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:04:56.330441 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:04:56.330441 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:04:56.330441 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:04:56.330441 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:04:56.330441 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:04:56.330441 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:04:56.330441 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:04:56.330441 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:04:56.330441 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:04:56.330441 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:04:56.330441 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:04:56.330441 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jun 22 10:04:56.330441 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:04:56.330441 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:04:56.330441 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:04:56.330441 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:04:56.331590 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:04:56.331590 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:04:56.331590 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:04:56.331590 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:04:56.331590 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:04:56.331590 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:04:56.331590 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:04:56.331590 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:04:56.331590 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:04:56.331590 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:04:56.331590 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 10:04:56.331590 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:04:56.331590 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 593/1180] 10.222.0.43 () {56 vars in 1096 bytes} [Wed Jun 22 10:04:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:04:56.336379 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cfdad7-3b3d-4f27-9380-ed6383f85b46 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:04:56.419092 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:04:56.435426 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cfdad7-3b3d-4f27-9380-ed6383f85b46 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:04:56.469171 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b6a208-7364-4086-bc72-64293eb2b3c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:04:56.469870 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b6a208-7364-4086-bc72-64293eb2b3c5 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:56.470158 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b6a208-7364-4086-bc72-64293eb2b3c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:56.470435 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b6a208-7364-4086-bc72-64293eb2b3c5 None admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:56.472153 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b6a208-7364-4086-bc72-64293eb2b3c5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:04:56.472463 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b6a208-7364-4086-bc72-64293eb2b3c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:04:56.475489 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b6a208-7364-4086-bc72-64293eb2b3c5 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:04:56.489913 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 588/1181] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Jun 22 10:04:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:04:56.495706 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc2c3be-db94-4016-837b-d9b17c4b5d95 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:04:56.608428 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc2c3be-db94-4016-837b-d9b17c4b5d95 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:04:56.635707 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:04:56.641725 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c91779-ba41-4231-80e1-a7ce78692df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:04:56.643100 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c91779-ba41-4231-80e1-a7ce78692df8 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:56.643386 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c91779-ba41-4231-80e1-a7ce78692df8 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:56.643660 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c91779-ba41-4231-80e1-a7ce78692df8 None admin] PATH_INFO: `/v3/users/24d283f352da43898c923bbc544d7960` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:56.656244 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c91779-ba41-4231-80e1-a7ce78692df8 None admin] RBAC: Authorizing `identity:get_user(user_id=24d283f352da43898c923bbc544d7960)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:04:56.657673 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c91779-ba41-4231-80e1-a7ce78692df8 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:04:56.659978 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 594/1182] 10.222.0.43 () {56 vars in 1177 bytes} [Wed Jun 22 10:04:56 2022] GET /identity/v3/users/24d283f352da43898c923bbc544d7960 => generated 311 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:04:56.665744 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b6a208-7364-4086-bc72-64293eb2b3c5 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:04:56.761237 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b6a208-7364-4086-bc72-64293eb2b3c5 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:04:56.794207 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fada2e2-cdf8-43f5-aa38-5a1170bb080a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:04:56.794838 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fada2e2-cdf8-43f5-aa38-5a1170bb080a None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:56.795122 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fada2e2-cdf8-43f5-aa38-5a1170bb080a None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:56.795398 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fada2e2-cdf8-43f5-aa38-5a1170bb080a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:56.815087 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:04:56.865845 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fada2e2-cdf8-43f5-aa38-5a1170bb080a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:04:56.867207 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fada2e2-cdf8-43f5-aa38-5a1170bb080a None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:04:56.963404 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 589/1183] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Jun 22 10:04:56 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 10:04:56.969246 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c91779-ba41-4231-80e1-a7ce78692df8 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:04:57.064927 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c91779-ba41-4231-80e1-a7ce78692df8 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:04:57.098209 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f068a4a8-8b56-48ce-9819-ec91b401b21f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:04:57.099059 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f068a4a8-8b56-48ce-9819-ec91b401b21f None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:57.099342 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f068a4a8-8b56-48ce-9819-ec91b401b21f None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:57.099619 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f068a4a8-8b56-48ce-9819-ec91b401b21f None admin] PATH_INFO: `/v3/projects/4143e63f538a4286ad0d0884714662d0` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:57.100794 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f068a4a8-8b56-48ce-9819-ec91b401b21f None admin] RBAC: Authorizing `identity:get_project(project_id=4143e63f538a4286ad0d0884714662d0)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:04:57.102505 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f068a4a8-8b56-48ce-9819-ec91b401b21f None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:04:57.104186 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 595/1184] 10.222.0.43 () {56 vars in 1186 bytes} [Wed Jun 22 10:04:56 2022] GET /identity/v3/projects/4143e63f538a4286ad0d0884714662d0 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:04:57.110351 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fada2e2-cdf8-43f5-aa38-5a1170bb080a None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:04:57.157448 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:04:57.207446 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fada2e2-cdf8-43f5-aa38-5a1170bb080a None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:04:57.240073 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52235d7-b390-445b-bd7b-a9dd4e129c4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:04:57.240712 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52235d7-b390-445b-bd7b-a9dd4e129c4a None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:57.240995 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52235d7-b390-445b-bd7b-a9dd4e129c4a None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:57.241273 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52235d7-b390-445b-bd7b-a9dd4e129c4a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:57.242120 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52235d7-b390-445b-bd7b-a9dd4e129c4a None admin] RBAC: Adding query filter params (role.id=26d9c2ab5dfc4e6d9ca80c6014123906, scope.project.id=4143e63f538a4286ad0d0884714662d0, user.id=24d283f352da43898c923bbc544d7960) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:04:57.242430 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52235d7-b390-445b-bd7b-a9dd4e129c4a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:04:57.243860 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52235d7-b390-445b-bd7b-a9dd4e129c4a None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:04:57.249130 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 590/1185] 10.222.0.43 () {56 vars in 1374 bytes} [Wed Jun 22 10:04:57 2022] GET /identity/v3/role_assignments?user.id=24d283f352da43898c923bbc544d7960&scope.project.id=4143e63f538a4286ad0d0884714662d0&role.id=26d9c2ab5dfc4e6d9ca80c6014123906 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:04:59.258767 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a7b89c-89e7-4631-b08b-028f6f843d1a None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:59.259296 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a7b89c-89e7-4631-b08b-028f6f843d1a None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:59.259296 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a7b89c-89e7-4631-b08b-028f6f843d1a None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:59.260679 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 596/1186] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:04:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:04:59.265883 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3453a6-06b3-43ca-b73c-a4d5939541dc None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:59.266269 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3453a6-06b3-43ca-b73c-a4d5939541dc None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:59.266450 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3453a6-06b3-43ca-b73c-a4d5939541dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:59.282767 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-8b3453a6-06b3-43ca-b73c-a4d5939541dc None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:04:59.284419 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-8b3453a6-06b3-43ca-b73c-a4d5939541dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:04:59.348732 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 591/1187] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:04:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 10:04:59.371846 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a7b89c-89e7-4631-b08b-028f6f843d1a None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:04:59.427786 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:04:59.471222 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a7b89c-89e7-4631-b08b-028f6f843d1a None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:04:59.510123 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d3f351-dc15-4b1d-a029-045bd1deca59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:04:59.510909 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d3f351-dc15-4b1d-a029-045bd1deca59 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:59.511193 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d3f351-dc15-4b1d-a029-045bd1deca59 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:59.511468 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d3f351-dc15-4b1d-a029-045bd1deca59 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:59.521859 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d3f351-dc15-4b1d-a029-045bd1deca59 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:04:59.529873 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-a7d3f351-dc15-4b1d-a029-045bd1deca59 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 10:04:59.529873 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:04:59.529873 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:04:59.529873 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:04:59.529873 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:04:59.529873 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:04:59.529873 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:04:59.529873 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:04:59.529873 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:04:59.529873 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:04:59.529873 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:04:59.529873 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:04:59.529873 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:04:59.529873 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:04:59.529873 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:04:59.529873 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:04:59.531014 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:04:59.531014 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:04:59.531014 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:04:59.531014 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:04:59.531014 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:04:59.531014 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:04:59.531014 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:04:59.531014 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:04:59.531014 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:04:59.531014 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:04:59.531014 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:04:59.531014 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jun 22 10:04:59.531014 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:04:59.531014 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:04:59.531014 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:04:59.531014 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:04:59.532101 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:04:59.532101 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:04:59.532101 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:04:59.532101 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:04:59.532101 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:04:59.532101 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:04:59.532101 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:04:59.532101 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:04:59.532101 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:04:59.532101 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:04:59.532101 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 10:04:59.532101 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:04:59.532101 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 597/1188] 10.222.0.43 () {56 vars in 1096 bytes} [Wed Jun 22 10:04:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:04:59.538164 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3453a6-06b3-43ca-b73c-a4d5939541dc None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:04:59.581223 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:04:59.636606 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3453a6-06b3-43ca-b73c-a4d5939541dc None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:04:59.671913 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075aaff9-9297-4746-9a38-3dcafdc34809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:04:59.672572 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075aaff9-9297-4746-9a38-3dcafdc34809 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:59.672852 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075aaff9-9297-4746-9a38-3dcafdc34809 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:59.673126 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075aaff9-9297-4746-9a38-3dcafdc34809 None admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:59.674202 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075aaff9-9297-4746-9a38-3dcafdc34809 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:04:59.674331 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075aaff9-9297-4746-9a38-3dcafdc34809 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:04:59.675675 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075aaff9-9297-4746-9a38-3dcafdc34809 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:04:59.683439 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 592/1189] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Jun 22 10:04:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:04:59.689164 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d3f351-dc15-4b1d-a029-045bd1deca59 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:04:59.786749 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d3f351-dc15-4b1d-a029-045bd1deca59 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:04:59.802639 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:04:59.819982 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5167f0bc-374a-4a25-8e9d-9274a88f0d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:04:59.820845 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5167f0bc-374a-4a25-8e9d-9274a88f0d0d None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:59.821126 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5167f0bc-374a-4a25-8e9d-9274a88f0d0d None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:59.821401 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5167f0bc-374a-4a25-8e9d-9274a88f0d0d None admin] PATH_INFO: `/v3/users/24d283f352da43898c923bbc544d7960` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:59.822648 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5167f0bc-374a-4a25-8e9d-9274a88f0d0d None admin] RBAC: Authorizing `identity:get_user(user_id=24d283f352da43898c923bbc544d7960)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:04:59.824074 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5167f0bc-374a-4a25-8e9d-9274a88f0d0d None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:04:59.825676 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 598/1190] 10.222.0.43 () {56 vars in 1177 bytes} [Wed Jun 22 10:04:59 2022] GET /identity/v3/users/24d283f352da43898c923bbc544d7960 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:04:59.831847 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075aaff9-9297-4746-9a38-3dcafdc34809 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:04:59.932891 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075aaff9-9297-4746-9a38-3dcafdc34809 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:04:59.935217 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:04:59.967600 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6942e273-29ca-4a29-8385-87dba1aeb316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:04:59.968456 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6942e273-29ca-4a29-8385-87dba1aeb316 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:04:59.968745 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6942e273-29ca-4a29-8385-87dba1aeb316 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:04:59.969028 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6942e273-29ca-4a29-8385-87dba1aeb316 None admin] PATH_INFO: `/v3/projects/4143e63f538a4286ad0d0884714662d0` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:04:59.970225 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6942e273-29ca-4a29-8385-87dba1aeb316 None admin] RBAC: Authorizing `identity:get_project(project_id=4143e63f538a4286ad0d0884714662d0)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:04:59.971936 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6942e273-29ca-4a29-8385-87dba1aeb316 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:04:59.973630 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 593/1191] 10.222.0.43 () {56 vars in 1186 bytes} [Wed Jun 22 10:04:59 2022] GET /identity/v3/projects/4143e63f538a4286ad0d0884714662d0 => generated 361 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:04:59.979750 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5167f0bc-374a-4a25-8e9d-9274a88f0d0d None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:05:00.076617 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5167f0bc-374a-4a25-8e9d-9274a88f0d0d None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:05:00.110135 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c99905-ae9a-4219-b577-bf1afd6c1b7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:05:00.111024 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c99905-ae9a-4219-b577-bf1afd6c1b7f None admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:05:00.111883 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c99905-ae9a-4219-b577-bf1afd6c1b7f None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:05:00.112168 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c99905-ae9a-4219-b577-bf1afd6c1b7f None admin] PATH_INFO: `/v3/projects/4143e63f538a4286ad0d0884714662d0/users/24d283f352da43898c923bbc544d7960/roles/26d9c2ab5dfc4e6d9ca80c6014123906` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:05:00.114154 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c99905-ae9a-4219-b577-bf1afd6c1b7f None admin] RBAC: Authorizing `identity:create_grant(project_id=4143e63f538a4286ad0d0884714662d0, user_id=24d283f352da43898c923bbc544d7960, role_id=26d9c2ab5dfc4e6d9ca80c6014123906)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:05:00.115586 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c99905-ae9a-4219-b577-bf1afd6c1b7f None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:05:00.129012 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 599/1192] 10.222.0.43 () {58 vars in 1439 bytes} [Wed Jun 22 10:04:59 2022] PUT /identity/v3/projects/4143e63f538a4286ad0d0884714662d0/users/24d283f352da43898c923bbc544d7960/roles/26d9c2ab5dfc4e6d9ca80c6014123906 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:05:02.128091 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd610406-b616-4dec-acb0-2e6698f46b4c None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:05:02.128552 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd610406-b616-4dec-acb0-2e6698f46b4c None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:05:02.128666 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd610406-b616-4dec-acb0-2e6698f46b4c None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:05:02.130069 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 594/1193] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:05:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:05:02.135109 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc72fb63-d99d-4034-a782-085eaae505dc None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:05:02.135494 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc72fb63-d99d-4034-a782-085eaae505dc None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:05:02.135679 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc72fb63-d99d-4034-a782-085eaae505dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:05:02.154073 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-bc72fb63-d99d-4034-a782-085eaae505dc None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:05:02.155246 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-bc72fb63-d99d-4034-a782-085eaae505dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:05:02.193871 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:05:02.220050 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 600/1194] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:05:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 10:05:02.243875 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd610406-b616-4dec-acb0-2e6698f46b4c None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:05:02.344329 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd610406-b616-4dec-acb0-2e6698f46b4c None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:05:02.377545 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fd0b01-67ca-4e13-8b31-f3a055f6505e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:05:02.378290 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fd0b01-67ca-4e13-8b31-f3a055f6505e None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:05:02.378568 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fd0b01-67ca-4e13-8b31-f3a055f6505e None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:05:02.378840 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fd0b01-67ca-4e13-8b31-f3a055f6505e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:05:02.388999 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fd0b01-67ca-4e13-8b31-f3a055f6505e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:05:02.397258 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-64fd0b01-67ca-4e13-8b31-f3a055f6505e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 10:05:02.397258 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:05:02.397258 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:05:02.397258 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:05:02.397258 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:05:02.397258 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:05:02.397258 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:05:02.397258 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:05:02.397258 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:05:02.397258 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:05:02.397258 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:05:02.397258 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:05:02.397258 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:05:02.397258 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:05:02.397258 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:05:02.397258 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:05:02.398470 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:05:02.398470 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:05:02.398470 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:05:02.398470 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:05:02.398470 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:05:02.398470 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:05:02.398470 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:05:02.398470 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:05:02.398470 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:05:02.398470 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:05:02.398470 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:05:02.398470 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( Jun 22 10:05:02.398470 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:05:02.398470 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:05:02.398470 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:05:02.398470 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:05:02.399524 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:05:02.399524 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:05:02.399524 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:05:02.399524 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:05:02.399524 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:05:02.399524 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:05:02.399524 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:05:02.399524 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:05:02.399524 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:05:02.399524 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:05:02.399524 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 10:05:02.399524 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:05:02.399524 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 595/1195] 10.222.0.43 () {56 vars in 1096 bytes} [Wed Jun 22 10:05:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:05:02.404503 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc72fb63-d99d-4034-a782-085eaae505dc None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:05:02.502843 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc72fb63-d99d-4034-a782-085eaae505dc None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:05:02.539183 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02908a9-0d55-4572-881c-445444799e48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:05:02.539860 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02908a9-0d55-4572-881c-445444799e48 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:05:02.540165 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02908a9-0d55-4572-881c-445444799e48 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:05:02.540447 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02908a9-0d55-4572-881c-445444799e48 None admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:05:02.541200 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02908a9-0d55-4572-881c-445444799e48 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:05:02.541513 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02908a9-0d55-4572-881c-445444799e48 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:05:02.542928 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02908a9-0d55-4572-881c-445444799e48 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:05:02.551751 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 601/1196] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Jun 22 10:05:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:05:02.557484 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fd0b01-67ca-4e13-8b31-f3a055f6505e None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:05:02.588159 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:05:02.654656 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fd0b01-67ca-4e13-8b31-f3a055f6505e None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:05:02.689188 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61e7944-8391-4293-9992-189ff3172a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:05:02.690636 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61e7944-8391-4293-9992-189ff3172a15 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:05:02.690923 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61e7944-8391-4293-9992-189ff3172a15 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:05:02.691200 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61e7944-8391-4293-9992-189ff3172a15 None admin] PATH_INFO: `/v3/users/24d283f352da43898c923bbc544d7960` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:05:02.692381 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61e7944-8391-4293-9992-189ff3172a15 None admin] RBAC: Authorizing `identity:get_user(user_id=24d283f352da43898c923bbc544d7960)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:05:02.693849 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61e7944-8391-4293-9992-189ff3172a15 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:05:02.695465 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 596/1197] 10.222.0.43 () {56 vars in 1177 bytes} [Wed Jun 22 10:05:02 2022] GET /identity/v3/users/24d283f352da43898c923bbc544d7960 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:05:02.701142 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02908a9-0d55-4572-881c-445444799e48 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:05:02.735469 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:05:02.798528 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02908a9-0d55-4572-881c-445444799e48 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:05:02.838036 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a727fb-4cd7-490c-8c0c-5c54cb6bafab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:05:02.838681 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a727fb-4cd7-490c-8c0c-5c54cb6bafab None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:05:02.838961 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a727fb-4cd7-490c-8c0c-5c54cb6bafab None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:05:02.839234 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a727fb-4cd7-490c-8c0c-5c54cb6bafab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:05:02.904727 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a727fb-4cd7-490c-8c0c-5c54cb6bafab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:05:02.906118 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a727fb-4cd7-490c-8c0c-5c54cb6bafab None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:05:02.939461 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:05:03.008229 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 602/1198] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Jun 22 10:05:02 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 10:05:03.014113 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61e7944-8391-4293-9992-189ff3172a15 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:05:03.109521 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:05:03.113268 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61e7944-8391-4293-9992-189ff3172a15 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:05:03.147360 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4558b930-aeb0-49ce-8601-38182bdc1f06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:05:03.148213 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4558b930-aeb0-49ce-8601-38182bdc1f06 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:05:03.148500 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4558b930-aeb0-49ce-8601-38182bdc1f06 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:05:03.148780 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4558b930-aeb0-49ce-8601-38182bdc1f06 None admin] PATH_INFO: `/v3/projects/4143e63f538a4286ad0d0884714662d0` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:05:03.150046 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4558b930-aeb0-49ce-8601-38182bdc1f06 None admin] RBAC: Authorizing `identity:get_project(project_id=4143e63f538a4286ad0d0884714662d0)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:05:03.151511 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4558b930-aeb0-49ce-8601-38182bdc1f06 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:05:03.153217 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 597/1199] 10.222.0.43 () {56 vars in 1186 bytes} [Wed Jun 22 10:05:03 2022] GET /identity/v3/projects/4143e63f538a4286ad0d0884714662d0 => generated 361 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:05:03.160049 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a727fb-4cd7-490c-8c0c-5c54cb6bafab None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:05:03.255735 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a727fb-4cd7-490c-8c0c-5c54cb6bafab None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:05:03.296334 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb41c2a5-ee92-4b7a-9af4-439214f5db69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:05:03.296990 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb41c2a5-ee92-4b7a-9af4-439214f5db69 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:05:03.297274 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb41c2a5-ee92-4b7a-9af4-439214f5db69 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:05:03.297551 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb41c2a5-ee92-4b7a-9af4-439214f5db69 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:05:03.298412 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb41c2a5-ee92-4b7a-9af4-439214f5db69 None admin] RBAC: Adding query filter params (role.id=26d9c2ab5dfc4e6d9ca80c6014123906, scope.project.id=4143e63f538a4286ad0d0884714662d0, user.id=24d283f352da43898c923bbc544d7960) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:05:03.298724 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb41c2a5-ee92-4b7a-9af4-439214f5db69 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:05:03.300148 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb41c2a5-ee92-4b7a-9af4-439214f5db69 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:05:03.302980 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:05:03.307483 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 603/1200] 10.222.0.43 () {56 vars in 1374 bytes} [Wed Jun 22 10:05:03 2022] GET /identity/v3/role_assignments?user.id=24d283f352da43898c923bbc544d7960&scope.project.id=4143e63f538a4286ad0d0884714662d0&role.id=26d9c2ab5dfc4e6d9ca80c6014123906 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:05:13.143408 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=16 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:05:59.228384 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ece47dd-ce2b-49c1-b16f-c5312e0d6cf0 None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:05:59.228384 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ece47dd-ce2b-49c1-b16f-c5312e0d6cf0 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:05:59.228384 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ece47dd-ce2b-49c1-b16f-c5312e0d6cf0 None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:05:59.229843 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 598/1201] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:05:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:05:59.235866 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401ec61c-75e4-4291-b9fd-16c66d167e05 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:05:59.236397 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401ec61c-75e4-4291-b9fd-16c66d167e05 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:05:59.236562 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401ec61c-75e4-4291-b9fd-16c66d167e05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:05:59.256767 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-401ec61c-75e4-4291-b9fd-16c66d167e05 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:05:59.258207 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-401ec61c-75e4-4291-b9fd-16c66d167e05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:05:59.350398 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 604/1202] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:05:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 10:05:59.376480 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ece47dd-ce2b-49c1-b16f-c5312e0d6cf0 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:05:59.510097 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ece47dd-ce2b-49c1-b16f-c5312e0d6cf0 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:05:59.556038 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c258a30a-a383-455c-a493-44dc9220d186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:05:59.556965 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c258a30a-a383-455c-a493-44dc9220d186 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:05:59.557257 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c258a30a-a383-455c-a493-44dc9220d186 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:05:59.557542 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c258a30a-a383-455c-a493-44dc9220d186 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:05:59.571085 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c258a30a-a383-455c-a493-44dc9220d186 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:05:59.572792 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c258a30a-a383-455c-a493-44dc9220d186 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:05:59.596617 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-c258a30a-a383-455c-a493-44dc9220d186 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:05:59.596617 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:05:59.596617 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:05:59.596617 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:05:59.596617 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:05:59.596617 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:05:59.596617 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:05:59.596617 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:05:59.596617 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:05:59.596617 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:05:59.596617 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:05:59.596617 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:05:59.596617 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:05:59.596617 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:05:59.596617 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:05:59.597716 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:05:59.597716 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:05:59.597716 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:05:59.597716 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:05:59.597716 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:05:59.597716 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:05:59.597716 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:05:59.597716 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:05:59.597716 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( Jun 22 10:05:59.597716 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:05:59.597716 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:05:59.597716 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:05:59.597716 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:05:59.597716 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:05:59.597716 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:05:59.597716 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:05:59.597716 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:05:59.602902 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:05:59.602902 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:05:59.602902 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:05:59.602902 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:05:59.602902 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 599/1203] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jun 22 10:05:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:05:59.604462 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401ec61c-75e4-4291-b9fd-16c66d167e05 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:05:59.735638 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401ec61c-75e4-4291-b9fd-16c66d167e05 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:05:59.774327 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:05:59.783286 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a231fc4-6ad7-41b1-9fad-b9216f2bbced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:05:59.784115 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a231fc4-6ad7-41b1-9fad-b9216f2bbced None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:05:59.784400 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a231fc4-6ad7-41b1-9fad-b9216f2bbced None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:05:59.784675 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a231fc4-6ad7-41b1-9fad-b9216f2bbced None admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:05:59.785574 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a231fc4-6ad7-41b1-9fad-b9216f2bbced None admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:05:59.785999 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a231fc4-6ad7-41b1-9fad-b9216f2bbced None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:05:59.787384 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a231fc4-6ad7-41b1-9fad-b9216f2bbced None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:05:59.806575 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 605/1204] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Jun 22 10:05:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:05:59.807791 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c258a30a-a383-455c-a493-44dc9220d186 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:05:59.883630 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:05:59.960020 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c258a30a-a383-455c-a493-44dc9220d186 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:00.005510 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4341a93d-838f-4d36-8c49-2c5d322a231c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:00.006150 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4341a93d-838f-4d36-8c49-2c5d322a231c None admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:00.006440 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4341a93d-838f-4d36-8c49-2c5d322a231c None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:00.006723 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4341a93d-838f-4d36-8c49-2c5d322a231c None admin] PATH_INFO: `/v3/users` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:00.008075 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4341a93d-838f-4d36-8c49-2c5d322a231c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:06:00.008953 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4341a93d-838f-4d36-8c49-2c5d322a231c None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:06:00.034741 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 600/1205] 10.222.0.43 () {60 vars in 1132 bytes} [Wed Jun 22 10:05:59 2022] POST /identity/v3/users => generated 251 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:06:02.405481 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbd57f8-5616-439c-a2c1-a76c0bb67019 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:02.406809 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbd57f8-5616-439c-a2c1-a76c0bb67019 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:02.406809 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbd57f8-5616-439c-a2c1-a76c0bb67019 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:02.408220 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 606/1206] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:06:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:06:02.414697 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eec9f9-8b90-49c3-ab3b-39d61f881647 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:02.414697 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eec9f9-8b90-49c3-ab3b-39d61f881647 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:02.415327 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eec9f9-8b90-49c3-ab3b-39d61f881647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:02.434303 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-b3eec9f9-8b90-49c3-ab3b-39d61f881647 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:06:02.435651 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-b3eec9f9-8b90-49c3-ab3b-39d61f881647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:06:02.518101 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 601/1207] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:06:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 10:06:02.543095 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbd57f8-5616-439c-a2c1-a76c0bb67019 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:02.658905 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbd57f8-5616-439c-a2c1-a76c0bb67019 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:02.697875 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6b5138-856d-4154-ac05-40403757da5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:02.698745 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6b5138-856d-4154-ac05-40403757da5c None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:02.699033 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6b5138-856d-4154-ac05-40403757da5c None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:02.699313 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6b5138-856d-4154-ac05-40403757da5c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:02.712901 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6b5138-856d-4154-ac05-40403757da5c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:06:02.722781 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-da6b5138-856d-4154-ac05-40403757da5c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 10:06:02.722781 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:06:02.722781 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:06:02.722781 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:06:02.722781 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:06:02.722781 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:06:02.722781 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:06:02.722781 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:06:02.722781 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:06:02.722781 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:06:02.722781 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:06:02.722781 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:06:02.722781 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:06:02.722781 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:06:02.722781 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:06:02.722781 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:06:02.724067 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:06:02.724067 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:06:02.724067 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:06:02.724067 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:06:02.724067 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:06:02.724067 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:06:02.724067 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:06:02.724067 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:06:02.724067 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:06:02.724067 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:06:02.724067 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:06:02.724067 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jun 22 10:06:02.724067 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:06:02.724067 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:06:02.724067 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:06:02.724067 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:06:02.724929 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:06:02.724929 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:06:02.724929 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:06:02.724929 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:06:02.724929 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:06:02.724929 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:06:02.724929 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:06:02.724929 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:06:02.724929 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:06:02.724929 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:06:02.724929 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 10:06:02.724929 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:06:02.724929 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 607/1208] 10.222.0.43 () {56 vars in 1102 bytes} [Wed Jun 22 10:06:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 10:06:02.730992 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eec9f9-8b90-49c3-ab3b-39d61f881647 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:02.776922 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:06:02.850826 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eec9f9-8b90-49c3-ab3b-39d61f881647 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:02.891608 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99cbb48-4ba9-4019-9b8f-15cdcf01325e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:02.892284 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99cbb48-4ba9-4019-9b8f-15cdcf01325e None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:02.892575 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99cbb48-4ba9-4019-9b8f-15cdcf01325e None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:02.892845 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99cbb48-4ba9-4019-9b8f-15cdcf01325e None admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:02.893594 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99cbb48-4ba9-4019-9b8f-15cdcf01325e None admin] RBAC: Adding query filter params (name=service) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:06:02.893927 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99cbb48-4ba9-4019-9b8f-15cdcf01325e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:06:02.895308 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99cbb48-4ba9-4019-9b8f-15cdcf01325e None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:06:02.909077 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 602/1209] 10.222.0.43 () {56 vars in 1103 bytes} [Wed Jun 22 10:06:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:06:02.910852 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6b5138-856d-4154-ac05-40403757da5c None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:02.977192 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:06:03.033164 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6b5138-856d-4154-ac05-40403757da5c None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:03.069159 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90028454-d776-493f-84e4-6465eadb2a24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:03.070040 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90028454-d776-493f-84e4-6465eadb2a24 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:03.070267 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90028454-d776-493f-84e4-6465eadb2a24 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:03.070526 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90028454-d776-493f-84e4-6465eadb2a24 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:03.082155 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90028454-d776-493f-84e4-6465eadb2a24 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:06:03.084171 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90028454-d776-493f-84e4-6465eadb2a24 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:06:03.102430 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-90028454-d776-493f-84e4-6465eadb2a24 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:06:03.102430 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:06:03.102430 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:06:03.102430 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:06:03.102430 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:06:03.102430 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:06:03.102430 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:06:03.102430 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:06:03.102430 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:06:03.102430 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:06:03.102430 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:06:03.102430 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:06:03.102430 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:06:03.102430 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:06:03.102430 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:06:03.103474 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:06:03.103474 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:06:03.103474 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:06:03.103474 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:06:03.103474 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:06:03.103474 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:06:03.103474 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:06:03.103474 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:06:03.103474 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jun 22 10:06:03.103474 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:06:03.103474 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:06:03.103474 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:06:03.103474 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:06:03.103474 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:06:03.103474 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:06:03.103474 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:06:03.103474 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:06:03.104403 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:06:03.104403 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:06:03.104403 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:06:03.104403 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:06:03.104403 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 608/1210] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jun 22 10:06:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:06:03.110911 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99cbb48-4ba9-4019-9b8f-15cdcf01325e None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:03.230224 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:06:03.233603 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99cbb48-4ba9-4019-9b8f-15cdcf01325e None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:03.280612 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64021c8c-0be2-4298-bd76-33cdc9ca5f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:03.282083 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64021c8c-0be2-4298-bd76-33cdc9ca5f61 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:03.282442 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64021c8c-0be2-4298-bd76-33cdc9ca5f61 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:03.282809 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64021c8c-0be2-4298-bd76-33cdc9ca5f61 None admin] PATH_INFO: `/v3/domains` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:03.283996 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64021c8c-0be2-4298-bd76-33cdc9ca5f61 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:06:03.284455 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64021c8c-0be2-4298-bd76-33cdc9ca5f61 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:06:03.286396 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64021c8c-0be2-4298-bd76-33cdc9ca5f61 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:06:03.301529 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 603/1211] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Jun 22 10:06:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:06:03.307573 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90028454-d776-493f-84e4-6465eadb2a24 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:03.431943 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90028454-d776-493f-84e4-6465eadb2a24 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:03.433736 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:06:03.477550 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a894740-f315-4b98-83b2-128b283a030c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:03.478731 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a894740-f315-4b98-83b2-128b283a030c None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:03.479074 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a894740-f315-4b98-83b2-128b283a030c None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:03.479357 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a894740-f315-4b98-83b2-128b283a030c None admin] PATH_INFO: `/v3/users/placement` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:03.488100 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a894740-f315-4b98-83b2-128b283a030c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:06:03.489465 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a894740-f315-4b98-83b2-128b283a030c None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:06:03.506484 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-8a894740-f315-4b98-83b2-128b283a030c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 22 10:06:03.506484 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:06:03.506484 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:06:03.506484 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:06:03.506484 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:06:03.506484 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:06:03.506484 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:06:03.506484 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:06:03.506484 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:06:03.506484 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:06:03.506484 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:06:03.506484 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:06:03.506484 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 10:06:03.506484 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 10:06:03.506484 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 10:06:03.506484 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 10:06:03.507927 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:06:03.507927 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:06:03.507927 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 10:06:03.507927 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:06:03.507927 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 10:06:03.507927 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:06:03.507927 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:06:03.507927 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:06:03.507927 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:06:03.507927 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:06:03.507927 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:06:03.507927 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jun 22 10:06:03.507927 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:06:03.507927 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:06:03.507927 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:06:03.507927 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:06:03.507927 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:06:03.507927 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:06:03.509072 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:06:03.509072 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:06:03.509072 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 10:06:03.509072 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 10:06:03.509072 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 10:06:03.509072 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 10:06:03.509072 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 10:06:03.509072 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 10:06:03.509072 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 22 10:06:03.509072 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:06:03.509072 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 609/1212] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jun 22 10:06:03 2022] GET /identity/v3/users/placement => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:06:03.518757 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64021c8c-0be2-4298-bd76-33cdc9ca5f61 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:03.641884 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64021c8c-0be2-4298-bd76-33cdc9ca5f61 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:03.688456 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0429411-c17b-4f78-b1b0-168e2f5f1f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:03.690139 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0429411-c17b-4f78-b1b0-168e2f5f1f6a None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:03.690139 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0429411-c17b-4f78-b1b0-168e2f5f1f6a None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:03.690139 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0429411-c17b-4f78-b1b0-168e2f5f1f6a None admin] PATH_INFO: `/v3/users` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:03.690831 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0429411-c17b-4f78-b1b0-168e2f5f1f6a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:06:03.691110 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0429411-c17b-4f78-b1b0-168e2f5f1f6a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:06:03.696926 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0429411-c17b-4f78-b1b0-168e2f5f1f6a None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:06:03.715946 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 604/1213] 10.222.0.43 () {56 vars in 1143 bytes} [Wed Jun 22 10:06:03 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:06:03.723287 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a894740-f315-4b98-83b2-128b283a030c None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:03.844479 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a894740-f315-4b98-83b2-128b283a030c None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:03.891394 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8960a3-f539-44b6-92d6-e39759913bdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:03.892148 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8960a3-f539-44b6-92d6-e39759913bdc None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:03.892525 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8960a3-f539-44b6-92d6-e39759913bdc None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:03.892899 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8960a3-f539-44b6-92d6-e39759913bdc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:03.929164 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:06:03.973484 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8960a3-f539-44b6-92d6-e39759913bdc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:06:03.975556 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8960a3-f539-44b6-92d6-e39759913bdc None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:06:04.101076 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 610/1214] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Jun 22 10:06:03 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 10:06:04.109242 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0429411-c17b-4f78-b1b0-168e2f5f1f6a None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:04.132371 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:06:04.234518 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0429411-c17b-4f78-b1b0-168e2f5f1f6a None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:04.272976 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc38a39-5bc1-4301-89fe-0db1ffe95c35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:04.273964 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc38a39-5bc1-4301-89fe-0db1ffe95c35 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:04.274342 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc38a39-5bc1-4301-89fe-0db1ffe95c35 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:04.274714 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc38a39-5bc1-4301-89fe-0db1ffe95c35 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:04.285700 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc38a39-5bc1-4301-89fe-0db1ffe95c35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:06:04.287396 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc38a39-5bc1-4301-89fe-0db1ffe95c35 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:06:04.307667 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-ffc38a39-5bc1-4301-89fe-0db1ffe95c35 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:06:04.307667 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:06:04.307667 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:06:04.307667 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:06:04.307667 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:06:04.307667 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:06:04.307667 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:06:04.307667 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:06:04.307667 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:06:04.307667 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:06:04.307667 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:06:04.307667 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:06:04.307667 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:06:04.307667 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:06:04.307667 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:06:04.308900 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:06:04.308900 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:06:04.308900 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:06:04.308900 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:06:04.308900 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:06:04.308900 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:06:04.308900 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:06:04.308900 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:06:04.308900 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( Jun 22 10:06:04.308900 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:06:04.308900 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:06:04.308900 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:06:04.308900 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:06:04.308900 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:06:04.308900 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:06:04.308900 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:06:04.308900 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:06:04.310051 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:06:04.310051 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:06:04.310051 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:06:04.310051 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:06:04.311020 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 605/1215] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jun 22 10:06:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:06:04.317436 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8960a3-f539-44b6-92d6-e39759913bdc None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:04.393453 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:06:04.439318 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8960a3-f539-44b6-92d6-e39759913bdc None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:04.477071 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d831a5c7-23c7-4867-a504-082cb8c56501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:04.478613 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d831a5c7-23c7-4867-a504-082cb8c56501 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:04.478613 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d831a5c7-23c7-4867-a504-082cb8c56501 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:04.478803 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d831a5c7-23c7-4867-a504-082cb8c56501 None admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:04.479525 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d831a5c7-23c7-4867-a504-082cb8c56501 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:06:04.479909 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d831a5c7-23c7-4867-a504-082cb8c56501 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:06:04.481350 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d831a5c7-23c7-4867-a504-082cb8c56501 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:06:04.495011 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 611/1216] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Jun 22 10:06:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:06:04.503067 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc38a39-5bc1-4301-89fe-0db1ffe95c35 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:04.591542 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:06:04.631279 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc38a39-5bc1-4301-89fe-0db1ffe95c35 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:04.680198 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c708823d-790d-4bf6-ba2a-32c779a947aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:04.681387 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c708823d-790d-4bf6-ba2a-32c779a947aa None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:04.681675 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c708823d-790d-4bf6-ba2a-32c779a947aa None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:04.681983 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c708823d-790d-4bf6-ba2a-32c779a947aa None admin] PATH_INFO: `/v3/projects/service` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:04.699138 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c708823d-790d-4bf6-ba2a-32c779a947aa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:06:04.700900 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c708823d-790d-4bf6-ba2a-32c779a947aa None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:06:04.719060 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-c708823d-790d-4bf6-ba2a-32c779a947aa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:06:04.719060 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:06:04.719060 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:06:04.719060 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:06:04.719060 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:06:04.719060 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:06:04.719060 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:06:04.719060 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:06:04.719060 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:06:04.719060 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:06:04.719060 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:06:04.719060 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:06:04.719060 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 10:06:04.719060 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 10:06:04.719060 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 10:06:04.720888 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 10:06:04.720888 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:06:04.720888 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:06:04.720888 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:06:04.720888 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:06:04.720888 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:06:04.720888 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:06:04.720888 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:06:04.720888 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( Jun 22 10:06:04.720888 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:06:04.720888 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:06:04.720888 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:06:04.720888 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:06:04.720888 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:06:04.720888 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:06:04.720888 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:06:04.720888 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:06:04.722578 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 10:06:04.722578 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 10:06:04.722578 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 10:06:04.722578 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 10:06:04.722578 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 10:06:04.722578 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 10:06:04.722578 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:06:04.722578 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:06:04.722578 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 606/1217] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Jun 22 10:06:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:06:04.729627 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d831a5c7-23c7-4867-a504-082cb8c56501 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:04.870260 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d831a5c7-23c7-4867-a504-082cb8c56501 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:04.896283 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:06:04.909513 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314246ff-5fd3-4321-9ba2-74b396d6ed3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:04.910580 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314246ff-5fd3-4321-9ba2-74b396d6ed3b None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:04.911103 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314246ff-5fd3-4321-9ba2-74b396d6ed3b None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:04.911589 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314246ff-5fd3-4321-9ba2-74b396d6ed3b None admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:04.912608 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314246ff-5fd3-4321-9ba2-74b396d6ed3b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:06:04.913156 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314246ff-5fd3-4321-9ba2-74b396d6ed3b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:06:04.914910 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314246ff-5fd3-4321-9ba2-74b396d6ed3b None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:06:04.938094 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 612/1218] 10.222.0.43 () {56 vars in 1148 bytes} [Wed Jun 22 10:06:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:06:04.941755 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c708823d-790d-4bf6-ba2a-32c779a947aa None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:05.068826 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c708823d-790d-4bf6-ba2a-32c779a947aa None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:05.111834 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:06:05.118277 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bfe14d-827f-4d9e-bfe2-92ef60e7185a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:05.118934 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bfe14d-827f-4d9e-bfe2-92ef60e7185a None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:05.119222 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bfe14d-827f-4d9e-bfe2-92ef60e7185a None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:05.119559 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bfe14d-827f-4d9e-bfe2-92ef60e7185a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:05.120571 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bfe14d-827f-4d9e-bfe2-92ef60e7185a None admin] RBAC: Adding query filter params (role.id=18493ce78e7c480c9202245b6d93cb4c, scope.project.id=e03f1c17e0884f188231d2949dc6f956, user.id=341ec95408c94dae8539ccff7225e3ba) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:06:05.120955 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bfe14d-827f-4d9e-bfe2-92ef60e7185a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:06:05.122577 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bfe14d-827f-4d9e-bfe2-92ef60e7185a None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:06:05.130936 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 607/1219] 10.222.0.43 () {56 vars in 1374 bytes} [Wed Jun 22 10:06:04 2022] GET /identity/v3/role_assignments?user.id=341ec95408c94dae8539ccff7225e3ba&scope.project.id=e03f1c17e0884f188231d2949dc6f956&role.id=18493ce78e7c480c9202245b6d93cb4c => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:06:07.265974 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457f773d-d6e2-4464-9472-e41b3f5c7d03 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:07.266504 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457f773d-d6e2-4464-9472-e41b3f5c7d03 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:07.266778 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457f773d-d6e2-4464-9472-e41b3f5c7d03 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:07.268403 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 613/1220] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:06:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:06:07.274043 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d43d07-145d-445b-a16c-4ee1f648377b None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:07.274484 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d43d07-145d-445b-a16c-4ee1f648377b None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:07.274610 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d43d07-145d-445b-a16c-4ee1f648377b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:07.292530 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-11d43d07-145d-445b-a16c-4ee1f648377b None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:06:07.293842 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-11d43d07-145d-445b-a16c-4ee1f648377b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:06:07.368577 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 608/1221] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:06:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 10:06:07.394030 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457f773d-d6e2-4464-9472-e41b3f5c7d03 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:07.512293 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457f773d-d6e2-4464-9472-e41b3f5c7d03 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:07.548254 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29caa904-1eef-4663-9dd0-431cd5f0ec30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:07.549080 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29caa904-1eef-4663-9dd0-431cd5f0ec30 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:07.549413 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29caa904-1eef-4663-9dd0-431cd5f0ec30 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:07.549651 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29caa904-1eef-4663-9dd0-431cd5f0ec30 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:07.561531 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29caa904-1eef-4663-9dd0-431cd5f0ec30 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:06:07.570039 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-29caa904-1eef-4663-9dd0-431cd5f0ec30 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 10:06:07.570039 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:06:07.570039 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:06:07.570039 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:06:07.570039 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:06:07.570039 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:06:07.570039 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:06:07.570039 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:06:07.570039 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:06:07.570039 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:06:07.570039 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:06:07.570039 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:06:07.570039 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:06:07.570039 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:06:07.570039 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:06:07.570039 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:06:07.571216 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:06:07.571216 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:06:07.571216 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:06:07.571216 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:06:07.571216 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:06:07.571216 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:06:07.571216 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:06:07.571216 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:06:07.571216 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:06:07.571216 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:06:07.571216 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:06:07.571216 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jun 22 10:06:07.571216 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:06:07.571216 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:06:07.571216 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:06:07.571216 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:06:07.572336 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:06:07.572336 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:06:07.572336 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:06:07.572336 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:06:07.572336 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:06:07.572336 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:06:07.572336 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:06:07.572336 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:06:07.572336 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:06:07.572336 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:06:07.572336 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 10:06:07.572336 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:06:07.572336 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 614/1222] 10.222.0.43 () {56 vars in 1102 bytes} [Wed Jun 22 10:06:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:06:07.577720 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d43d07-145d-445b-a16c-4ee1f648377b None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:07.695126 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d43d07-145d-445b-a16c-4ee1f648377b None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:07.720836 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:06:07.733233 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4de9d69-ece5-432a-bd57-8859bcd72936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:07.734697 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4de9d69-ece5-432a-bd57-8859bcd72936 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:07.735059 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4de9d69-ece5-432a-bd57-8859bcd72936 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:07.735339 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4de9d69-ece5-432a-bd57-8859bcd72936 None admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:07.736101 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4de9d69-ece5-432a-bd57-8859bcd72936 None admin] RBAC: Adding query filter params (name=service) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:06:07.736427 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4de9d69-ece5-432a-bd57-8859bcd72936 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:06:07.737937 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4de9d69-ece5-432a-bd57-8859bcd72936 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:06:07.747105 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 609/1223] 10.222.0.43 () {56 vars in 1103 bytes} [Wed Jun 22 10:06:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:06:07.753446 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29caa904-1eef-4663-9dd0-431cd5f0ec30 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:07.800366 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:06:07.868066 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29caa904-1eef-4663-9dd0-431cd5f0ec30 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:07.902784 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6bd969-2d38-4686-9053-8482c0b36d14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:07.903578 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6bd969-2d38-4686-9053-8482c0b36d14 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:07.903866 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6bd969-2d38-4686-9053-8482c0b36d14 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:07.904141 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6bd969-2d38-4686-9053-8482c0b36d14 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:07.915545 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6bd969-2d38-4686-9053-8482c0b36d14 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:06:07.917016 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6bd969-2d38-4686-9053-8482c0b36d14 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:06:07.935306 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-fe6bd969-2d38-4686-9053-8482c0b36d14 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:06:07.935306 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:06:07.935306 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:06:07.935306 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:06:07.935306 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:06:07.935306 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:06:07.935306 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:06:07.935306 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:06:07.935306 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:06:07.935306 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:06:07.935306 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:06:07.935306 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:06:07.935306 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:06:07.935306 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:06:07.935306 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:06:07.936314 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:06:07.936314 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:06:07.936314 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:06:07.936314 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:06:07.936314 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:06:07.936314 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:06:07.936314 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:06:07.936314 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:06:07.936314 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jun 22 10:06:07.936314 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:06:07.936314 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:06:07.936314 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:06:07.936314 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:06:07.936314 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:06:07.936314 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:06:07.936314 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:06:07.936314 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:06:07.938040 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:06:07.938040 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:06:07.938040 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:06:07.938040 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:06:07.938040 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 615/1224] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jun 22 10:06:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:06:07.942826 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4de9d69-ece5-432a-bd57-8859bcd72936 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:08.049009 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4de9d69-ece5-432a-bd57-8859bcd72936 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:08.089309 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7dbc8f-ddb0-4b4a-831d-1de7ee904b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:08.090020 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7dbc8f-ddb0-4b4a-831d-1de7ee904b09 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:08.090312 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7dbc8f-ddb0-4b4a-831d-1de7ee904b09 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:08.090595 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7dbc8f-ddb0-4b4a-831d-1de7ee904b09 None admin] PATH_INFO: `/v3/domains` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:08.091326 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7dbc8f-ddb0-4b4a-831d-1de7ee904b09 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:06:08.091640 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7dbc8f-ddb0-4b4a-831d-1de7ee904b09 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:06:08.093052 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7dbc8f-ddb0-4b4a-831d-1de7ee904b09 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:06:08.106376 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 610/1225] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Jun 22 10:06:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:06:08.113413 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6bd969-2d38-4686-9053-8482c0b36d14 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:08.217487 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:06:08.226838 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6bd969-2d38-4686-9053-8482c0b36d14 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:08.261644 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bb8dbb-d403-4b44-be60-8a0054d0adea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:08.262518 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bb8dbb-d403-4b44-be60-8a0054d0adea None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:08.262904 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bb8dbb-d403-4b44-be60-8a0054d0adea None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:08.263192 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bb8dbb-d403-4b44-be60-8a0054d0adea None admin] PATH_INFO: `/v3/users/placement` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:08.272087 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bb8dbb-d403-4b44-be60-8a0054d0adea None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:06:08.274361 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bb8dbb-d403-4b44-be60-8a0054d0adea None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:06:08.291093 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-32bb8dbb-d403-4b44-be60-8a0054d0adea None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 22 10:06:08.291093 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:06:08.291093 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:06:08.291093 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:06:08.291093 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:06:08.291093 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:06:08.291093 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:06:08.291093 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:06:08.291093 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:06:08.291093 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:06:08.291093 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:06:08.291093 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:06:08.291093 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 10:06:08.291093 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 10:06:08.291093 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 10:06:08.291093 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 10:06:08.292332 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:06:08.292332 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:06:08.292332 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 10:06:08.292332 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:06:08.292332 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 10:06:08.292332 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:06:08.292332 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:06:08.292332 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:06:08.292332 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:06:08.292332 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:06:08.292332 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:06:08.292332 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jun 22 10:06:08.292332 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:06:08.292332 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:06:08.292332 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:06:08.292332 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:06:08.292332 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:06:08.292332 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:06:08.293344 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:06:08.293344 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:06:08.293344 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 10:06:08.293344 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 10:06:08.293344 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 10:06:08.293344 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 10:06:08.293344 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 10:06:08.293344 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 10:06:08.293344 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 22 10:06:08.293344 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:06:08.293344 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 616/1226] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jun 22 10:06:08 2022] GET /identity/v3/users/placement => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:06:08.299203 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7dbc8f-ddb0-4b4a-831d-1de7ee904b09 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:08.347010 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:06:08.404239 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7dbc8f-ddb0-4b4a-831d-1de7ee904b09 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:08.443929 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78ef02d-11fd-4b16-a64a-f14e6701604d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:08.444605 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78ef02d-11fd-4b16-a64a-f14e6701604d None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:08.444890 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78ef02d-11fd-4b16-a64a-f14e6701604d None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:08.445168 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78ef02d-11fd-4b16-a64a-f14e6701604d None admin] PATH_INFO: `/v3/users` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:08.446028 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78ef02d-11fd-4b16-a64a-f14e6701604d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:06:08.446341 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78ef02d-11fd-4b16-a64a-f14e6701604d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:06:08.447812 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78ef02d-11fd-4b16-a64a-f14e6701604d None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:06:08.466584 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 611/1227] 10.222.0.43 () {56 vars in 1143 bytes} [Wed Jun 22 10:06:08 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:06:08.473264 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bb8dbb-d403-4b44-be60-8a0054d0adea None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:08.591868 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bb8dbb-d403-4b44-be60-8a0054d0adea None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:08.631243 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab64c74-4c02-454b-b80c-97947bc02e1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:08.632041 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab64c74-4c02-454b-b80c-97947bc02e1b None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:08.632324 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab64c74-4c02-454b-b80c-97947bc02e1b None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:08.632601 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab64c74-4c02-454b-b80c-97947bc02e1b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:08.644250 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab64c74-4c02-454b-b80c-97947bc02e1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:06:08.645747 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab64c74-4c02-454b-b80c-97947bc02e1b None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:06:08.664085 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-8ab64c74-4c02-454b-b80c-97947bc02e1b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:06:08.664085 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:06:08.664085 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:06:08.664085 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:06:08.664085 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:06:08.664085 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:06:08.664085 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:06:08.664085 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:06:08.664085 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:06:08.664085 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:06:08.664085 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:06:08.664085 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:06:08.664085 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:06:08.664085 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:06:08.664085 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:06:08.665334 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:06:08.665334 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:06:08.665334 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:06:08.665334 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:06:08.665334 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:06:08.665334 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:06:08.665334 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:06:08.665334 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:06:08.665334 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jun 22 10:06:08.665334 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:06:08.665334 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:06:08.665334 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:06:08.665334 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:06:08.665334 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:06:08.665334 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:06:08.665334 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:06:08.665334 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:06:08.666620 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:06:08.666620 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:06:08.666620 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:06:08.666620 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:06:08.666620 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 617/1228] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jun 22 10:06:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:06:08.672142 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78ef02d-11fd-4b16-a64a-f14e6701604d None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:08.788759 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78ef02d-11fd-4b16-a64a-f14e6701604d None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:08.791160 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:06:08.833471 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c676ec27-0211-49d0-9af1-45b29bb41687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:08.834345 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c676ec27-0211-49d0-9af1-45b29bb41687 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:08.834720 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c676ec27-0211-49d0-9af1-45b29bb41687 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:08.835125 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c676ec27-0211-49d0-9af1-45b29bb41687 None admin] PATH_INFO: `/v3/domains` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:08.835949 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c676ec27-0211-49d0-9af1-45b29bb41687 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:06:08.836332 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c676ec27-0211-49d0-9af1-45b29bb41687 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:06:08.837973 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c676ec27-0211-49d0-9af1-45b29bb41687 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:06:08.852686 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 612/1229] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Jun 22 10:06:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:06:08.859485 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab64c74-4c02-454b-b80c-97947bc02e1b None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:08.869382 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:06:08.973959 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab64c74-4c02-454b-b80c-97947bc02e1b None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:09.011953 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6235a127-a044-45d7-9f9f-7f9f78ccdd3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:09.013026 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6235a127-a044-45d7-9f9f-7f9f78ccdd3a None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:09.013315 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6235a127-a044-45d7-9f9f-7f9f78ccdd3a None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:09.013623 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6235a127-a044-45d7-9f9f-7f9f78ccdd3a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:09.022994 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6235a127-a044-45d7-9f9f-7f9f78ccdd3a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:06:09.024784 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6235a127-a044-45d7-9f9f-7f9f78ccdd3a None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:06:09.042229 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-6235a127-a044-45d7-9f9f-7f9f78ccdd3a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:06:09.042229 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:06:09.042229 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:06:09.042229 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:06:09.042229 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:06:09.042229 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:06:09.042229 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:06:09.042229 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:06:09.042229 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:06:09.042229 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:06:09.042229 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:06:09.042229 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:06:09.042229 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 10:06:09.042229 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 10:06:09.042229 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 10:06:09.043388 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 10:06:09.043388 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:06:09.043388 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:06:09.043388 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:06:09.043388 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:06:09.043388 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:06:09.043388 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:06:09.043388 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:06:09.043388 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jun 22 10:06:09.043388 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:06:09.043388 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:06:09.043388 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:06:09.043388 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:06:09.043388 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:06:09.043388 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:06:09.043388 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:06:09.043388 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:06:09.044581 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 10:06:09.044581 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 10:06:09.044581 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 10:06:09.044581 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 10:06:09.044581 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 10:06:09.044581 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 10:06:09.044581 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:06:09.044581 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:06:09.044581 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 618/1230] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Jun 22 10:06:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:06:09.050731 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c676ec27-0211-49d0-9af1-45b29bb41687 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:09.175902 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c676ec27-0211-49d0-9af1-45b29bb41687 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:09.214271 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4255234f-525d-481c-bed8-4d072751d0b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:09.214950 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4255234f-525d-481c-bed8-4d072751d0b3 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:09.215239 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4255234f-525d-481c-bed8-4d072751d0b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:09.215520 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4255234f-525d-481c-bed8-4d072751d0b3 None admin] PATH_INFO: `/v3/projects` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:09.216320 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4255234f-525d-481c-bed8-4d072751d0b3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:06:09.216637 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4255234f-525d-481c-bed8-4d072751d0b3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:06:09.219332 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4255234f-525d-481c-bed8-4d072751d0b3 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:06:09.232638 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 613/1231] 10.222.0.43 () {56 vars in 1148 bytes} [Wed Jun 22 10:06:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:06:09.239442 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6235a127-a044-45d7-9f9f-7f9f78ccdd3a None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:09.307077 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:06:09.344613 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6235a127-a044-45d7-9f9f-7f9f78ccdd3a None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:09.380671 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f708559-cbdb-44f2-95ee-1eae6c7b072b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:09.381613 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f708559-cbdb-44f2-95ee-1eae6c7b072b None admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:09.381999 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f708559-cbdb-44f2-95ee-1eae6c7b072b None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:09.382246 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f708559-cbdb-44f2-95ee-1eae6c7b072b None admin] PATH_INFO: `/v3/projects/e03f1c17e0884f188231d2949dc6f956/users/341ec95408c94dae8539ccff7225e3ba/roles/18493ce78e7c480c9202245b6d93cb4c` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:09.397985 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f708559-cbdb-44f2-95ee-1eae6c7b072b None admin] RBAC: Authorizing `identity:create_grant(project_id=e03f1c17e0884f188231d2949dc6f956, user_id=341ec95408c94dae8539ccff7225e3ba, role_id=18493ce78e7c480c9202245b6d93cb4c)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:06:09.399431 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f708559-cbdb-44f2-95ee-1eae6c7b072b None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:06:09.413710 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 619/1232] 10.222.0.43 () {58 vars in 1439 bytes} [Wed Jun 22 10:06:09 2022] PUT /identity/v3/projects/e03f1c17e0884f188231d2949dc6f956/users/341ec95408c94dae8539ccff7225e3ba/roles/18493ce78e7c480c9202245b6d93cb4c => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:06:11.549978 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321a41a2-f7ae-47fd-86e8-25d94f414cac None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:11.550518 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321a41a2-f7ae-47fd-86e8-25d94f414cac None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:11.550518 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321a41a2-f7ae-47fd-86e8-25d94f414cac None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:11.551906 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 614/1233] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:06:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:06:11.557279 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815dcd3c-f92c-4e9d-8083-06eeb8b64e71 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:11.557800 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815dcd3c-f92c-4e9d-8083-06eeb8b64e71 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:11.557800 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815dcd3c-f92c-4e9d-8083-06eeb8b64e71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:11.577260 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-815dcd3c-f92c-4e9d-8083-06eeb8b64e71 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:06:11.579044 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-815dcd3c-f92c-4e9d-8083-06eeb8b64e71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:06:11.662172 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 620/1234] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:06:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 10:06:11.688021 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321a41a2-f7ae-47fd-86e8-25d94f414cac None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:11.715148 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:06:11.800381 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321a41a2-f7ae-47fd-86e8-25d94f414cac None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:11.844250 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cf13ed-855a-4df9-939b-2a3caa54ed87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:11.845620 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cf13ed-855a-4df9-939b-2a3caa54ed87 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:11.845970 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cf13ed-855a-4df9-939b-2a3caa54ed87 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:11.846485 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cf13ed-855a-4df9-939b-2a3caa54ed87 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:11.864300 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cf13ed-855a-4df9-939b-2a3caa54ed87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:06:11.874672 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-c6cf13ed-855a-4df9-939b-2a3caa54ed87 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 10:06:11.874672 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:06:11.874672 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:06:11.874672 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:06:11.874672 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:06:11.874672 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:06:11.874672 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:06:11.874672 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:06:11.874672 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:06:11.874672 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:06:11.874672 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:06:11.874672 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:06:11.874672 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:06:11.874672 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:06:11.874672 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:06:11.874672 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:06:11.875709 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:06:11.875709 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:06:11.875709 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:06:11.875709 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:06:11.875709 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:06:11.875709 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:06:11.875709 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:06:11.875709 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:06:11.875709 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:06:11.875709 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:06:11.875709 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:06:11.875709 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( Jun 22 10:06:11.875709 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:06:11.875709 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:06:11.875709 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:06:11.875709 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:06:11.878375 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:06:11.878375 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:06:11.878375 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:06:11.878375 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:06:11.878375 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:06:11.878375 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:06:11.878375 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:06:11.878375 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:06:11.878375 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:06:11.878375 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:06:11.878375 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 10:06:11.878375 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:06:11.878375 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 615/1235] 10.222.0.43 () {56 vars in 1102 bytes} [Wed Jun 22 10:06:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:06:11.882200 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815dcd3c-f92c-4e9d-8083-06eeb8b64e71 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:11.937125 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:06:12.009461 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815dcd3c-f92c-4e9d-8083-06eeb8b64e71 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:12.051019 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a4b822-6532-4299-a221-1c488bf71e07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:12.051713 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a4b822-6532-4299-a221-1c488bf71e07 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:12.051906 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a4b822-6532-4299-a221-1c488bf71e07 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:12.052189 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a4b822-6532-4299-a221-1c488bf71e07 None admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:12.052940 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a4b822-6532-4299-a221-1c488bf71e07 None admin] RBAC: Adding query filter params (name=service) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:06:12.053247 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a4b822-6532-4299-a221-1c488bf71e07 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:06:12.054747 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a4b822-6532-4299-a221-1c488bf71e07 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:06:12.064283 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 621/1236] 10.222.0.43 () {56 vars in 1103 bytes} [Wed Jun 22 10:06:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:06:12.069972 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cf13ed-855a-4df9-939b-2a3caa54ed87 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:12.187379 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:06:12.206248 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cf13ed-855a-4df9-939b-2a3caa54ed87 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:12.246243 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa4a6fa-da7c-44aa-9cd7-baf1f0335977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:12.247261 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa4a6fa-da7c-44aa-9cd7-baf1f0335977 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:12.247663 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa4a6fa-da7c-44aa-9cd7-baf1f0335977 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:12.247968 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa4a6fa-da7c-44aa-9cd7-baf1f0335977 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:12.261331 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa4a6fa-da7c-44aa-9cd7-baf1f0335977 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:06:12.262837 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa4a6fa-da7c-44aa-9cd7-baf1f0335977 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:06:12.283978 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-4fa4a6fa-da7c-44aa-9cd7-baf1f0335977 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:06:12.283978 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:06:12.283978 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:06:12.283978 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:06:12.283978 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:06:12.283978 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:06:12.283978 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:06:12.283978 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:06:12.283978 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:06:12.283978 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:06:12.283978 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:06:12.283978 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:06:12.283978 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:06:12.283978 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:06:12.283978 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:06:12.284976 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:06:12.284976 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:06:12.284976 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:06:12.284976 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:06:12.284976 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:06:12.284976 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:06:12.284976 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:06:12.284976 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:06:12.284976 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( Jun 22 10:06:12.284976 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:06:12.284976 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:06:12.284976 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:06:12.284976 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:06:12.284976 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:06:12.284976 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:06:12.284976 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:06:12.284976 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:06:12.285890 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:06:12.285890 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:06:12.285890 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:06:12.285890 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:06:12.285890 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 616/1237] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jun 22 10:06:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:06:12.291330 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a4b822-6532-4299-a221-1c488bf71e07 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:12.410843 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a4b822-6532-4299-a221-1c488bf71e07 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:12.421520 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:06:12.449207 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88f1168-ea2d-4c68-b48e-72d8271ebef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:12.449951 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88f1168-ea2d-4c68-b48e-72d8271ebef1 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:12.450260 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88f1168-ea2d-4c68-b48e-72d8271ebef1 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:12.450541 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88f1168-ea2d-4c68-b48e-72d8271ebef1 None admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:12.451293 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88f1168-ea2d-4c68-b48e-72d8271ebef1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:06:12.451612 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88f1168-ea2d-4c68-b48e-72d8271ebef1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:06:12.453566 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88f1168-ea2d-4c68-b48e-72d8271ebef1 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:06:12.466500 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 622/1238] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Jun 22 10:06:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:06:12.473553 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa4a6fa-da7c-44aa-9cd7-baf1f0335977 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:12.590198 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa4a6fa-da7c-44aa-9cd7-baf1f0335977 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:12.634090 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5819ab77-4ad6-4f9e-a219-14238f8a9274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:12.635035 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5819ab77-4ad6-4f9e-a219-14238f8a9274 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:12.635363 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5819ab77-4ad6-4f9e-a219-14238f8a9274 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:12.635632 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5819ab77-4ad6-4f9e-a219-14238f8a9274 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:12.639200 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:06:12.646046 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5819ab77-4ad6-4f9e-a219-14238f8a9274 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:06:12.647676 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5819ab77-4ad6-4f9e-a219-14238f8a9274 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:06:12.663827 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-5819ab77-4ad6-4f9e-a219-14238f8a9274 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 22 10:06:12.663827 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:06:12.663827 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:06:12.663827 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:06:12.663827 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:06:12.663827 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:06:12.663827 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:06:12.663827 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:06:12.663827 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:06:12.663827 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:06:12.663827 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:06:12.663827 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:06:12.663827 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 10:06:12.663827 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 10:06:12.663827 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 10:06:12.663827 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 10:06:12.664998 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:06:12.664998 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:06:12.664998 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 10:06:12.664998 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:06:12.664998 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 10:06:12.664998 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:06:12.664998 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:06:12.664998 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:06:12.664998 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:06:12.664998 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:06:12.664998 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:06:12.664998 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( Jun 22 10:06:12.664998 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:06:12.664998 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:06:12.664998 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:06:12.664998 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:06:12.664998 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:06:12.664998 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:06:12.666056 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:06:12.666056 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:06:12.666056 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 10:06:12.666056 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 10:06:12.666056 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 10:06:12.666056 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 10:06:12.666056 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 10:06:12.666056 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 10:06:12.666056 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 22 10:06:12.666056 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:06:12.666056 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 617/1239] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jun 22 10:06:12 2022] GET /identity/v3/users/placement => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:06:12.671336 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88f1168-ea2d-4c68-b48e-72d8271ebef1 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:12.780653 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88f1168-ea2d-4c68-b48e-72d8271ebef1 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:12.817974 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100a1c9b-e9ee-4b1a-9730-f03051f87a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:12.818689 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100a1c9b-e9ee-4b1a-9730-f03051f87a96 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:12.819056 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100a1c9b-e9ee-4b1a-9730-f03051f87a96 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:12.819335 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100a1c9b-e9ee-4b1a-9730-f03051f87a96 None admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:12.820386 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100a1c9b-e9ee-4b1a-9730-f03051f87a96 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:06:12.820856 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100a1c9b-e9ee-4b1a-9730-f03051f87a96 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:06:12.822619 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100a1c9b-e9ee-4b1a-9730-f03051f87a96 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:06:12.853939 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 623/1240] 10.222.0.43 () {56 vars in 1143 bytes} [Wed Jun 22 10:06:12 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:06:12.855368 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5819ab77-4ad6-4f9e-a219-14238f8a9274 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:12.972690 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5819ab77-4ad6-4f9e-a219-14238f8a9274 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:13.012538 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47d35d0-1eb7-4f27-be79-a423fda356b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:13.013299 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47d35d0-1eb7-4f27-be79-a423fda356b0 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:13.013647 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47d35d0-1eb7-4f27-be79-a423fda356b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:13.013954 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47d35d0-1eb7-4f27-be79-a423fda356b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:13.083055 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:06:13.090453 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47d35d0-1eb7-4f27-be79-a423fda356b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:06:13.091937 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47d35d0-1eb7-4f27-be79-a423fda356b0 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:06:13.205439 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 618/1241] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Jun 22 10:06:12 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 10:06:13.211629 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100a1c9b-e9ee-4b1a-9730-f03051f87a96 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:13.243849 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:06:13.326066 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100a1c9b-e9ee-4b1a-9730-f03051f87a96 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:13.370046 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ae2bb7-64e3-4a8b-918b-1501698fd080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:13.371137 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ae2bb7-64e3-4a8b-918b-1501698fd080 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:13.371479 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ae2bb7-64e3-4a8b-918b-1501698fd080 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:13.371935 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ae2bb7-64e3-4a8b-918b-1501698fd080 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:13.385050 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ae2bb7-64e3-4a8b-918b-1501698fd080 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:06:13.386665 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ae2bb7-64e3-4a8b-918b-1501698fd080 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:06:13.407400 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-d2ae2bb7-64e3-4a8b-918b-1501698fd080 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:06:13.407400 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:06:13.407400 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:06:13.407400 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:06:13.407400 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:06:13.407400 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:06:13.407400 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:06:13.407400 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:06:13.407400 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:06:13.407400 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:06:13.407400 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:06:13.407400 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:06:13.407400 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:06:13.407400 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:06:13.407400 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:06:13.412650 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:06:13.412650 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:06:13.412650 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:06:13.412650 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:06:13.412650 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:06:13.412650 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:06:13.412650 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:06:13.412650 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:06:13.412650 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jun 22 10:06:13.412650 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:06:13.412650 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:06:13.412650 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:06:13.412650 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:06:13.412650 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:06:13.412650 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:06:13.412650 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:06:13.412650 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:06:13.413729 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:06:13.413729 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:06:13.413729 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:06:13.413729 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:06:13.413729 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 624/1242] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jun 22 10:06:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 10:06:13.414532 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47d35d0-1eb7-4f27-be79-a423fda356b0 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:13.527805 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:06:13.536842 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47d35d0-1eb7-4f27-be79-a423fda356b0 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:13.575431 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b87f84-535a-42a8-a873-ccdfcb7176ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:13.576168 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b87f84-535a-42a8-a873-ccdfcb7176ff None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:13.576456 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b87f84-535a-42a8-a873-ccdfcb7176ff None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:13.576743 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b87f84-535a-42a8-a873-ccdfcb7176ff None admin] PATH_INFO: `/v3/domains` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:13.577607 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b87f84-535a-42a8-a873-ccdfcb7176ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:06:13.578087 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b87f84-535a-42a8-a873-ccdfcb7176ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:06:13.579599 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b87f84-535a-42a8-a873-ccdfcb7176ff None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:06:13.597523 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 619/1243] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Jun 22 10:06:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:06:13.598945 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ae2bb7-64e3-4a8b-918b-1501698fd080 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:13.704955 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:06:13.735917 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ae2bb7-64e3-4a8b-918b-1501698fd080 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:13.784432 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87b6c72-4f8b-4617-a2d6-f287eff43563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:13.785139 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87b6c72-4f8b-4617-a2d6-f287eff43563 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:13.785426 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87b6c72-4f8b-4617-a2d6-f287eff43563 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:13.785737 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87b6c72-4f8b-4617-a2d6-f287eff43563 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:13.792815 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87b6c72-4f8b-4617-a2d6-f287eff43563 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:06:13.794450 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87b6c72-4f8b-4617-a2d6-f287eff43563 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:06:13.809645 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-b87b6c72-4f8b-4617-a2d6-f287eff43563 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:06:13.809645 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:06:13.809645 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:06:13.809645 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:06:13.809645 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:06:13.809645 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:06:13.809645 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:06:13.809645 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:06:13.809645 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:06:13.809645 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:06:13.809645 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:06:13.809645 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:06:13.809645 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 10:06:13.809645 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 10:06:13.809645 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 10:06:13.810752 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 10:06:13.810752 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:06:13.810752 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:06:13.810752 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:06:13.810752 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:06:13.810752 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:06:13.810752 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:06:13.810752 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:06:13.810752 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jun 22 10:06:13.810752 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:06:13.810752 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:06:13.810752 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:06:13.810752 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:06:13.810752 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:06:13.810752 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:06:13.810752 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:06:13.810752 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:06:13.812343 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 10:06:13.812343 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 10:06:13.812343 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 10:06:13.812343 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 10:06:13.812343 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 10:06:13.812343 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 10:06:13.812343 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:06:13.812343 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:06:13.812343 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 625/1244] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Jun 22 10:06:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:06:13.816957 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b87f84-535a-42a8-a873-ccdfcb7176ff None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:13.933050 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b87f84-535a-42a8-a873-ccdfcb7176ff None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:13.971952 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322029f8-b4f1-4ca8-930b-816f0ae3a760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:13.972616 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322029f8-b4f1-4ca8-930b-816f0ae3a760 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:13.972899 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322029f8-b4f1-4ca8-930b-816f0ae3a760 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:13.973176 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322029f8-b4f1-4ca8-930b-816f0ae3a760 None admin] PATH_INFO: `/v3/projects` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:13.973998 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322029f8-b4f1-4ca8-930b-816f0ae3a760 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:06:13.974309 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322029f8-b4f1-4ca8-930b-816f0ae3a760 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:06:13.975750 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322029f8-b4f1-4ca8-930b-816f0ae3a760 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:06:13.989204 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 620/1245] 10.222.0.43 () {56 vars in 1148 bytes} [Wed Jun 22 10:06:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:06:13.995312 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87b6c72-4f8b-4617-a2d6-f287eff43563 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:14.116972 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87b6c72-4f8b-4617-a2d6-f287eff43563 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:14.160703 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2feb5e7-9cda-44e4-9b97-7f8ebafbc574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:14.161434 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2feb5e7-9cda-44e4-9b97-7f8ebafbc574 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:14.161776 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2feb5e7-9cda-44e4-9b97-7f8ebafbc574 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:14.162926 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2feb5e7-9cda-44e4-9b97-7f8ebafbc574 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:14.163033 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2feb5e7-9cda-44e4-9b97-7f8ebafbc574 None admin] RBAC: Adding query filter params (role.id=18493ce78e7c480c9202245b6d93cb4c, scope.project.id=e03f1c17e0884f188231d2949dc6f956, user.id=341ec95408c94dae8539ccff7225e3ba) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:06:14.163382 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2feb5e7-9cda-44e4-9b97-7f8ebafbc574 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:06:14.164967 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2feb5e7-9cda-44e4-9b97-7f8ebafbc574 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:06:14.181742 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 626/1246] 10.222.0.43 () {56 vars in 1374 bytes} [Wed Jun 22 10:06:13 2022] GET /identity/v3/role_assignments?user.id=341ec95408c94dae8539ccff7225e3ba&scope.project.id=e03f1c17e0884f188231d2949dc6f956&role.id=18493ce78e7c480c9202245b6d93cb4c => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:06:16.404636 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbca36e7-b1b5-48fb-adfd-19796f207c41 None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:16.405732 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbca36e7-b1b5-48fb-adfd-19796f207c41 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:16.405732 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbca36e7-b1b5-48fb-adfd-19796f207c41 None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:16.407107 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 621/1247] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:06:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:06:16.415668 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ec36d9-cf61-4338-ac15-04b2b5da8b5c None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:16.416202 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ec36d9-cf61-4338-ac15-04b2b5da8b5c None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:16.416409 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ec36d9-cf61-4338-ac15-04b2b5da8b5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:16.422910 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:06:16.437847 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-c3ec36d9-cf61-4338-ac15-04b2b5da8b5c None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:06:16.440168 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-c3ec36d9-cf61-4338-ac15-04b2b5da8b5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:06:16.521931 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 627/1248] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:06:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 10:06:16.547987 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbca36e7-b1b5-48fb-adfd-19796f207c41 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:16.568905 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:06:16.671702 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbca36e7-b1b5-48fb-adfd-19796f207c41 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:16.710970 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c954176c-8d76-4984-ab83-c8e6fadac2ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:16.711829 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c954176c-8d76-4984-ab83-c8e6fadac2ef None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:16.712120 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c954176c-8d76-4984-ab83-c8e6fadac2ef None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:16.712402 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c954176c-8d76-4984-ab83-c8e6fadac2ef None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:16.724436 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c954176c-8d76-4984-ab83-c8e6fadac2ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:06:16.734370 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-c954176c-8d76-4984-ab83-c8e6fadac2ef None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 10:06:16.734370 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:06:16.734370 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:06:16.734370 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:06:16.734370 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:06:16.734370 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:06:16.734370 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:06:16.734370 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:06:16.734370 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:06:16.734370 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:06:16.734370 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:06:16.734370 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:06:16.734370 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:06:16.734370 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:06:16.734370 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:06:16.734370 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:06:16.735626 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:06:16.735626 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:06:16.735626 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:06:16.735626 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:06:16.735626 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:06:16.735626 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:06:16.735626 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:06:16.735626 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:06:16.735626 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:06:16.735626 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:06:16.735626 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:06:16.735626 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( Jun 22 10:06:16.735626 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:06:16.735626 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:06:16.735626 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:06:16.735626 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:06:16.736569 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:06:16.736569 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:06:16.736569 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:06:16.736569 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:06:16.736569 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:06:16.736569 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:06:16.736569 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:06:16.736569 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:06:16.736569 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:06:16.736569 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:06:16.736569 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 10:06:16.736569 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:06:16.736569 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 622/1249] 10.222.0.43 () {56 vars in 1096 bytes} [Wed Jun 22 10:06:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:06:16.742041 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ec36d9-cf61-4338-ac15-04b2b5da8b5c None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:16.860005 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ec36d9-cf61-4338-ac15-04b2b5da8b5c None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:16.898608 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:06:16.904767 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7310c33-dbe8-461c-8bf6-dd7cf1fcf973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:16.906300 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7310c33-dbe8-461c-8bf6-dd7cf1fcf973 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:16.906590 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7310c33-dbe8-461c-8bf6-dd7cf1fcf973 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:16.906872 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7310c33-dbe8-461c-8bf6-dd7cf1fcf973 None admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:16.907629 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7310c33-dbe8-461c-8bf6-dd7cf1fcf973 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:06:16.907938 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7310c33-dbe8-461c-8bf6-dd7cf1fcf973 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:06:16.909311 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7310c33-dbe8-461c-8bf6-dd7cf1fcf973 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:06:16.918631 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 628/1250] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Jun 22 10:06:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:06:16.925081 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c954176c-8d76-4984-ab83-c8e6fadac2ef None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:17.014132 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:06:17.042865 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c954176c-8d76-4984-ab83-c8e6fadac2ef None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:17.083725 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d939719f-6aa3-4f79-947b-c948fa7b0f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:17.084552 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d939719f-6aa3-4f79-947b-c948fa7b0f6a None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:17.084840 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d939719f-6aa3-4f79-947b-c948fa7b0f6a None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:17.085126 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d939719f-6aa3-4f79-947b-c948fa7b0f6a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:17.097363 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d939719f-6aa3-4f79-947b-c948fa7b0f6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:06:17.098984 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d939719f-6aa3-4f79-947b-c948fa7b0f6a None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:06:17.119064 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-d939719f-6aa3-4f79-947b-c948fa7b0f6a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:06:17.119064 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:06:17.119064 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:06:17.119064 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:06:17.119064 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:06:17.119064 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:06:17.119064 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:06:17.119064 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:06:17.119064 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:06:17.119064 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:06:17.119064 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:06:17.119064 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:06:17.119064 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:06:17.119064 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:06:17.119064 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:06:17.120254 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:06:17.120254 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:06:17.120254 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:06:17.120254 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:06:17.120254 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:06:17.120254 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:06:17.120254 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:06:17.120254 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:06:17.120254 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( Jun 22 10:06:17.120254 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:06:17.120254 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:06:17.120254 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:06:17.120254 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:06:17.120254 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:06:17.120254 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:06:17.120254 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:06:17.120254 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:06:17.121296 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:06:17.121296 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:06:17.121296 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:06:17.121296 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:06:17.121296 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 623/1251] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jun 22 10:06:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 10:06:17.128517 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7310c33-dbe8-461c-8bf6-dd7cf1fcf973 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:17.243675 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7310c33-dbe8-461c-8bf6-dd7cf1fcf973 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:17.282714 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10a0609-eb2e-462b-b27d-d68e8513c1eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:17.283432 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10a0609-eb2e-462b-b27d-d68e8513c1eb None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:17.283846 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10a0609-eb2e-462b-b27d-d68e8513c1eb None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:17.284138 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10a0609-eb2e-462b-b27d-d68e8513c1eb None admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:17.285093 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10a0609-eb2e-462b-b27d-d68e8513c1eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:06:17.285447 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10a0609-eb2e-462b-b27d-d68e8513c1eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:06:17.287275 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10a0609-eb2e-462b-b27d-d68e8513c1eb None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:06:17.307862 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 629/1252] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Jun 22 10:06:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:06:17.309410 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d939719f-6aa3-4f79-947b-c948fa7b0f6a None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:17.438263 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d939719f-6aa3-4f79-947b-c948fa7b0f6a None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:17.468837 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:06:17.480872 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0f884d-cabb-4818-a9e5-f4514531288c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:17.481817 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0f884d-cabb-4818-a9e5-f4514531288c None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:17.482237 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0f884d-cabb-4818-a9e5-f4514531288c None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:17.482504 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0f884d-cabb-4818-a9e5-f4514531288c None admin] PATH_INFO: `/v3/users/placement` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:17.491406 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0f884d-cabb-4818-a9e5-f4514531288c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:06:17.492949 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0f884d-cabb-4818-a9e5-f4514531288c None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:06:17.515955 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-8b0f884d-cabb-4818-a9e5-f4514531288c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 22 10:06:17.515955 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:06:17.515955 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:06:17.515955 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:06:17.515955 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:06:17.515955 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:06:17.515955 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:06:17.515955 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:06:17.515955 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:06:17.515955 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:06:17.515955 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:06:17.515955 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:06:17.515955 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 10:06:17.515955 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 10:06:17.515955 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 10:06:17.515955 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 10:06:17.517496 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:06:17.517496 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:06:17.517496 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 10:06:17.517496 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:06:17.517496 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 10:06:17.517496 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:06:17.517496 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:06:17.517496 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:06:17.517496 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:06:17.517496 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:06:17.517496 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:06:17.517496 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( Jun 22 10:06:17.517496 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:06:17.517496 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:06:17.517496 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:06:17.517496 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:06:17.517496 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:06:17.517496 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:06:17.518797 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:06:17.518797 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:06:17.518797 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 10:06:17.518797 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 10:06:17.518797 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 10:06:17.518797 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 10:06:17.518797 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 10:06:17.518797 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 10:06:17.518797 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 22 10:06:17.518797 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:06:17.518797 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 624/1253] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jun 22 10:06:17 2022] GET /identity/v3/users/placement => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 10:06:17.525529 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10a0609-eb2e-462b-b27d-d68e8513c1eb None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:17.588392 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:06:17.639009 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10a0609-eb2e-462b-b27d-d68e8513c1eb None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:17.679587 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88f9eec-e17b-4045-baec-36a97154308c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:17.680278 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88f9eec-e17b-4045-baec-36a97154308c None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:17.680565 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88f9eec-e17b-4045-baec-36a97154308c None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:17.680857 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88f9eec-e17b-4045-baec-36a97154308c None admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:17.681730 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88f9eec-e17b-4045-baec-36a97154308c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:06:17.682053 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88f9eec-e17b-4045-baec-36a97154308c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:06:17.683495 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88f9eec-e17b-4045-baec-36a97154308c None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:06:17.702149 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 630/1254] 10.222.0.43 () {56 vars in 1143 bytes} [Wed Jun 22 10:06:17 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:06:17.708077 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0f884d-cabb-4818-a9e5-f4514531288c None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:17.831510 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0f884d-cabb-4818-a9e5-f4514531288c None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:17.878799 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d05f3ef-d519-4cab-8940-21b1daba2a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:17.879669 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d05f3ef-d519-4cab-8940-21b1daba2a13 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:17.880053 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d05f3ef-d519-4cab-8940-21b1daba2a13 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:17.880366 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d05f3ef-d519-4cab-8940-21b1daba2a13 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:17.948968 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:06:17.963374 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d05f3ef-d519-4cab-8940-21b1daba2a13 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:06:17.965113 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d05f3ef-d519-4cab-8940-21b1daba2a13 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:06:18.078145 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 625/1255] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Jun 22 10:06:17 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 10:06:18.084129 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88f9eec-e17b-4045-baec-36a97154308c None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:18.196768 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88f9eec-e17b-4045-baec-36a97154308c None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:18.213148 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:06:18.237331 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d18312-14a2-4e9f-aa5d-4b96811131c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:18.238168 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d18312-14a2-4e9f-aa5d-4b96811131c0 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:18.238449 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d18312-14a2-4e9f-aa5d-4b96811131c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:18.238743 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d18312-14a2-4e9f-aa5d-4b96811131c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:18.249426 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d18312-14a2-4e9f-aa5d-4b96811131c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:06:18.250996 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d18312-14a2-4e9f-aa5d-4b96811131c0 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:06:18.270818 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-e2d18312-14a2-4e9f-aa5d-4b96811131c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:06:18.270818 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:06:18.270818 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:06:18.270818 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:06:18.270818 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:06:18.270818 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:06:18.270818 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:06:18.270818 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:06:18.270818 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:06:18.270818 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:06:18.270818 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:06:18.270818 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:06:18.270818 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:06:18.270818 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:06:18.270818 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:06:18.272019 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:06:18.272019 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:06:18.272019 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:06:18.272019 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:06:18.272019 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:06:18.272019 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:06:18.272019 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:06:18.272019 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:06:18.272019 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jun 22 10:06:18.272019 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:06:18.272019 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:06:18.272019 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:06:18.272019 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:06:18.272019 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:06:18.272019 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:06:18.272019 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:06:18.272019 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:06:18.273140 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:06:18.273140 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:06:18.273140 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:06:18.273140 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:06:18.273140 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 631/1256] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jun 22 10:06:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 10:06:18.277939 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d05f3ef-d519-4cab-8940-21b1daba2a13 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:18.375431 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:06:18.389529 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d05f3ef-d519-4cab-8940-21b1daba2a13 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:18.431040 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b972056-4a83-42fe-9e34-b9a00ea2208d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:18.431872 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b972056-4a83-42fe-9e34-b9a00ea2208d None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:18.432245 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b972056-4a83-42fe-9e34-b9a00ea2208d None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:18.432567 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b972056-4a83-42fe-9e34-b9a00ea2208d None admin] PATH_INFO: `/v3/domains` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:18.433529 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b972056-4a83-42fe-9e34-b9a00ea2208d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:06:18.433922 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b972056-4a83-42fe-9e34-b9a00ea2208d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:06:18.435492 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b972056-4a83-42fe-9e34-b9a00ea2208d None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:06:18.449519 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 626/1257] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Jun 22 10:06:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:06:18.455815 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d18312-14a2-4e9f-aa5d-4b96811131c0 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:18.565941 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d18312-14a2-4e9f-aa5d-4b96811131c0 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:18.604824 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdb17fa-b289-43f7-8d9e-e94805301db9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:18.605646 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdb17fa-b289-43f7-8d9e-e94805301db9 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:18.605975 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdb17fa-b289-43f7-8d9e-e94805301db9 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:18.606258 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdb17fa-b289-43f7-8d9e-e94805301db9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:18.614717 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdb17fa-b289-43f7-8d9e-e94805301db9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:06:18.616572 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdb17fa-b289-43f7-8d9e-e94805301db9 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:06:18.633578 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-8fdb17fa-b289-43f7-8d9e-e94805301db9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:06:18.633578 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:06:18.633578 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:06:18.633578 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:06:18.633578 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:06:18.633578 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:06:18.633578 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:06:18.633578 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:06:18.633578 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:06:18.633578 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:06:18.633578 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:06:18.633578 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:06:18.633578 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 10:06:18.633578 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 10:06:18.633578 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 10:06:18.634692 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 10:06:18.634692 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:06:18.634692 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:06:18.634692 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:06:18.634692 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:06:18.634692 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:06:18.634692 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:06:18.634692 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:06:18.634692 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jun 22 10:06:18.634692 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:06:18.634692 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:06:18.634692 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:06:18.634692 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:06:18.634692 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:06:18.634692 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:06:18.634692 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:06:18.634692 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:06:18.635724 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 10:06:18.635724 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 10:06:18.635724 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 10:06:18.635724 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 10:06:18.635724 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 10:06:18.635724 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 10:06:18.635724 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:06:18.635724 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:06:18.635724 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 632/1258] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Jun 22 10:06:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:06:18.641603 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b972056-4a83-42fe-9e34-b9a00ea2208d None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:18.754232 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b972056-4a83-42fe-9e34-b9a00ea2208d None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:18.789379 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45108b6-b8fa-4ec5-a211-5473071476a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:18.790047 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45108b6-b8fa-4ec5-a211-5473071476a7 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:18.790336 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45108b6-b8fa-4ec5-a211-5473071476a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:18.790615 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45108b6-b8fa-4ec5-a211-5473071476a7 None admin] PATH_INFO: `/v3/projects` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:18.791401 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45108b6-b8fa-4ec5-a211-5473071476a7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:06:18.791712 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45108b6-b8fa-4ec5-a211-5473071476a7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:06:18.793158 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45108b6-b8fa-4ec5-a211-5473071476a7 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:06:18.806672 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 627/1259] 10.222.0.43 () {56 vars in 1148 bytes} [Wed Jun 22 10:06:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:06:18.813526 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdb17fa-b289-43f7-8d9e-e94805301db9 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:18.847586 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:06:18.947046 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdb17fa-b289-43f7-8d9e-e94805301db9 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:18.989287 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c86b17-8481-4c99-8f89-44a1468a02b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:18.989982 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c86b17-8481-4c99-8f89-44a1468a02b1 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:18.990269 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c86b17-8481-4c99-8f89-44a1468a02b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:18.990548 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c86b17-8481-4c99-8f89-44a1468a02b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:18.991385 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c86b17-8481-4c99-8f89-44a1468a02b1 None admin] RBAC: Adding query filter params (role.id=26d9c2ab5dfc4e6d9ca80c6014123906, scope.project.id=e03f1c17e0884f188231d2949dc6f956, user.id=341ec95408c94dae8539ccff7225e3ba) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:06:18.991706 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c86b17-8481-4c99-8f89-44a1468a02b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:06:18.993173 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c86b17-8481-4c99-8f89-44a1468a02b1 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:06:18.999199 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 633/1260] 10.222.0.43 () {56 vars in 1374 bytes} [Wed Jun 22 10:06:18 2022] GET /identity/v3/role_assignments?user.id=341ec95408c94dae8539ccff7225e3ba&scope.project.id=e03f1c17e0884f188231d2949dc6f956&role.id=26d9c2ab5dfc4e6d9ca80c6014123906 => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:06:21.034049 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747ae124-b64f-46e2-80d6-250a9530e67e None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:21.034581 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747ae124-b64f-46e2-80d6-250a9530e67e None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:21.034675 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747ae124-b64f-46e2-80d6-250a9530e67e None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:21.036017 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 628/1261] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:06:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:06:21.041264 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985a9ee7-ef23-4029-9861-849ea04d844d None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:21.041728 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985a9ee7-ef23-4029-9861-849ea04d844d None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:21.041871 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985a9ee7-ef23-4029-9861-849ea04d844d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:21.058784 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-985a9ee7-ef23-4029-9861-849ea04d844d None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:06:21.059958 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-985a9ee7-ef23-4029-9861-849ea04d844d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:06:21.126238 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 634/1262] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:06:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 10:06:21.148885 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747ae124-b64f-46e2-80d6-250a9530e67e None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:21.160283 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:06:21.251306 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747ae124-b64f-46e2-80d6-250a9530e67e None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:21.285278 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c50ff0-dcf6-4ad6-a121-5ed10d1afddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:21.286026 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c50ff0-dcf6-4ad6-a121-5ed10d1afddd None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:21.286314 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c50ff0-dcf6-4ad6-a121-5ed10d1afddd None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:21.286594 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c50ff0-dcf6-4ad6-a121-5ed10d1afddd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:21.296412 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c50ff0-dcf6-4ad6-a121-5ed10d1afddd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:06:21.303984 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-f0c50ff0-dcf6-4ad6-a121-5ed10d1afddd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 10:06:21.303984 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:06:21.303984 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:06:21.303984 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:06:21.303984 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:06:21.303984 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:06:21.303984 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:06:21.303984 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:06:21.303984 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:06:21.303984 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:06:21.303984 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:06:21.303984 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:06:21.303984 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:06:21.303984 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:06:21.303984 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:06:21.303984 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:06:21.305064 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:06:21.305064 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:06:21.305064 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:06:21.305064 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:06:21.305064 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:06:21.305064 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:06:21.305064 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:06:21.305064 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:06:21.305064 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:06:21.305064 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:06:21.305064 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:06:21.305064 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( Jun 22 10:06:21.305064 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:06:21.305064 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:06:21.305064 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:06:21.305064 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:06:21.306155 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:06:21.306155 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:06:21.306155 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:06:21.306155 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:06:21.306155 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:06:21.306155 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:06:21.306155 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:06:21.306155 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:06:21.306155 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:06:21.306155 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:06:21.306155 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 10:06:21.306155 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:06:21.306155 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 629/1263] 10.222.0.43 () {56 vars in 1096 bytes} [Wed Jun 22 10:06:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:06:21.311354 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985a9ee7-ef23-4029-9861-849ea04d844d None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:21.329612 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:06:21.409196 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985a9ee7-ef23-4029-9861-849ea04d844d None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:21.443541 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f079dc0-5530-408d-8e41-19de71d2c3ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:21.444208 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f079dc0-5530-408d-8e41-19de71d2c3ba None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:21.444496 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f079dc0-5530-408d-8e41-19de71d2c3ba None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:21.444777 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f079dc0-5530-408d-8e41-19de71d2c3ba None admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:21.445534 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f079dc0-5530-408d-8e41-19de71d2c3ba None admin] RBAC: Adding query filter params (name=admin) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:06:21.445876 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f079dc0-5530-408d-8e41-19de71d2c3ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:06:21.447261 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f079dc0-5530-408d-8e41-19de71d2c3ba None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:06:21.455935 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 635/1264] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Jun 22 10:06:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:06:21.461582 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c50ff0-dcf6-4ad6-a121-5ed10d1afddd None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:21.531846 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:06:21.565862 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c50ff0-dcf6-4ad6-a121-5ed10d1afddd None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:21.599546 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5825f2c-dbb8-4f0f-8e0d-084a95c05fa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:21.600338 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5825f2c-dbb8-4f0f-8e0d-084a95c05fa0 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:21.600624 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5825f2c-dbb8-4f0f-8e0d-084a95c05fa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:21.600904 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5825f2c-dbb8-4f0f-8e0d-084a95c05fa0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:21.611754 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5825f2c-dbb8-4f0f-8e0d-084a95c05fa0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:06:21.613205 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5825f2c-dbb8-4f0f-8e0d-084a95c05fa0 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:06:21.630691 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-d5825f2c-dbb8-4f0f-8e0d-084a95c05fa0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:06:21.630691 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:06:21.630691 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:06:21.630691 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:06:21.630691 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:06:21.630691 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:06:21.630691 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:06:21.630691 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:06:21.630691 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:06:21.630691 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:06:21.630691 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:06:21.630691 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:06:21.630691 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:06:21.630691 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:06:21.630691 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:06:21.631829 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:06:21.631829 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:06:21.631829 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:06:21.631829 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:06:21.631829 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:06:21.631829 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:06:21.631829 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:06:21.631829 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:06:21.631829 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( Jun 22 10:06:21.631829 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:06:21.631829 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:06:21.631829 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:06:21.631829 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:06:21.631829 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:06:21.631829 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:06:21.631829 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:06:21.631829 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:06:21.632818 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:06:21.632818 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:06:21.632818 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:06:21.632818 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:06:21.632818 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 630/1265] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jun 22 10:06:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:06:21.637592 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f079dc0-5530-408d-8e41-19de71d2c3ba None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:21.715690 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:06:21.735334 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f079dc0-5530-408d-8e41-19de71d2c3ba None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:21.769472 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbbe415-ea93-44d6-a1ca-36b0d9d430bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:21.770157 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbbe415-ea93-44d6-a1ca-36b0d9d430bf None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:21.770442 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbbe415-ea93-44d6-a1ca-36b0d9d430bf None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:21.770720 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbbe415-ea93-44d6-a1ca-36b0d9d430bf None admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:21.771437 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbbe415-ea93-44d6-a1ca-36b0d9d430bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:06:21.771744 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbbe415-ea93-44d6-a1ca-36b0d9d430bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:06:21.773106 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbbe415-ea93-44d6-a1ca-36b0d9d430bf None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:06:21.784841 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 636/1266] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Jun 22 10:06:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:06:21.790663 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5825f2c-dbb8-4f0f-8e0d-084a95c05fa0 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:21.905184 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5825f2c-dbb8-4f0f-8e0d-084a95c05fa0 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:21.926320 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:06:21.940414 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7dc786-62d2-4a98-b305-1170ac2f6376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:21.941212 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7dc786-62d2-4a98-b305-1170ac2f6376 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:21.941492 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7dc786-62d2-4a98-b305-1170ac2f6376 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:21.941793 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7dc786-62d2-4a98-b305-1170ac2f6376 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:21.949048 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7dc786-62d2-4a98-b305-1170ac2f6376 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:06:21.950507 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7dc786-62d2-4a98-b305-1170ac2f6376 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:06:21.964428 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-cb7dc786-62d2-4a98-b305-1170ac2f6376 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 22 10:06:21.964428 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:06:21.964428 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:06:21.964428 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:06:21.964428 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:06:21.964428 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:06:21.964428 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:06:21.964428 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:06:21.964428 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:06:21.964428 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:06:21.964428 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:06:21.964428 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:06:21.964428 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 10:06:21.964428 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 10:06:21.964428 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 10:06:21.964428 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 10:06:21.965549 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:06:21.965549 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:06:21.965549 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 10:06:21.965549 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:06:21.965549 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 10:06:21.965549 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:06:21.965549 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:06:21.965549 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:06:21.965549 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:06:21.965549 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:06:21.965549 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:06:21.965549 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( Jun 22 10:06:21.965549 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:06:21.965549 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:06:21.965549 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:06:21.965549 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:06:21.965549 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:06:21.965549 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:06:21.966831 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:06:21.966831 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:06:21.966831 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 10:06:21.966831 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 10:06:21.966831 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 10:06:21.966831 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 10:06:21.966831 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 10:06:21.966831 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 10:06:21.966831 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 22 10:06:21.966831 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:06:21.966831 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 631/1267] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jun 22 10:06:21 2022] GET /identity/v3/users/placement => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:06:21.971906 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbbe415-ea93-44d6-a1ca-36b0d9d430bf None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:22.067370 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbbe415-ea93-44d6-a1ca-36b0d9d430bf None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:22.100741 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d5fcaf-4334-4f4f-a788-b34ed154a204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:22.101668 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d5fcaf-4334-4f4f-a788-b34ed154a204 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:22.101973 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d5fcaf-4334-4f4f-a788-b34ed154a204 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:22.102247 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d5fcaf-4334-4f4f-a788-b34ed154a204 None admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:22.103075 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d5fcaf-4334-4f4f-a788-b34ed154a204 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:06:22.103382 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d5fcaf-4334-4f4f-a788-b34ed154a204 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:06:22.104795 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d5fcaf-4334-4f4f-a788-b34ed154a204 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:06:22.113576 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:06:22.122993 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 637/1268] 10.222.0.43 () {56 vars in 1143 bytes} [Wed Jun 22 10:06:21 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:06:22.129050 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7dc786-62d2-4a98-b305-1170ac2f6376 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:22.227498 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7dc786-62d2-4a98-b305-1170ac2f6376 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:22.259595 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea374581-cce7-4de7-9439-39e68fa718c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:22.260375 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea374581-cce7-4de7-9439-39e68fa718c4 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:22.260661 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea374581-cce7-4de7-9439-39e68fa718c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:22.260938 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea374581-cce7-4de7-9439-39e68fa718c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:22.271787 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea374581-cce7-4de7-9439-39e68fa718c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:06:22.273233 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea374581-cce7-4de7-9439-39e68fa718c4 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:06:22.290492 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-ea374581-cce7-4de7-9439-39e68fa718c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:06:22.290492 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:06:22.290492 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:06:22.290492 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:06:22.290492 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:06:22.290492 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:06:22.290492 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:06:22.290492 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:06:22.290492 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:06:22.290492 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:06:22.290492 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:06:22.290492 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:06:22.290492 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:06:22.290492 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:06:22.290492 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:06:22.291597 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:06:22.291597 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:06:22.291597 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:06:22.291597 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:06:22.291597 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:06:22.291597 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:06:22.291597 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:06:22.291597 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:06:22.291597 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( Jun 22 10:06:22.291597 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:06:22.291597 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:06:22.291597 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:06:22.291597 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:06:22.291597 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:06:22.291597 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:06:22.291597 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:06:22.291597 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:06:22.292682 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:06:22.292682 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:06:22.292682 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:06:22.292682 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:06:22.292682 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 632/1269] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jun 22 10:06:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:06:22.297480 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d5fcaf-4334-4f4f-a788-b34ed154a204 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:22.395424 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d5fcaf-4334-4f4f-a788-b34ed154a204 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:22.427300 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f6099e-1a24-4bf3-8f17-728b237cfd65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:22.427943 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f6099e-1a24-4bf3-8f17-728b237cfd65 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:22.428222 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f6099e-1a24-4bf3-8f17-728b237cfd65 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:22.428493 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f6099e-1a24-4bf3-8f17-728b237cfd65 None admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:22.429204 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f6099e-1a24-4bf3-8f17-728b237cfd65 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:06:22.429507 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f6099e-1a24-4bf3-8f17-728b237cfd65 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:06:22.430899 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f6099e-1a24-4bf3-8f17-728b237cfd65 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:06:22.442366 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 638/1270] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Jun 22 10:06:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:06:22.448085 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea374581-cce7-4de7-9439-39e68fa718c4 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:22.480464 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:06:22.552733 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea374581-cce7-4de7-9439-39e68fa718c4 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:22.586799 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70623d51-5537-4a0e-ba43-a967676fa3a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:22.587581 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70623d51-5537-4a0e-ba43-a967676fa3a9 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:22.587868 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70623d51-5537-4a0e-ba43-a967676fa3a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:22.588146 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70623d51-5537-4a0e-ba43-a967676fa3a9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:22.595152 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70623d51-5537-4a0e-ba43-a967676fa3a9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:06:22.596600 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70623d51-5537-4a0e-ba43-a967676fa3a9 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:06:22.611202 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-70623d51-5537-4a0e-ba43-a967676fa3a9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:06:22.611202 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:06:22.611202 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:06:22.611202 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:06:22.611202 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:06:22.611202 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:06:22.611202 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:06:22.611202 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:06:22.611202 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:06:22.611202 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:06:22.611202 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:06:22.611202 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:06:22.611202 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 10:06:22.611202 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 10:06:22.611202 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 10:06:22.612254 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 10:06:22.612254 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:06:22.612254 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:06:22.612254 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:06:22.612254 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:06:22.612254 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:06:22.612254 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:06:22.612254 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:06:22.612254 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( Jun 22 10:06:22.612254 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:06:22.612254 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:06:22.612254 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:06:22.612254 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:06:22.612254 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:06:22.612254 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:06:22.612254 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:06:22.612254 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:06:22.613619 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 10:06:22.613619 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 10:06:22.613619 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 10:06:22.613619 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 10:06:22.613619 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 10:06:22.613619 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 10:06:22.613619 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:06:22.613619 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:06:22.613619 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 633/1271] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Jun 22 10:06:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:06:22.618375 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f6099e-1a24-4bf3-8f17-728b237cfd65 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:22.674992 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:06:22.716943 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f6099e-1a24-4bf3-8f17-728b237cfd65 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:22.750719 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2396e18a-a4ac-4c3f-a260-4a1c74b0bc84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:22.751312 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2396e18a-a4ac-4c3f-a260-4a1c74b0bc84 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:22.751597 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2396e18a-a4ac-4c3f-a260-4a1c74b0bc84 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:22.751876 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2396e18a-a4ac-4c3f-a260-4a1c74b0bc84 None admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:22.752660 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2396e18a-a4ac-4c3f-a260-4a1c74b0bc84 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:06:22.752975 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2396e18a-a4ac-4c3f-a260-4a1c74b0bc84 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:06:22.754430 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2396e18a-a4ac-4c3f-a260-4a1c74b0bc84 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:06:22.766200 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 639/1272] 10.222.0.43 () {56 vars in 1148 bytes} [Wed Jun 22 10:06:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:06:22.772023 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70623d51-5537-4a0e-ba43-a967676fa3a9 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:22.872784 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:06:22.882779 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70623d51-5537-4a0e-ba43-a967676fa3a9 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:22.915693 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8483b0-8f00-47bb-b136-debe32de86b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:22.916576 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8483b0-8f00-47bb-b136-debe32de86b8 None admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:22.916860 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8483b0-8f00-47bb-b136-debe32de86b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:22.917139 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8483b0-8f00-47bb-b136-debe32de86b8 None admin] PATH_INFO: `/v3/projects/e03f1c17e0884f188231d2949dc6f956/users/341ec95408c94dae8539ccff7225e3ba/roles/26d9c2ab5dfc4e6d9ca80c6014123906` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:22.919087 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8483b0-8f00-47bb-b136-debe32de86b8 None admin] RBAC: Authorizing `identity:create_grant(project_id=e03f1c17e0884f188231d2949dc6f956, user_id=341ec95408c94dae8539ccff7225e3ba, role_id=26d9c2ab5dfc4e6d9ca80c6014123906)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:06:22.921026 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8483b0-8f00-47bb-b136-debe32de86b8 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:06:22.933449 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 634/1273] 10.222.0.43 () {58 vars in 1439 bytes} [Wed Jun 22 10:06:22 2022] PUT /identity/v3/projects/e03f1c17e0884f188231d2949dc6f956/users/341ec95408c94dae8539ccff7225e3ba/roles/26d9c2ab5dfc4e6d9ca80c6014123906 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:06:24.945114 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513a4092-2fcb-4784-911d-2470c5108976 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:24.945672 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513a4092-2fcb-4784-911d-2470c5108976 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:24.945672 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513a4092-2fcb-4784-911d-2470c5108976 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:24.947077 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 640/1274] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:06:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:06:24.953099 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4028a26a-6c3c-43d5-afa1-f8d0509def33 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:24.953493 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4028a26a-6c3c-43d5-afa1-f8d0509def33 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:24.953653 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4028a26a-6c3c-43d5-afa1-f8d0509def33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:24.970244 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-4028a26a-6c3c-43d5-afa1-f8d0509def33 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:06:24.971530 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-4028a26a-6c3c-43d5-afa1-f8d0509def33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:06:25.039514 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 635/1275] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:06:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 10:06:25.064606 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513a4092-2fcb-4784-911d-2470c5108976 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:25.164973 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513a4092-2fcb-4784-911d-2470c5108976 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:25.182274 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:06:25.199370 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52831b2-7a91-405c-a7a0-7e6e667bfa36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:25.200093 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52831b2-7a91-405c-a7a0-7e6e667bfa36 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:25.200383 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52831b2-7a91-405c-a7a0-7e6e667bfa36 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:25.200664 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52831b2-7a91-405c-a7a0-7e6e667bfa36 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:25.210676 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52831b2-7a91-405c-a7a0-7e6e667bfa36 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 10:06:25.218382 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-b52831b2-7a91-405c-a7a0-7e6e667bfa36 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 10:06:25.218382 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:06:25.218382 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:06:25.218382 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:06:25.218382 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:06:25.218382 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:06:25.218382 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:06:25.218382 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:06:25.218382 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:06:25.218382 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:06:25.218382 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:06:25.218382 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:06:25.218382 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 10:06:25.218382 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 10:06:25.218382 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 10:06:25.218382 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 10:06:25.219503 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 10:06:25.219503 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 10:06:25.219503 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 10:06:25.219503 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 10:06:25.219503 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:06:25.219503 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:06:25.219503 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:06:25.219503 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:06:25.219503 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:06:25.219503 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:06:25.219503 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:06:25.219503 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jun 22 10:06:25.219503 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:06:25.219503 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:06:25.219503 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:06:25.219503 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:06:25.220408 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:06:25.220408 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:06:25.220408 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:06:25.220408 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:06:25.220408 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 10:06:25.220408 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 10:06:25.220408 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 10:06:25.220408 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 10:06:25.220408 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 10:06:25.220408 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 10:06:25.220408 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 10:06:25.220408 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:06:25.220408 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 641/1276] 10.222.0.43 () {56 vars in 1096 bytes} [Wed Jun 22 10:06:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:06:25.225585 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4028a26a-6c3c-43d5-afa1-f8d0509def33 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:25.312903 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:06:25.331455 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4028a26a-6c3c-43d5-afa1-f8d0509def33 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:25.366797 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e224f1f9-6cd4-4ffc-8257-0f6505b51bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:25.367461 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e224f1f9-6cd4-4ffc-8257-0f6505b51bda None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:25.367747 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e224f1f9-6cd4-4ffc-8257-0f6505b51bda None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:25.368024 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e224f1f9-6cd4-4ffc-8257-0f6505b51bda None admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:25.368770 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e224f1f9-6cd4-4ffc-8257-0f6505b51bda None admin] RBAC: Adding query filter params (name=admin) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:06:25.369078 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e224f1f9-6cd4-4ffc-8257-0f6505b51bda None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:06:25.370477 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e224f1f9-6cd4-4ffc-8257-0f6505b51bda None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:06:25.382783 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 636/1277] 10.222.0.43 () {56 vars in 1099 bytes} [Wed Jun 22 10:06:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:06:25.389444 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52831b2-7a91-405c-a7a0-7e6e667bfa36 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:25.499322 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52831b2-7a91-405c-a7a0-7e6e667bfa36 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:25.534679 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a490b002-525e-448a-a189-e0312818d58d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:25.536870 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a490b002-525e-448a-a189-e0312818d58d None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:25.537168 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a490b002-525e-448a-a189-e0312818d58d None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:25.537454 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a490b002-525e-448a-a189-e0312818d58d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:25.552452 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a490b002-525e-448a-a189-e0312818d58d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:06:25.554241 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a490b002-525e-448a-a189-e0312818d58d None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:06:25.573399 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-a490b002-525e-448a-a189-e0312818d58d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:06:25.573399 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:06:25.573399 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:06:25.573399 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:06:25.573399 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:06:25.573399 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:06:25.573399 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:06:25.573399 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:06:25.573399 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:06:25.573399 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:06:25.573399 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:06:25.573399 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:06:25.573399 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:06:25.573399 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:06:25.573399 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:06:25.574461 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:06:25.574461 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:06:25.574461 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:06:25.574461 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:06:25.574461 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:06:25.574461 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:06:25.574461 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:06:25.574461 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:06:25.574461 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jun 22 10:06:25.574461 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:06:25.574461 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:06:25.574461 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:06:25.574461 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:06:25.574461 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:06:25.574461 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:06:25.574461 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:06:25.574461 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:06:25.575384 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:06:25.575384 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:06:25.575384 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:06:25.575384 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:06:25.575384 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 642/1278] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jun 22 10:06:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:06:25.581086 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e224f1f9-6cd4-4ffc-8257-0f6505b51bda None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:25.683422 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e224f1f9-6cd4-4ffc-8257-0f6505b51bda None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:25.718778 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af49a9e5-5f0e-4365-b6d0-9eb5a02f5919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:25.719438 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af49a9e5-5f0e-4365-b6d0-9eb5a02f5919 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:25.719720 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af49a9e5-5f0e-4365-b6d0-9eb5a02f5919 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:25.719996 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af49a9e5-5f0e-4365-b6d0-9eb5a02f5919 None admin] PATH_INFO: `/v3/domains` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:25.720718 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af49a9e5-5f0e-4365-b6d0-9eb5a02f5919 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:06:25.721021 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af49a9e5-5f0e-4365-b6d0-9eb5a02f5919 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:06:25.722429 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af49a9e5-5f0e-4365-b6d0-9eb5a02f5919 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:06:25.735268 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 637/1279] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Jun 22 10:06:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:06:25.741012 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a490b002-525e-448a-a189-e0312818d58d None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:25.776672 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:06:25.863115 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a490b002-525e-448a-a189-e0312818d58d None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:25.905211 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9402435f-b248-49c0-8dbe-2dc2775404a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:25.906125 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9402435f-b248-49c0-8dbe-2dc2775404a7 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:25.906407 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9402435f-b248-49c0-8dbe-2dc2775404a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:25.906677 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9402435f-b248-49c0-8dbe-2dc2775404a7 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:25.914571 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9402435f-b248-49c0-8dbe-2dc2775404a7 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:06:25.916088 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9402435f-b248-49c0-8dbe-2dc2775404a7 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:06:25.931185 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-9402435f-b248-49c0-8dbe-2dc2775404a7 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 22 10:06:25.931185 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:06:25.931185 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:06:25.931185 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:06:25.931185 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:06:25.931185 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:06:25.931185 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:06:25.931185 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:06:25.931185 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:06:25.931185 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:06:25.931185 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:06:25.931185 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:06:25.931185 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 10:06:25.931185 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 10:06:25.931185 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 10:06:25.931185 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 10:06:25.932357 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:06:25.932357 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:06:25.932357 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 10:06:25.932357 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:06:25.932357 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 10:06:25.932357 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 10:06:25.932357 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:06:25.932357 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:06:25.932357 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:06:25.932357 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:06:25.932357 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:06:25.932357 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jun 22 10:06:25.932357 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:06:25.932357 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:06:25.932357 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:06:25.932357 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:06:25.932357 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:06:25.932357 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:06:25.933709 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:06:25.933709 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:06:25.933709 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 10:06:25.933709 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 10:06:25.933709 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 10:06:25.933709 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 10:06:25.933709 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 10:06:25.933709 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 10:06:25.933709 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 22 10:06:25.933709 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:06:25.933709 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 643/1280] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jun 22 10:06:25 2022] GET /identity/v3/users/placement => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:06:25.939903 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af49a9e5-5f0e-4365-b6d0-9eb5a02f5919 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:25.943885 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:06:26.049641 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af49a9e5-5f0e-4365-b6d0-9eb5a02f5919 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:26.085593 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49ec630-8cec-48fd-bb52-370a999acbd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:26.086303 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49ec630-8cec-48fd-bb52-370a999acbd5 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:26.086588 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49ec630-8cec-48fd-bb52-370a999acbd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:26.086867 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49ec630-8cec-48fd-bb52-370a999acbd5 None admin] PATH_INFO: `/v3/users` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:26.087716 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49ec630-8cec-48fd-bb52-370a999acbd5 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:06:26.088023 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49ec630-8cec-48fd-bb52-370a999acbd5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:06:26.089460 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49ec630-8cec-48fd-bb52-370a999acbd5 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:06:26.107647 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 638/1281] 10.222.0.43 () {56 vars in 1143 bytes} [Wed Jun 22 10:06:25 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:06:26.114150 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9402435f-b248-49c0-8dbe-2dc2775404a7 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:26.209657 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:06:26.220208 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9402435f-b248-49c0-8dbe-2dc2775404a7 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:26.253834 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807ad36f-021b-4599-97f9-19192d3091b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:26.254480 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807ad36f-021b-4599-97f9-19192d3091b8 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:26.254765 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807ad36f-021b-4599-97f9-19192d3091b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:26.255043 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807ad36f-021b-4599-97f9-19192d3091b8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:26.319990 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807ad36f-021b-4599-97f9-19192d3091b8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:06:26.321355 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807ad36f-021b-4599-97f9-19192d3091b8 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:06:26.408478 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:06:26.418779 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 644/1282] 10.222.0.43 () {58 vars in 1282 bytes} [Wed Jun 22 10:06:26 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 10:06:26.425117 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49ec630-8cec-48fd-bb52-370a999acbd5 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:26.486438 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:06:26.525071 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49ec630-8cec-48fd-bb52-370a999acbd5 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:26.560706 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60d50d3-caaf-4da3-a5a8-5539a0deb2b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:26.561498 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60d50d3-caaf-4da3-a5a8-5539a0deb2b0 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:26.561822 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60d50d3-caaf-4da3-a5a8-5539a0deb2b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:26.562103 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60d50d3-caaf-4da3-a5a8-5539a0deb2b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:26.572201 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60d50d3-caaf-4da3-a5a8-5539a0deb2b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:06:26.573600 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60d50d3-caaf-4da3-a5a8-5539a0deb2b0 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:06:26.591316 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-a60d50d3-caaf-4da3-a5a8-5539a0deb2b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:06:26.591316 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:06:26.591316 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:06:26.591316 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:06:26.591316 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:06:26.591316 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:06:26.591316 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:06:26.591316 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:06:26.591316 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:06:26.591316 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:06:26.591316 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:06:26.591316 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:06:26.591316 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 10:06:26.591316 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 10:06:26.591316 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 10:06:26.593049 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 10:06:26.593049 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:06:26.593049 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:06:26.593049 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:06:26.593049 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:06:26.593049 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:06:26.593049 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:06:26.593049 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:06:26.593049 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( Jun 22 10:06:26.593049 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:06:26.593049 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:06:26.593049 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:06:26.593049 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:06:26.593049 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:06:26.593049 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:06:26.593049 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:06:26.593049 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:06:26.594029 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 10:06:26.594029 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 10:06:26.594029 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 10:06:26.594029 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:06:26.594029 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 639/1283] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jun 22 10:06:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:06:26.599123 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807ad36f-021b-4599-97f9-19192d3091b8 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:26.694939 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807ad36f-021b-4599-97f9-19192d3091b8 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:26.726887 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65929c0-e8d1-4c69-8479-70bdeb5e54cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:26.727528 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65929c0-e8d1-4c69-8479-70bdeb5e54cc None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:26.727809 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65929c0-e8d1-4c69-8479-70bdeb5e54cc None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:26.728085 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65929c0-e8d1-4c69-8479-70bdeb5e54cc None admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:26.728798 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65929c0-e8d1-4c69-8479-70bdeb5e54cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:06:26.729104 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65929c0-e8d1-4c69-8479-70bdeb5e54cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:06:26.730472 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65929c0-e8d1-4c69-8479-70bdeb5e54cc None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:06:26.742486 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 645/1284] 10.222.0.43 () {56 vars in 1109 bytes} [Wed Jun 22 10:06:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:06:26.748082 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60d50d3-caaf-4da3-a5a8-5539a0deb2b0 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:26.852706 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60d50d3-caaf-4da3-a5a8-5539a0deb2b0 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:26.867175 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:06:26.887576 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79184116-cfcf-4eed-9abc-bf8b782e119d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:26.888364 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79184116-cfcf-4eed-9abc-bf8b782e119d None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:26.888646 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79184116-cfcf-4eed-9abc-bf8b782e119d None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:26.888923 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79184116-cfcf-4eed-9abc-bf8b782e119d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:26.895439 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79184116-cfcf-4eed-9abc-bf8b782e119d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:06:26.896913 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79184116-cfcf-4eed-9abc-bf8b782e119d None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:06:26.910854 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application [None req-79184116-cfcf-4eed-9abc-bf8b782e119d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:06:26.910854 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:06:26.910854 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:06:26.910854 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:06:26.910854 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:06:26.910854 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:06:26.910854 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:06:26.910854 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:06:26.910854 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:06:26.910854 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:06:26.910854 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:06:26.910854 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:06:26.910854 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 10:06:26.910854 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 10:06:26.910854 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 10:06:26.911871 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 10:06:26.911871 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:06:26.911871 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:06:26.911871 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:06:26.911871 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:06:26.911871 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:06:26.911871 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:06:26.911871 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:06:26.911871 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application with Lock( Jun 22 10:06:26.911871 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:06:26.911871 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:06:26.911871 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:06:26.911871 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:06:26.911871 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:06:26.911871 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:06:26.911871 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:06:26.911871 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:06:26.913171 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 10:06:26.913171 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 10:06:26.913171 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 10:06:26.913171 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 10:06:26.913171 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 10:06:26.913171 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 10:06:26.913171 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 10:06:26.913171 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: ERROR keystone.server.flask.application Jun 22 10:06:26.913171 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 640/1285] 10.222.0.43 () {56 vars in 1111 bytes} [Wed Jun 22 10:06:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:06:26.917916 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65929c0-e8d1-4c69-8479-70bdeb5e54cc None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:26.967707 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:06:27.019897 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65929c0-e8d1-4c69-8479-70bdeb5e54cc None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:27.053707 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02761d93-29b3-42a7-9674-935c8f359a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:27.054370 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02761d93-29b3-42a7-9674-935c8f359a6d None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:27.054656 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02761d93-29b3-42a7-9674-935c8f359a6d None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:27.054936 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02761d93-29b3-42a7-9674-935c8f359a6d None admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:27.055718 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02761d93-29b3-42a7-9674-935c8f359a6d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:06:27.056031 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02761d93-29b3-42a7-9674-935c8f359a6d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:06:27.057452 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02761d93-29b3-42a7-9674-935c8f359a6d None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:06:27.069113 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 646/1286] 10.222.0.43 () {56 vars in 1148 bytes} [Wed Jun 22 10:06:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:06:27.075132 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79184116-cfcf-4eed-9abc-bf8b782e119d None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:27.173144 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79184116-cfcf-4eed-9abc-bf8b782e119d None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:27.205028 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d68acb-b167-485a-aa20-ddb01819b9e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:27.205672 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d68acb-b167-485a-aa20-ddb01819b9e9 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:27.205982 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d68acb-b167-485a-aa20-ddb01819b9e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:27.206260 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d68acb-b167-485a-aa20-ddb01819b9e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:27.207083 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d68acb-b167-485a-aa20-ddb01819b9e9 None admin] RBAC: Adding query filter params (role.id=26d9c2ab5dfc4e6d9ca80c6014123906, scope.project.id=e03f1c17e0884f188231d2949dc6f956, user.id=341ec95408c94dae8539ccff7225e3ba) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:06:27.207395 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d68acb-b167-485a-aa20-ddb01819b9e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:06:27.208825 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d68acb-b167-485a-aa20-ddb01819b9e9 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:06:27.214524 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 641/1287] 10.222.0.43 () {56 vars in 1374 bytes} [Wed Jun 22 10:06:27 2022] GET /identity/v3/role_assignments?user.id=341ec95408c94dae8539ccff7225e3ba&scope.project.id=e03f1c17e0884f188231d2949dc6f956&role.id=26d9c2ab5dfc4e6d9ca80c6014123906 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:06:29.277315 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265bb29c-47e2-44a9-b80b-40bc92c2e460 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:29.277898 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265bb29c-47e2-44a9-b80b-40bc92c2e460 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:29.277898 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265bb29c-47e2-44a9-b80b-40bc92c2e460 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:29.279267 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 647/1288] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:06:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:06:29.285067 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a58820-f648-4193-8293-f6c9a12f3337 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:29.285496 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a58820-f648-4193-8293-f6c9a12f3337 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:29.285627 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a58820-f648-4193-8293-f6c9a12f3337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:29.302640 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-03a58820-f648-4193-8293-f6c9a12f3337 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:06:29.303807 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-03a58820-f648-4193-8293-f6c9a12f3337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:06:29.332124 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:06:29.370138 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 642/1289] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:06:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 10:06:29.392163 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265bb29c-47e2-44a9-b80b-40bc92c2e460 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:29.493558 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265bb29c-47e2-44a9-b80b-40bc92c2e460 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:29.503971 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:06:29.527613 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179fc269-2b7c-4ea1-8822-1a607a9e41fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:29.528398 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179fc269-2b7c-4ea1-8822-1a607a9e41fa None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:29.528683 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179fc269-2b7c-4ea1-8822-1a607a9e41fa None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:29.528961 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179fc269-2b7c-4ea1-8822-1a607a9e41fa None admin] PATH_INFO: `/v3/services/placement` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:29.530278 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179fc269-2b7c-4ea1-8822-1a607a9e41fa None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:06:29.531639 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179fc269-2b7c-4ea1-8822-1a607a9e41fa None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:06:29.543134 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-179fc269-2b7c-4ea1-8822-1a607a9e41fa None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 22 10:06:29.543134 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:06:29.543134 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 10:06:29.543134 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 10:06:29.543134 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 10:06:29.543134 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 10:06:29.543134 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 10:06:29.543134 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 10:06:29.543134 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 22 10:06:29.543134 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:06:29.543134 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 10:06:29.543134 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:06:29.543134 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:06:29.543134 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:06:29.543134 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:06:29.543134 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:06:29.543134 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:06:29.544323 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:06:29.544323 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:06:29.544323 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:06:29.544323 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:06:29.544323 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:06:29.544323 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:06:29.544323 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 10:06:29.544323 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 10:06:29.544323 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 10:06:29.544323 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 10:06:29.544323 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:06:29.544323 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:06:29.544323 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:06:29.544323 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:06:29.544323 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:06:29.544323 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:06:29.545244 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:06:29.545244 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jun 22 10:06:29.545244 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:06:29.545244 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:06:29.545244 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:06:29.545244 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:06:29.545244 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:06:29.545244 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:06:29.545244 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:06:29.545244 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:06:29.545244 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 10:06:29.545244 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 10:06:29.545244 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 22 10:06:29.545244 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:06:29.545244 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 648/1290] 10.222.0.43 () {56 vars in 1117 bytes} [Wed Jun 22 10:06:29 2022] GET /identity/v3/services/placement => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:06:29.550339 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a58820-f648-4193-8293-f6c9a12f3337 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:29.659330 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a58820-f648-4193-8293-f6c9a12f3337 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:29.692516 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de1dbf5-4544-47a4-be39-4e568df0e030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:29.693177 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de1dbf5-4544-47a4-be39-4e568df0e030 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:29.693463 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de1dbf5-4544-47a4-be39-4e568df0e030 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:29.693769 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de1dbf5-4544-47a4-be39-4e568df0e030 None admin] PATH_INFO: `/v3/services` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:29.694478 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de1dbf5-4544-47a4-be39-4e568df0e030 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:06:29.694792 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de1dbf5-4544-47a4-be39-4e568df0e030 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:06:29.696177 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de1dbf5-4544-47a4-be39-4e568df0e030 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:06:29.700866 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 643/1291] 10.222.0.43 () {56 vars in 1116 bytes} [Wed Jun 22 10:06:29 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:06:29.707271 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179fc269-2b7c-4ea1-8822-1a607a9e41fa None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:29.804852 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179fc269-2b7c-4ea1-8822-1a607a9e41fa None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:29.839391 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8200f71-1a7c-42ee-9f35-7c907224cf64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:29.840071 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8200f71-1a7c-42ee-9f35-7c907224cf64 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:29.840337 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8200f71-1a7c-42ee-9f35-7c907224cf64 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:29.840615 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8200f71-1a7c-42ee-9f35-7c907224cf64 None admin] PATH_INFO: `/v3/services` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:29.841321 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8200f71-1a7c-42ee-9f35-7c907224cf64 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:06:29.841628 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8200f71-1a7c-42ee-9f35-7c907224cf64 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:06:29.843947 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8200f71-1a7c-42ee-9f35-7c907224cf64 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:06:29.849085 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 649/1292] 10.222.0.43 () {56 vars in 1116 bytes} [Wed Jun 22 10:06:29 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:06:31.896256 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bba7576-0154-4566-8e2e-928d3df69eaa None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:31.896786 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bba7576-0154-4566-8e2e-928d3df69eaa None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:31.896902 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bba7576-0154-4566-8e2e-928d3df69eaa None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:31.898205 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 644/1293] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:06:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:06:31.903245 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e202b3-176c-42c8-ba53-dbe5762c5dac None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:31.903630 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e202b3-176c-42c8-ba53-dbe5762c5dac None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:31.903816 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e202b3-176c-42c8-ba53-dbe5762c5dac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:31.920884 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-f3e202b3-176c-42c8-ba53-dbe5762c5dac None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:06:31.922155 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-f3e202b3-176c-42c8-ba53-dbe5762c5dac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:06:31.951689 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:06:31.995875 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 650/1294] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:06:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 10:06:32.020036 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bba7576-0154-4566-8e2e-928d3df69eaa None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:32.051259 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:06:32.121675 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bba7576-0154-4566-8e2e-928d3df69eaa None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:32.155768 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36f07ac-9bed-4a35-a64e-3aee633614b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:32.156363 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36f07ac-9bed-4a35-a64e-3aee633614b5 None admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:32.156653 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36f07ac-9bed-4a35-a64e-3aee633614b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:32.156933 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36f07ac-9bed-4a35-a64e-3aee633614b5 None admin] PATH_INFO: `/v3/services` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:32.157648 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36f07ac-9bed-4a35-a64e-3aee633614b5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:06:32.159067 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36f07ac-9bed-4a35-a64e-3aee633614b5 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:06:32.171708 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 645/1295] 10.222.0.43 () {60 vars in 1141 bytes} [Wed Jun 22 10:06:32 2022] POST /identity/v3/services => generated 246 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:06:34.211593 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d420d4-9669-4a1a-9c1d-3609338b2b63 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:34.212136 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d420d4-9669-4a1a-9c1d-3609338b2b63 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:34.212136 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d420d4-9669-4a1a-9c1d-3609338b2b63 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:34.213544 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 651/1296] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:06:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:06:34.219034 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b7ae41-7826-4df2-89c3-5cc089e01d92 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:34.219427 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b7ae41-7826-4df2-89c3-5cc089e01d92 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:34.219592 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b7ae41-7826-4df2-89c3-5cc089e01d92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:34.236596 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-51b7ae41-7826-4df2-89c3-5cc089e01d92 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:06:34.237811 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-51b7ae41-7826-4df2-89c3-5cc089e01d92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:06:34.308095 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 646/1297] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:06:34 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 10:06:34.331670 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d420d4-9669-4a1a-9c1d-3609338b2b63 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:34.444314 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d420d4-9669-4a1a-9c1d-3609338b2b63 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:34.477584 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f581da-d111-4a50-aa59-dff63bfbb4f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:34.478402 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f581da-d111-4a50-aa59-dff63bfbb4f7 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:34.478691 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f581da-d111-4a50-aa59-dff63bfbb4f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:34.478975 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f581da-d111-4a50-aa59-dff63bfbb4f7 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:34.479621 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f581da-d111-4a50-aa59-dff63bfbb4f7 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:06:34.480985 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f581da-d111-4a50-aa59-dff63bfbb4f7 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:06:34.492859 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-84f581da-d111-4a50-aa59-dff63bfbb4f7 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 22 10:06:34.492859 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:06:34.492859 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 10:06:34.492859 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 10:06:34.492859 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 10:06:34.492859 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 10:06:34.492859 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 10:06:34.492859 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 10:06:34.492859 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 22 10:06:34.492859 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:06:34.492859 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 10:06:34.492859 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:06:34.492859 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:06:34.492859 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:06:34.492859 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:06:34.492859 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:06:34.492859 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:06:34.494044 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:06:34.494044 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:06:34.494044 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:06:34.494044 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:06:34.494044 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:06:34.494044 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:06:34.494044 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 10:06:34.494044 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 10:06:34.494044 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 10:06:34.494044 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 10:06:34.494044 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:06:34.494044 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:06:34.494044 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:06:34.494044 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:06:34.494044 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:06:34.494044 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:06:34.494930 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:06:34.494930 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jun 22 10:06:34.494930 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:06:34.494930 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:06:34.494930 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:06:34.494930 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:06:34.494930 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:06:34.494930 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:06:34.494930 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:06:34.494930 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:06:34.494930 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 10:06:34.494930 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 10:06:34.494930 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 22 10:06:34.494930 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:06:34.494930 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 652/1298] 10.222.0.43 () {56 vars in 1117 bytes} [Wed Jun 22 10:06:34 2022] GET /identity/v3/services/placement => generated 90 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:06:34.500684 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b7ae41-7826-4df2-89c3-5cc089e01d92 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:34.519672 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:06:34.599841 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b7ae41-7826-4df2-89c3-5cc089e01d92 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:34.632796 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b69779-87a0-46ee-bd83-3f0ea35e8d20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:34.633451 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b69779-87a0-46ee-bd83-3f0ea35e8d20 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:34.633759 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b69779-87a0-46ee-bd83-3f0ea35e8d20 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:34.634040 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b69779-87a0-46ee-bd83-3f0ea35e8d20 None admin] PATH_INFO: `/v3/services` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:34.634738 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b69779-87a0-46ee-bd83-3f0ea35e8d20 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:06:34.635043 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b69779-87a0-46ee-bd83-3f0ea35e8d20 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:06:34.636406 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b69779-87a0-46ee-bd83-3f0ea35e8d20 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:06:34.642127 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 647/1299] 10.222.0.43 () {56 vars in 1116 bytes} [Wed Jun 22 10:06:34 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:06:34.647961 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f581da-d111-4a50-aa59-dff63bfbb4f7 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:34.678867 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:06:34.750201 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f581da-d111-4a50-aa59-dff63bfbb4f7 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:34.783239 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbda9fb-0421-4e1a-8325-2502c160e522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:34.783879 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbda9fb-0421-4e1a-8325-2502c160e522 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:34.784159 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbda9fb-0421-4e1a-8325-2502c160e522 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:34.784435 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbda9fb-0421-4e1a-8325-2502c160e522 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:34.785215 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbda9fb-0421-4e1a-8325-2502c160e522 None admin] RBAC: Adding query filter params (interface=public, service_id=0300226b383a4dbaa380b8d6f7d0cd8c, region_id=RegionOne) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:06:34.785531 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbda9fb-0421-4e1a-8325-2502c160e522 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:06:34.786917 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbda9fb-0421-4e1a-8325-2502c160e522 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:06:34.791821 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 653/1300] 10.222.0.43 () {56 vars in 1251 bytes} [Wed Jun 22 10:06:34 2022] GET /identity/v3/endpoints?service_id=0300226b383a4dbaa380b8d6f7d0cd8c&interface=public®ion_id=RegionOne => generated 194 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:06:34.798112 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b69779-87a0-46ee-bd83-3f0ea35e8d20 None admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:34.886136 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:06:34.904153 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b69779-87a0-46ee-bd83-3f0ea35e8d20 None admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:34.937897 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b978c7-feba-425f-8072-40aa5a20a58d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:34.938552 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b978c7-feba-425f-8072-40aa5a20a58d None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:34.938835 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b978c7-feba-425f-8072-40aa5a20a58d None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:34.939113 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b978c7-feba-425f-8072-40aa5a20a58d None admin] PATH_INFO: `/v3/services` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:34.939785 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b978c7-feba-425f-8072-40aa5a20a58d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:06:34.941148 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b978c7-feba-425f-8072-40aa5a20a58d None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:06:34.947848 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 648/1301] 10.222.0.43 () {56 vars in 1087 bytes} [Wed Jun 22 10:06:34 2022] GET /identity/v3/services => generated 2191 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:06:36.943273 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdf5d5f-e9a3-4e16-ae48-8bb40675b3cf None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:36.943810 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdf5d5f-e9a3-4e16-ae48-8bb40675b3cf None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:36.943810 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdf5d5f-e9a3-4e16-ae48-8bb40675b3cf None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:36.945183 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 654/1302] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:06:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:06:36.950174 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cf6de9-6d20-4bb8-a05c-d2a292b5f746 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:36.950593 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cf6de9-6d20-4bb8-a05c-d2a292b5f746 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:36.950797 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cf6de9-6d20-4bb8-a05c-d2a292b5f746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:36.967555 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-a2cf6de9-6d20-4bb8-a05c-d2a292b5f746 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:06:36.968716 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-a2cf6de9-6d20-4bb8-a05c-d2a292b5f746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:06:37.039320 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 649/1303] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:06:36 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 10:06:37.061865 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdf5d5f-e9a3-4e16-ae48-8bb40675b3cf None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:37.156537 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:06:37.163580 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdf5d5f-e9a3-4e16-ae48-8bb40675b3cf None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:37.196682 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650778eb-c16f-47b3-aac9-75fb5c40de40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:37.197410 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650778eb-c16f-47b3-aac9-75fb5c40de40 None admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:37.197720 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650778eb-c16f-47b3-aac9-75fb5c40de40 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:37.198005 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650778eb-c16f-47b3-aac9-75fb5c40de40 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:37.198653 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650778eb-c16f-47b3-aac9-75fb5c40de40 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:06:37.200440 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650778eb-c16f-47b3-aac9-75fb5c40de40 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:06:37.213221 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application [None req-650778eb-c16f-47b3-aac9-75fb5c40de40 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 22 10:06:37.213221 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:06:37.213221 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 10:06:37.213221 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 10:06:37.213221 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 10:06:37.213221 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 10:06:37.213221 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 10:06:37.213221 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 10:06:37.213221 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 22 10:06:37.213221 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:06:37.213221 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 10:06:37.213221 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:06:37.213221 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 10:06:37.213221 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 10:06:37.213221 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 10:06:37.213221 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 10:06:37.213221 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 10:06:37.214233 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 10:06:37.214233 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 10:06:37.214233 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 10:06:37.214233 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 10:06:37.214233 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 10:06:37.214233 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 10:06:37.214233 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 10:06:37.214233 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 10:06:37.214233 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 10:06:37.214233 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 10:06:37.214233 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 10:06:37.214233 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 10:06:37.214233 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 10:06:37.214233 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 10:06:37.214233 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 10:06:37.214233 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 10:06:37.215117 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 10:06:37.215117 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application with Lock( Jun 22 10:06:37.215117 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 10:06:37.215117 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self._enter() Jun 22 10:06:37.215117 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 10:06:37.215117 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 10:06:37.215117 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 10:06:37.215117 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application return self.creator() Jun 22 10:06:37.215117 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 10:06:37.215117 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application created_value = creator( Jun 22 10:06:37.215117 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 10:06:37.215117 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 10:06:37.215117 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 22 10:06:37.215117 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: ERROR keystone.server.flask.application Jun 22 10:06:37.215117 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 655/1304] 10.222.0.43 () {56 vars in 1117 bytes} [Wed Jun 22 10:06:37 2022] GET /identity/v3/services/placement => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 10:06:37.221579 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cf6de9-6d20-4bb8-a05c-d2a292b5f746 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:37.297661 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:06:37.320481 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cf6de9-6d20-4bb8-a05c-d2a292b5f746 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:37.355755 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d27c39-065d-480a-8e76-fc2d9be76306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:37.356416 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d27c39-065d-480a-8e76-fc2d9be76306 None admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:37.356703 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d27c39-065d-480a-8e76-fc2d9be76306 None admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:37.356983 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d27c39-065d-480a-8e76-fc2d9be76306 None admin] PATH_INFO: `/v3/services` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:37.357710 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d27c39-065d-480a-8e76-fc2d9be76306 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:06:37.358027 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d27c39-065d-480a-8e76-fc2d9be76306 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:06:37.359434 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d27c39-065d-480a-8e76-fc2d9be76306 None admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:06:37.364476 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 650/1305] 10.222.0.43 () {56 vars in 1116 bytes} [Wed Jun 22 10:06:37 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:06:37.370347 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650778eb-c16f-47b3-aac9-75fb5c40de40 None admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:06:37.469575 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650778eb-c16f-47b3-aac9-75fb5c40de40 None admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:06:37.503290 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fe70b3-6ecb-45b4-9605-5b752ce78b89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:06:37.503931 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fe70b3-6ecb-45b4-9605-5b752ce78b89 None admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:06:37.504216 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fe70b3-6ecb-45b4-9605-5b752ce78b89 None admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:06:37.504496 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fe70b3-6ecb-45b4-9605-5b752ce78b89 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:06:37.505238 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fe70b3-6ecb-45b4-9605-5b752ce78b89 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:06:37.506621 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fe70b3-6ecb-45b4-9605-5b752ce78b89 None admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:06:37.524854 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 656/1306] 10.222.0.43 () {60 vars in 1144 bytes} [Wed Jun 22 10:06:37 2022] POST /identity/v3/endpoints => generated 331 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:06:47.362081 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=30 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:06:47.520597 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:41.475753 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bce6222-a626-420e-8c8e-880a87329ba7 None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:41.476335 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bce6222-a626-420e-8c8e-880a87329ba7 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:41.476335 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bce6222-a626-420e-8c8e-880a87329ba7 None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:41.482121 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 651/1307] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:07:41 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:07:41.483530 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea61c236-0cdf-40cb-a09d-856afcf0b1db None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:41.483995 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea61c236-0cdf-40cb-a09d-856afcf0b1db None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:41.484078 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea61c236-0cdf-40cb-a09d-856afcf0b1db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:41.717115 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-ea61c236-0cdf-40cb-a09d-856afcf0b1db None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:07:41.718244 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-ea61c236-0cdf-40cb-a09d-856afcf0b1db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:07:41.883703 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 657/1308] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:07:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 401 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:07:41.944601 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839d2f82-8633-4c10-b14b-d5b1846b72a0 None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:41.945304 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839d2f82-8633-4c10-b14b-d5b1846b72a0 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:41.945827 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839d2f82-8633-4c10-b14b-d5b1846b72a0 None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:41.948645 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 652/1309] 10.222.0.43 () {54 vars in 964 bytes} [Wed Jun 22 10:07:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:07:41.955358 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75f0450-7920-406f-9614-847f9982906d None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:41.955979 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75f0450-7920-406f-9614-847f9982906d None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:41.956477 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75f0450-7920-406f-9614-847f9982906d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:42.046732 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-f75f0450-7920-406f-9614-847f9982906d None None] MFA Rules not processed for user `fe93d4c0737249fd8623bb5ce188e34e`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:07:42.048494 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-f75f0450-7920-406f-9614-847f9982906d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:07:42.072197 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:42.142760 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 658/1310] 10.222.0.43 () {58 vars in 1061 bytes} [Wed Jun 22 10:07:41 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:07:42.151692 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839d2f82-8633-4c10-b14b-d5b1846b72a0 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:42.153422 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-839d2f82-8633-4c10-b14b-d5b1846b72a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:07:42.294030 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839d2f82-8633-4c10-b14b-d5b1846b72a0 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:42.377783 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d337111f-9dcc-46e8-afde-bc166ec4859e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe93d4c0737249fd8623bb5ce188e34e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:42.378441 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d337111f-9dcc-46e8-afde-bc166ec4859e service neutron] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:42.378727 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d337111f-9dcc-46e8-afde-bc166ec4859e service neutron] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:42.379004 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d337111f-9dcc-46e8-afde-bc166ec4859e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:42.380675 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-d337111f-9dcc-46e8-afde-bc166ec4859e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:07:42.441061 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:42.505234 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d337111f-9dcc-46e8-afde-bc166ec4859e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:42.507019 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d337111f-9dcc-46e8-afde-bc166ec4859e service neutron] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:42.530139 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 653/1311] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:07:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:07:44.894648 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cb40fa-d35a-4be4-b240-7fd44fa68f98 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:44.895193 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cb40fa-d35a-4be4-b240-7fd44fa68f98 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:44.895193 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cb40fa-d35a-4be4-b240-7fd44fa68f98 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:44.896567 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 659/1312] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:07:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:07:44.902307 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c594bdb-cf9e-430e-8a0e-ad72129820e9 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:44.902772 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c594bdb-cf9e-430e-8a0e-ad72129820e9 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:44.902871 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c594bdb-cf9e-430e-8a0e-ad72129820e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:44.977479 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-3c594bdb-cf9e-430e-8a0e-ad72129820e9 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:07:44.978727 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-3c594bdb-cf9e-430e-8a0e-ad72129820e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:07:45.092947 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 654/1313] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:07:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:07:45.132046 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cb40fa-d35a-4be4-b240-7fd44fa68f98 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:45.133576 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-c0cb40fa-d35a-4be4-b240-7fd44fa68f98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:07:45.243023 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cb40fa-d35a-4be4-b240-7fd44fa68f98 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:45.314542 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:45.316814 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8d8fd9-4029-4bfb-8950-c83accb7df98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe93d4c0737249fd8623bb5ce188e34e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:45.317493 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8d8fd9-4029-4bfb-8950-c83accb7df98 service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:45.318029 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8d8fd9-4029-4bfb-8950-c83accb7df98 service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:45.318369 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8d8fd9-4029-4bfb-8950-c83accb7df98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:45.320430 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-8b8d8fd9-4029-4bfb-8950-c83accb7df98 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:07:45.434086 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8d8fd9-4029-4bfb-8950-c83accb7df98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:45.435532 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8d8fd9-4029-4bfb-8950-c83accb7df98 service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:45.455673 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 660/1314] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:07:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:07:47.871159 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4857d39e-7efd-42bb-9cb1-466c69f1147a None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:47.871669 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4857d39e-7efd-42bb-9cb1-466c69f1147a None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:47.871669 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4857d39e-7efd-42bb-9cb1-466c69f1147a None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:47.873099 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 655/1315] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:07:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:07:47.878788 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05108bb-07b2-4945-8606-a5cf05268eae None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:47.879204 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05108bb-07b2-4945-8606-a5cf05268eae None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:47.879359 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05108bb-07b2-4945-8606-a5cf05268eae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:47.944167 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-c05108bb-07b2-4945-8606-a5cf05268eae None None] MFA Rules not processed for user `0f1078f8c5e549218cce1ee68f96ea91`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:07:47.945377 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-c05108bb-07b2-4945-8606-a5cf05268eae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:07:47.997998 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:48.041858 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 661/1316] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:07:47 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:07:48.082579 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4857d39e-7efd-42bb-9cb1-466c69f1147a None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:48.084126 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-4857d39e-7efd-42bb-9cb1-466c69f1147a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:07:48.095803 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:48.191455 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4857d39e-7efd-42bb-9cb1-466c69f1147a None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:48.265637 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16907702-50e0-47c8-bf09-ca964d99683b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe93d4c0737249fd8623bb5ce188e34e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:48.266312 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16907702-50e0-47c8-bf09-ca964d99683b service neutron] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:48.266599 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16907702-50e0-47c8-bf09-ca964d99683b service neutron] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:48.266881 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16907702-50e0-47c8-bf09-ca964d99683b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:48.268523 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-16907702-50e0-47c8-bf09-ca964d99683b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:07:48.331321 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:48.378298 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16907702-50e0-47c8-bf09-ca964d99683b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:48.379802 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16907702-50e0-47c8-bf09-ca964d99683b service neutron] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:48.397916 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 656/1317] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:07:48 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:07:51.038349 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11ba09d-31b3-490e-b248-652912612520 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:51.038924 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11ba09d-31b3-490e-b248-652912612520 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:51.038924 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11ba09d-31b3-490e-b248-652912612520 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:51.040276 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 662/1318] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:07:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:07:51.045846 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeffda8-d663-4015-8d40-68e95547e848 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:51.046240 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeffda8-d663-4015-8d40-68e95547e848 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:51.046400 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeffda8-d663-4015-8d40-68e95547e848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:51.110910 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-4aeffda8-d663-4015-8d40-68e95547e848 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:07:51.112105 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-4aeffda8-d663-4015-8d40-68e95547e848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:07:51.207240 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 657/1319] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:07:51 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:07:51.261467 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b34502-92bf-4441-be66-863a47ba9f9c None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:51.261780 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b34502-92bf-4441-be66-863a47ba9f9c None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:51.262065 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b34502-92bf-4441-be66-863a47ba9f9c None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:51.263438 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 663/1320] 10.222.0.43 () {54 vars in 964 bytes} [Wed Jun 22 10:07:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:07:51.269597 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b535a88-8d05-4a26-b780-6bef874118d9 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:51.269915 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b535a88-8d05-4a26-b780-6bef874118d9 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:51.270200 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b535a88-8d05-4a26-b780-6bef874118d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:51.290672 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:51.345023 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-0b535a88-8d05-4a26-b780-6bef874118d9 None None] MFA Rules not processed for user `fe93d4c0737249fd8623bb5ce188e34e`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:07:51.346242 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-0b535a88-8d05-4a26-b780-6bef874118d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:07:51.421014 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 658/1321] 10.222.0.43 () {58 vars in 1061 bytes} [Wed Jun 22 10:07:51 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:07:51.430503 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b34502-92bf-4441-be66-863a47ba9f9c None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:51.432534 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-85b34502-92bf-4441-be66-863a47ba9f9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:07:51.535857 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b34502-92bf-4441-be66-863a47ba9f9c None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:51.607273 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe9c77b-6dcb-45e5-832b-71963af49d47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe93d4c0737249fd8623bb5ce188e34e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:51.607842 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe9c77b-6dcb-45e5-832b-71963af49d47 service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:51.608127 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe9c77b-6dcb-45e5-832b-71963af49d47 service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:51.608405 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe9c77b-6dcb-45e5-832b-71963af49d47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:51.610071 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-4fe9c77b-6dcb-45e5-832b-71963af49d47 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:07:51.617294 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:51.720857 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe9c77b-6dcb-45e5-832b-71963af49d47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:51.722330 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe9c77b-6dcb-45e5-832b-71963af49d47 service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:51.741357 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 664/1322] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:07:51 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:07:54.962754 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8ab01b-defd-4886-8863-482dbfe986b8 None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:54.963360 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8ab01b-defd-4886-8863-482dbfe986b8 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:54.963592 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8ab01b-defd-4886-8863-482dbfe986b8 None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:54.964889 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 659/1323] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:07:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:07:54.970807 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8792b1e2-2da8-4102-8f38-ebddc3438c43 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:54.971320 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8792b1e2-2da8-4102-8f38-ebddc3438c43 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:54.971427 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8792b1e2-2da8-4102-8f38-ebddc3438c43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:55.037467 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-8792b1e2-2da8-4102-8f38-ebddc3438c43 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:07:55.038700 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-8792b1e2-2da8-4102-8f38-ebddc3438c43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:07:55.112760 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:55.157745 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 665/1324] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:07:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:07:55.194617 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8ab01b-defd-4886-8863-482dbfe986b8 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:55.196183 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-0c8ab01b-defd-4886-8863-482dbfe986b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:07:55.305049 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8ab01b-defd-4886-8863-482dbfe986b8 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:55.317943 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:55.382934 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81ab7c7-9dcf-4785-b601-17ec81340bf9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe93d4c0737249fd8623bb5ce188e34e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:55.383588 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81ab7c7-9dcf-4785-b601-17ec81340bf9 service neutron] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:55.383872 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81ab7c7-9dcf-4785-b601-17ec81340bf9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:55.384148 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81ab7c7-9dcf-4785-b601-17ec81340bf9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:55.386528 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-a81ab7c7-9dcf-4785-b601-17ec81340bf9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:07:55.497672 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81ab7c7-9dcf-4785-b601-17ec81340bf9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:55.499052 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81ab7c7-9dcf-4785-b601-17ec81340bf9 service neutron] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:55.518470 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 660/1325] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:07:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:07:57.646756 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32e6035-a009-4c90-ab11-cdd6617774ca None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:57.647261 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32e6035-a009-4c90-ab11-cdd6617774ca None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:57.647261 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32e6035-a009-4c90-ab11-cdd6617774ca None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:57.648629 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 666/1326] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:07:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:07:57.654565 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddc742c-a326-466a-8fab-9cfefa175a45 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:57.655042 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddc742c-a326-466a-8fab-9cfefa175a45 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:57.655140 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddc742c-a326-466a-8fab-9cfefa175a45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:57.701830 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:57.720296 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-bddc742c-a326-466a-8fab-9cfefa175a45 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:07:57.721502 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-bddc742c-a326-466a-8fab-9cfefa175a45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:07:57.820683 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 661/1327] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:07:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:07:57.857883 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32e6035-a009-4c90-ab11-cdd6617774ca None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:07:57.859438 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-a32e6035-a009-4c90-ab11-cdd6617774ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:07:57.968262 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32e6035-a009-4c90-ab11-cdd6617774ca None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:07:58.045747 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074f2eb4-de4e-4c98-8f9c-69234c8eacc3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe93d4c0737249fd8623bb5ce188e34e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:07:58.046408 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074f2eb4-de4e-4c98-8f9c-69234c8eacc3 service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:07:58.046695 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074f2eb4-de4e-4c98-8f9c-69234c8eacc3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:07:58.046976 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074f2eb4-de4e-4c98-8f9c-69234c8eacc3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:07:58.048625 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-074f2eb4-de4e-4c98-8f9c-69234c8eacc3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:07:58.065824 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:07:58.184754 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074f2eb4-de4e-4c98-8f9c-69234c8eacc3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:07:58.186245 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074f2eb4-de4e-4c98-8f9c-69234c8eacc3 service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:07:58.205393 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 667/1328] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:07:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:08:00.323189 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff10f5a-db7d-4491-84e2-029e105d1d27 None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:00.323666 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff10f5a-db7d-4491-84e2-029e105d1d27 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:00.323761 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff10f5a-db7d-4491-84e2-029e105d1d27 None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:00.325263 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 662/1329] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:08:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:08:00.330800 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06730ec-c6a1-43e1-a723-74161f3dd9d7 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:00.331238 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06730ec-c6a1-43e1-a723-74161f3dd9d7 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:00.331350 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06730ec-c6a1-43e1-a723-74161f3dd9d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:00.402829 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-d06730ec-c6a1-43e1-a723-74161f3dd9d7 None None] MFA Rules not processed for user `0f1078f8c5e549218cce1ee68f96ea91`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:08:00.404051 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-d06730ec-c6a1-43e1-a723-74161f3dd9d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:08:00.468473 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:00.501987 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 668/1330] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:08:00 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:08:00.539325 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff10f5a-db7d-4491-84e2-029e105d1d27 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:00.541558 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-cff10f5a-db7d-4491-84e2-029e105d1d27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:08:00.646393 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff10f5a-db7d-4491-84e2-029e105d1d27 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:00.667644 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:00.721986 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7e8aa5-2162-412f-a17d-d25f73b72eec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe93d4c0737249fd8623bb5ce188e34e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:00.722632 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7e8aa5-2162-412f-a17d-d25f73b72eec service neutron] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:00.722914 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7e8aa5-2162-412f-a17d-d25f73b72eec service neutron] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:00.723189 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7e8aa5-2162-412f-a17d-d25f73b72eec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:00.724822 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-1f7e8aa5-2162-412f-a17d-d25f73b72eec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:08:00.857574 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7e8aa5-2162-412f-a17d-d25f73b72eec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:00.859061 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7e8aa5-2162-412f-a17d-d25f73b72eec service neutron] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:00.889132 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 663/1331] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:08:00 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:08:03.229413 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a1820f-d16e-4f81-8095-04441ff53e77 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:03.230257 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a1820f-d16e-4f81-8095-04441ff53e77 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:03.230257 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a1820f-d16e-4f81-8095-04441ff53e77 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:03.231384 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 669/1332] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:08:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:08:03.236712 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1c4a31-1aff-42a9-95e2-f10e395d8ce2 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:03.237128 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1c4a31-1aff-42a9-95e2-f10e395d8ce2 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:03.237281 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1c4a31-1aff-42a9-95e2-f10e395d8ce2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:03.301042 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:03.303933 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-0f1c4a31-1aff-42a9-95e2-f10e395d8ce2 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:08:03.305724 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-0f1c4a31-1aff-42a9-95e2-f10e395d8ce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:08:03.404271 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 664/1333] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:08:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:08:03.440071 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a1820f-d16e-4f81-8095-04441ff53e77 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:03.441628 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-32a1820f-d16e-4f81-8095-04441ff53e77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:08:03.551203 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a1820f-d16e-4f81-8095-04441ff53e77 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:03.628931 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe7d781-acf3-453d-8468-f5419f054593 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe93d4c0737249fd8623bb5ce188e34e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:03.629585 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe7d781-acf3-453d-8468-f5419f054593 service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:03.629896 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe7d781-acf3-453d-8468-f5419f054593 service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:03.630172 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe7d781-acf3-453d-8468-f5419f054593 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:03.631907 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-bfe7d781-acf3-453d-8468-f5419f054593 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:08:03.659754 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:03.745150 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe7d781-acf3-453d-8468-f5419f054593 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:03.746774 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe7d781-acf3-453d-8468-f5419f054593 service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:03.767052 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 670/1334] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:08:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:08:05.910126 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5d067e-e574-4111-9f3a-97acbefcb9c4 None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:05.910635 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5d067e-e574-4111-9f3a-97acbefcb9c4 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:05.910635 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5d067e-e574-4111-9f3a-97acbefcb9c4 None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:05.911976 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 665/1335] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:08:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 10:08:05.917269 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2492aa-31b7-4b20-be37-000d8fa0e383 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:05.917748 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2492aa-31b7-4b20-be37-000d8fa0e383 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:05.917984 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2492aa-31b7-4b20-be37-000d8fa0e383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:05.996086 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-5e2492aa-31b7-4b20-be37-000d8fa0e383 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:08:05.997277 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-5e2492aa-31b7-4b20-be37-000d8fa0e383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:08:06.079503 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:06.103680 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 671/1336] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:08:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:08:06.143536 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5d067e-e574-4111-9f3a-97acbefcb9c4 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:06.145114 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-bd5d067e-e574-4111-9f3a-97acbefcb9c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:08:06.249088 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5d067e-e574-4111-9f3a-97acbefcb9c4 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:06.277580 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:06.322624 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7c4a05-5fa6-43e8-abe1-f6c5a969455c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe93d4c0737249fd8623bb5ce188e34e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:06.323270 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7c4a05-5fa6-43e8-abe1-f6c5a969455c service neutron] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:06.323558 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7c4a05-5fa6-43e8-abe1-f6c5a969455c service neutron] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:06.323840 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7c4a05-5fa6-43e8-abe1-f6c5a969455c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:06.325469 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-7e7c4a05-5fa6-43e8-abe1-f6c5a969455c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:08:06.433704 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7c4a05-5fa6-43e8-abe1-f6c5a969455c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:06.435148 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7c4a05-5fa6-43e8-abe1-f6c5a969455c service neutron] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:06.452904 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 666/1337] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:08:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:08:08.808181 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72162f8-6b21-4bac-963d-c2ecc82da194 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:08.808719 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72162f8-6b21-4bac-963d-c2ecc82da194 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:08.808719 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72162f8-6b21-4bac-963d-c2ecc82da194 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:08.810150 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 672/1338] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:08:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:08:08.815413 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f8933d-318f-4350-9c0c-e0b8261994de None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:08.815856 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f8933d-318f-4350-9c0c-e0b8261994de None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:08.815958 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f8933d-318f-4350-9c0c-e0b8261994de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:08.880883 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-19f8933d-318f-4350-9c0c-e0b8261994de None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:08:08.882104 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-19f8933d-318f-4350-9c0c-e0b8261994de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:08:08.892978 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:08.982737 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 667/1339] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:08:08 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:08:09.018581 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72162f8-6b21-4bac-963d-c2ecc82da194 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:09.020102 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-f72162f8-6b21-4bac-963d-c2ecc82da194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:08:09.123098 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72162f8-6b21-4bac-963d-c2ecc82da194 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:09.197102 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579fdc83-e7b4-4235-839c-174be854761b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe93d4c0737249fd8623bb5ce188e34e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:09.197773 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579fdc83-e7b4-4235-839c-174be854761b service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:09.198064 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579fdc83-e7b4-4235-839c-174be854761b service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:09.198344 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579fdc83-e7b4-4235-839c-174be854761b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:09.200000 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-579fdc83-e7b4-4235-839c-174be854761b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:08:09.235196 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:09.309751 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579fdc83-e7b4-4235-839c-174be854761b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:09.311177 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579fdc83-e7b4-4235-839c-174be854761b service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:09.328932 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 673/1340] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:08:09 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:08:13.450327 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4225556-db2d-48f4-bb26-31a61c5b4f6d None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:13.450864 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4225556-db2d-48f4-bb26-31a61c5b4f6d None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:13.450864 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4225556-db2d-48f4-bb26-31a61c5b4f6d None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:13.452366 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 668/1341] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:08:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:08:13.457429 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277f3136-205f-4a62-b488-6707e15fb339 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:13.457915 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277f3136-205f-4a62-b488-6707e15fb339 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:13.458029 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277f3136-205f-4a62-b488-6707e15fb339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:13.544148 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-277f3136-205f-4a62-b488-6707e15fb339 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:08:13.545357 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-277f3136-205f-4a62-b488-6707e15fb339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:08:13.642277 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:13.655730 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 674/1342] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:08:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:08:13.694625 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4225556-db2d-48f4-bb26-31a61c5b4f6d None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:13.696957 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-a4225556-db2d-48f4-bb26-31a61c5b4f6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:08:13.797526 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4225556-db2d-48f4-bb26-31a61c5b4f6d None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:13.801115 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfed576-bf10-48c7-9b25-7939550824f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe93d4c0737249fd8623bb5ce188e34e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:13.801863 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfed576-bf10-48c7-9b25-7939550824f1 service neutron] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:13.802215 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfed576-bf10-48c7-9b25-7939550824f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:13.802559 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfed576-bf10-48c7-9b25-7939550824f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:13.812486 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfed576-bf10-48c7-9b25-7939550824f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:13.814072 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfed576-bf10-48c7-9b25-7939550824f1 service neutron] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:13.828525 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 669/1343] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:08:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:08:16.505774 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953fcf21-9ac9-4fcc-96aa-2a61d0d012ac None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:16.506317 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953fcf21-9ac9-4fcc-96aa-2a61d0d012ac None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:16.506317 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953fcf21-9ac9-4fcc-96aa-2a61d0d012ac None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:16.507724 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 675/1344] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:08:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:08:16.513749 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf43cc7-a5c6-4c7b-a5d2-919c2801d333 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:16.514226 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf43cc7-a5c6-4c7b-a5d2-919c2801d333 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:16.514345 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf43cc7-a5c6-4c7b-a5d2-919c2801d333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:16.544230 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-8cf43cc7-a5c6-4c7b-a5d2-919c2801d333 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:08:16.545436 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-8cf43cc7-a5c6-4c7b-a5d2-919c2801d333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:08:16.574194 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:16.630444 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 670/1345] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:08:16 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:08:16.669672 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953fcf21-9ac9-4fcc-96aa-2a61d0d012ac None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:16.681178 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953fcf21-9ac9-4fcc-96aa-2a61d0d012ac None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:16.684920 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0a8e5c-c964-41ed-8fe2-7ae4bd3d4312 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe93d4c0737249fd8623bb5ce188e34e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:16.685582 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0a8e5c-c964-41ed-8fe2-7ae4bd3d4312 service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:16.685910 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0a8e5c-c964-41ed-8fe2-7ae4bd3d4312 service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:16.686193 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0a8e5c-c964-41ed-8fe2-7ae4bd3d4312 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:16.696601 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0a8e5c-c964-41ed-8fe2-7ae4bd3d4312 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:16.698367 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0a8e5c-c964-41ed-8fe2-7ae4bd3d4312 service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:16.709008 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 676/1346] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:08:16 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:08:20.889810 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbeadbe-fec7-431e-9b02-e8f7cc2be510 None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:20.890289 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbeadbe-fec7-431e-9b02-e8f7cc2be510 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:20.890410 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbeadbe-fec7-431e-9b02-e8f7cc2be510 None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:20.891783 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 671/1347] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:08:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:08:20.897133 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310dde26-21e7-4e85-95a2-f73bb5b29207 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:20.897560 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310dde26-21e7-4e85-95a2-f73bb5b29207 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:20.897714 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310dde26-21e7-4e85-95a2-f73bb5b29207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:20.916780 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-310dde26-21e7-4e85-95a2-f73bb5b29207 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:08:20.918020 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-310dde26-21e7-4e85-95a2-f73bb5b29207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:08:20.926192 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 677/1348] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:08:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:08:20.964999 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbeadbe-fec7-431e-9b02-e8f7cc2be510 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:20.976005 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbeadbe-fec7-431e-9b02-e8f7cc2be510 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:20.979889 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca37a06-0b94-4f72-8678-108616ae0de5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe93d4c0737249fd8623bb5ce188e34e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:20.980548 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca37a06-0b94-4f72-8678-108616ae0de5 service neutron] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:20.980830 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca37a06-0b94-4f72-8678-108616ae0de5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:20.981136 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca37a06-0b94-4f72-8678-108616ae0de5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:20.990766 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca37a06-0b94-4f72-8678-108616ae0de5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:20.992332 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca37a06-0b94-4f72-8678-108616ae0de5 service neutron] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:21.003032 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 672/1349] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:08:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:08:26.177917 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fc3fd9-a0dc-436b-b65b-48d18edc24bf None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:26.178934 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fc3fd9-a0dc-436b-b65b-48d18edc24bf None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:26.179384 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fc3fd9-a0dc-436b-b65b-48d18edc24bf None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:26.181500 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 678/1350] 10.222.0.43 () {54 vars in 921 bytes} [Wed Jun 22 10:08:26 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:08:26.196531 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bec047b-a15c-4c72-bb86-30eb1a510db2 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:26.197411 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bec047b-a15c-4c72-bb86-30eb1a510db2 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:26.201973 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bec047b-a15c-4c72-bb86-30eb1a510db2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:26.298025 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-1bec047b-a15c-4c72-bb86-30eb1a510db2 None None] MFA Rules not processed for user `341ec95408c94dae8539ccff7225e3ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:08:26.299907 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-1bec047b-a15c-4c72-bb86-30eb1a510db2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:08:26.390406 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 673/1351] 10.222.0.43 () {58 vars in 1018 bytes} [Wed Jun 22 10:08:26 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:08:30.721372 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8aa923-5025-4d2c-9345-fd54068608c0 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:30.721921 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8aa923-5025-4d2c-9345-fd54068608c0 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:30.722039 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8aa923-5025-4d2c-9345-fd54068608c0 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:30.723558 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 679/1352] 10.222.0.43 () {54 vars in 921 bytes} [Wed Jun 22 10:08:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:08:30.729726 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bee2e58-4482-46f9-baad-4da3239aeb27 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:30.730578 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bee2e58-4482-46f9-baad-4da3239aeb27 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:30.731002 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bee2e58-4482-46f9-baad-4da3239aeb27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:30.752511 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-7bee2e58-4482-46f9-baad-4da3239aeb27 None None] MFA Rules not processed for user `341ec95408c94dae8539ccff7225e3ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:08:30.754132 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-7bee2e58-4482-46f9-baad-4da3239aeb27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:08:30.763574 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 674/1353] 10.222.0.43 () {58 vars in 1018 bytes} [Wed Jun 22 10:08:30 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:08:30.911334 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=13 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:32.210475 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e088f0-f4e8-4002-824a-187aaecc28c8 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:32.212344 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e088f0-f4e8-4002-824a-187aaecc28c8 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:32.212344 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e088f0-f4e8-4002-824a-187aaecc28c8 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:32.212976 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 680/1354] 10.222.0.43 () {54 vars in 921 bytes} [Wed Jun 22 10:08:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:08:32.218038 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de549b9-4078-48c3-9143-986c9df53996 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:32.218457 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de549b9-4078-48c3-9143-986c9df53996 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:32.218606 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de549b9-4078-48c3-9143-986c9df53996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:32.237039 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-7de549b9-4078-48c3-9143-986c9df53996 None None] MFA Rules not processed for user `341ec95408c94dae8539ccff7225e3ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:08:32.238256 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-7de549b9-4078-48c3-9143-986c9df53996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:08:32.247601 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 675/1355] 10.222.0.43 () {58 vars in 1018 bytes} [Wed Jun 22 10:08:32 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:08:36.016372 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebacc5ec-7c51-41d1-938f-4577bed29e3e None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:36.017062 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebacc5ec-7c51-41d1-938f-4577bed29e3e None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:36.017062 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebacc5ec-7c51-41d1-938f-4577bed29e3e None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:36.018380 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 681/1356] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:08:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:08:36.024307 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25e8a65-9a03-4045-bf39-ef27ec551f5d None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:36.024817 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25e8a65-9a03-4045-bf39-ef27ec551f5d None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:36.024912 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25e8a65-9a03-4045-bf39-ef27ec551f5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:36.043165 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-d25e8a65-9a03-4045-bf39-ef27ec551f5d None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:08:36.044337 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-d25e8a65-9a03-4045-bf39-ef27ec551f5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:08:36.052027 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 676/1357] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:08:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:08:36.113989 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a31861-901a-4cc8-9b49-6328bdb71a8a None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:36.114640 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a31861-901a-4cc8-9b49-6328bdb71a8a None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:36.115097 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a31861-901a-4cc8-9b49-6328bdb71a8a None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:36.117612 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 682/1358] 10.222.0.43 () {54 vars in 961 bytes} [Wed Jun 22 10:08:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:08:36.126959 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63579604-047d-4268-abea-53b9953c5eb9 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:36.127508 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63579604-047d-4268-abea-53b9953c5eb9 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:36.127952 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63579604-047d-4268-abea-53b9953c5eb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:36.174011 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:36.182845 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-63579604-047d-4268-abea-53b9953c5eb9 None None] MFA Rules not processed for user `158a49aa3750478a84bf71b9aad24397`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:08:36.184081 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-63579604-047d-4268-abea-53b9953c5eb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:08:36.271502 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 677/1359] 10.222.0.43 () {58 vars in 1058 bytes} [Wed Jun 22 10:08:36 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:08:36.280602 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a31861-901a-4cc8-9b49-6328bdb71a8a None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:36.295481 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a31861-901a-4cc8-9b49-6328bdb71a8a None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:36.302283 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9217b9b5-f229-452d-bc16-3296ecb373d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '158a49aa3750478a84bf71b9aad24397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:36.303299 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9217b9b5-f229-452d-bc16-3296ecb373d5 service nova] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:36.303942 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9217b9b5-f229-452d-bc16-3296ecb373d5 service nova] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:36.305148 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9217b9b5-f229-452d-bc16-3296ecb373d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:36.316721 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9217b9b5-f229-452d-bc16-3296ecb373d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:36.319041 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9217b9b5-f229-452d-bc16-3296ecb373d5 service nova] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:36.334139 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 683/1360] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:08:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:08:38.616087 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33724934-bd39-4fee-8e97-cbaf4a1f1667 None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:38.616634 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33724934-bd39-4fee-8e97-cbaf4a1f1667 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:38.616634 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33724934-bd39-4fee-8e97-cbaf4a1f1667 None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:38.618634 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 678/1361] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:08:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:08:38.623829 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750222b5-60b0-472d-ab1d-3b9401aa27d1 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:38.624264 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750222b5-60b0-472d-ab1d-3b9401aa27d1 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:38.624358 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750222b5-60b0-472d-ab1d-3b9401aa27d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:38.644178 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-750222b5-60b0-472d-ab1d-3b9401aa27d1 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:08:38.645512 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-750222b5-60b0-472d-ab1d-3b9401aa27d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:08:38.655927 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 684/1362] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:08:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:08:38.706327 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33724934-bd39-4fee-8e97-cbaf4a1f1667 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:38.722280 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33724934-bd39-4fee-8e97-cbaf4a1f1667 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:38.728952 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffc30b8-dbaf-4338-9478-b973e0841b19 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '158a49aa3750478a84bf71b9aad24397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:38.729841 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffc30b8-dbaf-4338-9478-b973e0841b19 service nova] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:38.730325 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffc30b8-dbaf-4338-9478-b973e0841b19 service nova] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:38.730796 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffc30b8-dbaf-4338-9478-b973e0841b19 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:38.739405 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffc30b8-dbaf-4338-9478-b973e0841b19 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:38.741224 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffc30b8-dbaf-4338-9478-b973e0841b19 service nova] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:38.751724 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 679/1363] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:08:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:08:41.145217 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa1f8ee-a6cb-43cf-8f9a-6c14147be57c None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:41.145824 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa1f8ee-a6cb-43cf-8f9a-6c14147be57c None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:41.145824 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa1f8ee-a6cb-43cf-8f9a-6c14147be57c None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:41.147197 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 685/1364] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:08:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:08:41.153031 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893ed798-6ab1-4402-801a-122567166b00 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:41.153440 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893ed798-6ab1-4402-801a-122567166b00 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:41.153601 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893ed798-6ab1-4402-801a-122567166b00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:41.172294 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-893ed798-6ab1-4402-801a-122567166b00 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:08:41.173504 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-893ed798-6ab1-4402-801a-122567166b00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:08:41.182406 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 680/1365] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:08:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:08:41.245000 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77346faa-bc5d-435d-badc-a4614d00e9e1 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:41.245000 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77346faa-bc5d-435d-badc-a4614d00e9e1 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:41.245000 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77346faa-bc5d-435d-badc-a4614d00e9e1 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:41.247194 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 686/1366] 10.222.0.43 () {54 vars in 961 bytes} [Wed Jun 22 10:08:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:08:41.251388 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edd9991-012d-4bce-bde3-32a581a964b3 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:41.251680 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edd9991-012d-4bce-bde3-32a581a964b3 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:41.251967 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edd9991-012d-4bce-bde3-32a581a964b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:41.271296 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-9edd9991-012d-4bce-bde3-32a581a964b3 None None] MFA Rules not processed for user `158a49aa3750478a84bf71b9aad24397`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:08:41.272531 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-9edd9991-012d-4bce-bde3-32a581a964b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:08:41.282037 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 681/1367] 10.222.0.43 () {58 vars in 1058 bytes} [Wed Jun 22 10:08:41 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:08:41.290708 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77346faa-bc5d-435d-badc-a4614d00e9e1 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:41.305512 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77346faa-bc5d-435d-badc-a4614d00e9e1 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:41.311928 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f524ae0e-4513-48d0-8a9e-7aee46f21676 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '158a49aa3750478a84bf71b9aad24397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:41.312578 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f524ae0e-4513-48d0-8a9e-7aee46f21676 service nova] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:41.312866 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f524ae0e-4513-48d0-8a9e-7aee46f21676 service nova] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:41.313149 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f524ae0e-4513-48d0-8a9e-7aee46f21676 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:41.323224 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f524ae0e-4513-48d0-8a9e-7aee46f21676 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:41.324752 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f524ae0e-4513-48d0-8a9e-7aee46f21676 service nova] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:41.334700 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 687/1368] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:08:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 10:08:43.453508 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5671ca-191b-4f72-8cd3-0f4f0677d86a None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:43.454129 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5671ca-191b-4f72-8cd3-0f4f0677d86a None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:43.454370 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5671ca-191b-4f72-8cd3-0f4f0677d86a None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:43.455962 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 682/1369] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:08:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:08:43.461419 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e1f1af-a17e-4fbf-b51a-d732496b69ec None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:43.461874 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e1f1af-a17e-4fbf-b51a-d732496b69ec None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:43.462189 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e1f1af-a17e-4fbf-b51a-d732496b69ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:43.483120 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-c5e1f1af-a17e-4fbf-b51a-d732496b69ec None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:08:43.484455 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-c5e1f1af-a17e-4fbf-b51a-d732496b69ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:08:43.493349 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 688/1370] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:08:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:08:43.536537 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5671ca-191b-4f72-8cd3-0f4f0677d86a None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:43.552445 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5671ca-191b-4f72-8cd3-0f4f0677d86a None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:43.558648 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac196941-3471-42e9-a26b-eb3e0fa0096e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '158a49aa3750478a84bf71b9aad24397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:43.559321 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac196941-3471-42e9-a26b-eb3e0fa0096e service nova] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:43.559605 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac196941-3471-42e9-a26b-eb3e0fa0096e service nova] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:43.559881 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac196941-3471-42e9-a26b-eb3e0fa0096e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:43.569567 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac196941-3471-42e9-a26b-eb3e0fa0096e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:43.572296 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac196941-3471-42e9-a26b-eb3e0fa0096e service nova] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:43.583310 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 683/1371] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:08:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:08:44.246627 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20669a69-cb3d-4ca0-8256-cbe9bd3522f0 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:44.246917 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20669a69-cb3d-4ca0-8256-cbe9bd3522f0 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:44.247368 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20669a69-cb3d-4ca0-8256-cbe9bd3522f0 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:44.248919 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 689/1372] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:08:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:08:44.254235 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269d0e87-b974-496c-be22-ba53b97088e5 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:44.254534 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269d0e87-b974-496c-be22-ba53b97088e5 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:44.254819 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269d0e87-b974-496c-be22-ba53b97088e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:44.274372 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-269d0e87-b974-496c-be22-ba53b97088e5 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:08:44.275576 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-269d0e87-b974-496c-be22-ba53b97088e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:08:44.283580 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 684/1373] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:08:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:08:44.626059 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9f2a8c-84d5-4312-bbbc-f9e88899b6fa None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:44.626059 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9f2a8c-84d5-4312-bbbc-f9e88899b6fa None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:44.626059 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9f2a8c-84d5-4312-bbbc-f9e88899b6fa None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:44.628836 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 690/1374] 10.222.0.43 () {54 vars in 963 bytes} [Wed Jun 22 10:08:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:08:44.633271 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f154a005-ba13-47b0-aed7-9980b96aec91 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:44.633847 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f154a005-ba13-47b0-aed7-9980b96aec91 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:44.634115 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f154a005-ba13-47b0-aed7-9980b96aec91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:44.684865 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-f154a005-ba13-47b0-aed7-9980b96aec91 None None] MFA Rules not processed for user `9bbcb3d4dc704dfdb0097abc594ca855`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:08:44.686099 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-f154a005-ba13-47b0-aed7-9980b96aec91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:08:44.750802 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 685/1375] 10.222.0.43 () {58 vars in 1060 bytes} [Wed Jun 22 10:08:44 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:08:44.759000 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9f2a8c-84d5-4312-bbbc-f9e88899b6fa None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:44.770223 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9f2a8c-84d5-4312-bbbc-f9e88899b6fa None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:44.773989 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3ae3af-8886-4522-9241-ea0d2846a5db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bbcb3d4dc704dfdb0097abc594ca855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:44.774762 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3ae3af-8886-4522-9241-ea0d2846a5db service cinder] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:44.775151 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3ae3af-8886-4522-9241-ea0d2846a5db service cinder] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:44.775531 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3ae3af-8886-4522-9241-ea0d2846a5db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:44.785153 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3ae3af-8886-4522-9241-ea0d2846a5db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:44.786871 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3ae3af-8886-4522-9241-ea0d2846a5db service cinder] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:44.799187 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 691/1376] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:08:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:08:45.675717 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec34a3e-2053-498f-9890-9b4a84bb894f None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:45.676304 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec34a3e-2053-498f-9890-9b4a84bb894f None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:45.676304 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec34a3e-2053-498f-9890-9b4a84bb894f None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:45.682130 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 686/1377] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:08:45 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:08:45.683422 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8894b7d0-3222-4c95-b77d-4bafb977d560 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:45.683810 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8894b7d0-3222-4c95-b77d-4bafb977d560 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:45.684107 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8894b7d0-3222-4c95-b77d-4bafb977d560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:45.707341 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-8894b7d0-3222-4c95-b77d-4bafb977d560 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:08:45.708695 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-8894b7d0-3222-4c95-b77d-4bafb977d560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:08:45.722180 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 692/1378] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:08:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:08:45.762808 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec34a3e-2053-498f-9890-9b4a84bb894f None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:45.777293 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec34a3e-2053-498f-9890-9b4a84bb894f None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:45.782825 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5963d4-5681-4bbb-9507-9e5872b6f70d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '158a49aa3750478a84bf71b9aad24397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:45.783532 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5963d4-5681-4bbb-9507-9e5872b6f70d service nova] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:45.784032 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5963d4-5681-4bbb-9507-9e5872b6f70d service nova] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:45.784369 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5963d4-5681-4bbb-9507-9e5872b6f70d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:45.794525 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5963d4-5681-4bbb-9507-9e5872b6f70d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:45.796329 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5963d4-5681-4bbb-9507-9e5872b6f70d service nova] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:45.800721 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:45.808720 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 687/1379] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:08:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:08:47.873921 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4712a2-250f-4a7a-ab71-71c1588fc037 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:47.874797 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4712a2-250f-4a7a-ab71-71c1588fc037 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:47.875225 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4712a2-250f-4a7a-ab71-71c1588fc037 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:47.877057 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 693/1380] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:08:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:08:47.883332 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c84de2-802a-4d21-b1ce-f1cef3ba57fd None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:47.884135 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c84de2-802a-4d21-b1ce-f1cef3ba57fd None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:47.884563 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c84de2-802a-4d21-b1ce-f1cef3ba57fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:47.902704 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-78c84de2-802a-4d21-b1ce-f1cef3ba57fd None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:08:47.903808 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-78c84de2-802a-4d21-b1ce-f1cef3ba57fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:08:47.911546 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 688/1381] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:08:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:08:47.958461 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4712a2-250f-4a7a-ab71-71c1588fc037 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:47.977511 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4712a2-250f-4a7a-ab71-71c1588fc037 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:47.982967 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f288c45-3014-44e0-b583-1927f139c6d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '158a49aa3750478a84bf71b9aad24397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:47.983604 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f288c45-3014-44e0-b583-1927f139c6d7 service nova] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:47.983892 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f288c45-3014-44e0-b583-1927f139c6d7 service nova] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:47.984172 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f288c45-3014-44e0-b583-1927f139c6d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:47.994024 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f288c45-3014-44e0-b583-1927f139c6d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:47.995633 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f288c45-3014-44e0-b583-1927f139c6d7 service nova] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:48.004974 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 694/1382] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:08:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:08:50.131139 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b48960-f5ad-4cf0-b32e-936e35c17795 None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:50.131650 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b48960-f5ad-4cf0-b32e-936e35c17795 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:50.132366 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b48960-f5ad-4cf0-b32e-936e35c17795 None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:50.133774 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 689/1383] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:08:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 10:08:50.139576 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecf9da0-2309-4b6e-9919-d69eb066478b None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:50.140041 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecf9da0-2309-4b6e-9919-d69eb066478b None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:50.140338 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecf9da0-2309-4b6e-9919-d69eb066478b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:50.160620 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-3ecf9da0-2309-4b6e-9919-d69eb066478b None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:08:50.161824 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-3ecf9da0-2309-4b6e-9919-d69eb066478b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:08:50.170568 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 695/1384] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:08:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:08:50.213127 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b48960-f5ad-4cf0-b32e-936e35c17795 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:50.228379 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b48960-f5ad-4cf0-b32e-936e35c17795 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:50.233981 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da3b70c-2d89-4aee-bc9c-22f655aca9b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '158a49aa3750478a84bf71b9aad24397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:50.234831 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da3b70c-2d89-4aee-bc9c-22f655aca9b1 service nova] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:50.235188 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da3b70c-2d89-4aee-bc9c-22f655aca9b1 service nova] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:50.235560 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da3b70c-2d89-4aee-bc9c-22f655aca9b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:50.245442 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da3b70c-2d89-4aee-bc9c-22f655aca9b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:50.247291 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da3b70c-2d89-4aee-bc9c-22f655aca9b1 service nova] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:50.258126 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 690/1385] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:08:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:08:52.345525 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363f0ea6-c51b-4b10-a5fc-ce626b2f9b67 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:52.346228 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363f0ea6-c51b-4b10-a5fc-ce626b2f9b67 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:52.346228 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363f0ea6-c51b-4b10-a5fc-ce626b2f9b67 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:52.353550 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990043d4-3258-4b54-9fa5-f98aa5f2642f None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:52.353550 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990043d4-3258-4b54-9fa5-f98aa5f2642f None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:52.354312 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990043d4-3258-4b54-9fa5-f98aa5f2642f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:52.355988 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 696/1386] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:08:52 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:08:52.372945 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-990043d4-3258-4b54-9fa5-f98aa5f2642f None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:08:52.374122 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-990043d4-3258-4b54-9fa5-f98aa5f2642f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:08:52.398503 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 691/1387] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:08:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:08:52.434357 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363f0ea6-c51b-4b10-a5fc-ce626b2f9b67 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:52.451158 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363f0ea6-c51b-4b10-a5fc-ce626b2f9b67 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:52.456924 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c96850b-41dd-4e4a-88d6-cf168fd90aa3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '158a49aa3750478a84bf71b9aad24397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:52.457565 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c96850b-41dd-4e4a-88d6-cf168fd90aa3 service nova] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:52.457876 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c96850b-41dd-4e4a-88d6-cf168fd90aa3 service nova] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:52.458155 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c96850b-41dd-4e4a-88d6-cf168fd90aa3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:52.468384 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c96850b-41dd-4e4a-88d6-cf168fd90aa3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:52.470038 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c96850b-41dd-4e4a-88d6-cf168fd90aa3 service nova] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:52.481542 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 697/1388] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:08:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:08:54.589681 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9842411-7894-41f3-b9b1-dc9a06178b57 None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:54.590242 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9842411-7894-41f3-b9b1-dc9a06178b57 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:54.590465 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9842411-7894-41f3-b9b1-dc9a06178b57 None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:54.592322 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 692/1389] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:08:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:08:54.597574 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a4b559-018a-4d95-a025-4cd04b1a5291 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:54.598106 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a4b559-018a-4d95-a025-4cd04b1a5291 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:54.598106 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a4b559-018a-4d95-a025-4cd04b1a5291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:54.616855 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-55a4b559-018a-4d95-a025-4cd04b1a5291 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:08:54.618088 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-55a4b559-018a-4d95-a025-4cd04b1a5291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:08:54.625992 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 698/1390] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:08:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:08:54.671596 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9842411-7894-41f3-b9b1-dc9a06178b57 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:54.686582 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9842411-7894-41f3-b9b1-dc9a06178b57 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:54.692075 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df7a9f1-d012-40fc-b3da-bf133beca091 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '158a49aa3750478a84bf71b9aad24397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:54.692718 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df7a9f1-d012-40fc-b3da-bf133beca091 service nova] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:54.693003 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df7a9f1-d012-40fc-b3da-bf133beca091 service nova] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:54.693283 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df7a9f1-d012-40fc-b3da-bf133beca091 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:54.701743 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df7a9f1-d012-40fc-b3da-bf133beca091 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:54.703376 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df7a9f1-d012-40fc-b3da-bf133beca091 service nova] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:54.714439 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 693/1391] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:08:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:08:56.802047 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1f5bea-95fd-4c58-9140-d2d58050c45e None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:56.802779 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1f5bea-95fd-4c58-9140-d2d58050c45e None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:56.802779 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1f5bea-95fd-4c58-9140-d2d58050c45e None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:56.804567 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 699/1392] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:08:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:08:56.809949 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d4bc9c-e381-48ae-a9d2-eb479e1919a5 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:56.810429 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d4bc9c-e381-48ae-a9d2-eb479e1919a5 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:56.810641 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d4bc9c-e381-48ae-a9d2-eb479e1919a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:56.832801 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-13d4bc9c-e381-48ae-a9d2-eb479e1919a5 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:08:56.834087 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-13d4bc9c-e381-48ae-a9d2-eb479e1919a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:08:56.843644 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 694/1393] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:08:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:08:56.896310 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1f5bea-95fd-4c58-9140-d2d58050c45e None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:56.911736 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1f5bea-95fd-4c58-9140-d2d58050c45e None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:56.917492 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3147fca9-8832-47a6-80cc-2b714789f140 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '158a49aa3750478a84bf71b9aad24397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:56.918166 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3147fca9-8832-47a6-80cc-2b714789f140 service nova] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:56.918454 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3147fca9-8832-47a6-80cc-2b714789f140 service nova] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:56.918733 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3147fca9-8832-47a6-80cc-2b714789f140 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:56.926992 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3147fca9-8832-47a6-80cc-2b714789f140 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:56.928583 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3147fca9-8832-47a6-80cc-2b714789f140 service nova] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:56.939947 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 700/1394] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:08:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:08:59.059407 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92b60a9-9aa3-47c4-811f-ff086871754c None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:59.059984 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92b60a9-9aa3-47c4-811f-ff086871754c None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:59.059984 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92b60a9-9aa3-47c4-811f-ff086871754c None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:59.061343 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 695/1395] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:08:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:08:59.066839 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d5ee37-1c3d-40ad-bf85-068da71a7940 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:59.067302 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d5ee37-1c3d-40ad-bf85-068da71a7940 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:59.067418 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d5ee37-1c3d-40ad-bf85-068da71a7940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:59.085587 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-51d5ee37-1c3d-40ad-bf85-068da71a7940 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:08:59.086807 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-51d5ee37-1c3d-40ad-bf85-068da71a7940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:08:59.094652 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 701/1396] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:08:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:08:59.140037 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92b60a9-9aa3-47c4-811f-ff086871754c None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:08:59.154858 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92b60a9-9aa3-47c4-811f-ff086871754c None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:08:59.160249 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9608e44-c9ed-44a7-b2a3-638a73541fb9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '158a49aa3750478a84bf71b9aad24397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:08:59.160884 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9608e44-c9ed-44a7-b2a3-638a73541fb9 service nova] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:08:59.161168 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9608e44-c9ed-44a7-b2a3-638a73541fb9 service nova] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:08:59.161447 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9608e44-c9ed-44a7-b2a3-638a73541fb9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:08:59.170054 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9608e44-c9ed-44a7-b2a3-638a73541fb9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:08:59.171637 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9608e44-c9ed-44a7-b2a3-638a73541fb9 service nova] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:08:59.181570 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 696/1397] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:08:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:09:00.424637 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bce822e-6f9b-40d3-83c3-fb5d15c0fcac None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:00.425200 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bce822e-6f9b-40d3-83c3-fb5d15c0fcac None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:00.425200 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bce822e-6f9b-40d3-83c3-fb5d15c0fcac None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:00.426757 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 702/1398] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:09:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:09:00.432563 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3374ecaa-8bac-46ee-bbb3-f9558fcd628a None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:00.432975 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3374ecaa-8bac-46ee-bbb3-f9558fcd628a None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:00.433118 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3374ecaa-8bac-46ee-bbb3-f9558fcd628a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:00.451542 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-3374ecaa-8bac-46ee-bbb3-f9558fcd628a None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:09:00.452716 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-3374ecaa-8bac-46ee-bbb3-f9558fcd628a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:09:00.460600 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 697/1399] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:09:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:09:00.518059 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c096c490-8c96-4171-aa38-e056187fae47 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:00.518424 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c096c490-8c96-4171-aa38-e056187fae47 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:00.518774 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c096c490-8c96-4171-aa38-e056187fae47 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:00.520213 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 703/1400] 10.222.0.43 () {54 vars in 962 bytes} [Wed Jun 22 10:09:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:09:00.526148 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71f0387-421b-400c-8500-c87b5845d5a1 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:00.526445 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71f0387-421b-400c-8500-c87b5845d5a1 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:00.526726 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71f0387-421b-400c-8500-c87b5845d5a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:00.580275 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-f71f0387-421b-400c-8500-c87b5845d5a1 None None] MFA Rules not processed for user `a2418acec46b4db48346129004827853`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:09:00.581478 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-f71f0387-421b-400c-8500-c87b5845d5a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:09:00.641382 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 698/1401] 10.222.0.43 () {58 vars in 1059 bytes} [Wed Jun 22 10:09:00 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:09:00.649762 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c096c490-8c96-4171-aa38-e056187fae47 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:09:00.660239 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c096c490-8c96-4171-aa38-e056187fae47 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:09:00.663813 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9582d266-4b9b-4c09-8cc1-74e60e3c57ab service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2418acec46b4db48346129004827853', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:09:00.664441 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9582d266-4b9b-4c09-8cc1-74e60e3c57ab service glance] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:00.664725 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9582d266-4b9b-4c09-8cc1-74e60e3c57ab service glance] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:00.665012 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9582d266-4b9b-4c09-8cc1-74e60e3c57ab service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:00.673990 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9582d266-4b9b-4c09-8cc1-74e60e3c57ab service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:09:00.675466 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9582d266-4b9b-4c09-8cc1-74e60e3c57ab service glance] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:09:00.685070 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 704/1402] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:09:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:09:01.293362 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30285420-f32b-4ce8-81c8-5a740e11deb5 None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:01.293582 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30285420-f32b-4ce8-81c8-5a740e11deb5 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:01.293876 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30285420-f32b-4ce8-81c8-5a740e11deb5 None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:01.295267 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 699/1403] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:09:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:09:01.301002 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866e7072-d8b7-4d4e-b36e-e86f94b18ad3 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:01.301321 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866e7072-d8b7-4d4e-b36e-e86f94b18ad3 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:01.301604 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866e7072-d8b7-4d4e-b36e-e86f94b18ad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:01.308685 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=61 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:09:01.322454 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-866e7072-d8b7-4d4e-b36e-e86f94b18ad3 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:09:01.323661 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-866e7072-d8b7-4d4e-b36e-e86f94b18ad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:09:01.331819 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 705/1404] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:09:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:09:01.376741 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30285420-f32b-4ce8-81c8-5a740e11deb5 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:09:01.394063 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30285420-f32b-4ce8-81c8-5a740e11deb5 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:09:01.400275 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5f1e9b-717e-4bf4-9aff-8e6a942c22cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '158a49aa3750478a84bf71b9aad24397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:09:01.400981 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5f1e9b-717e-4bf4-9aff-8e6a942c22cb service nova] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:01.401333 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5f1e9b-717e-4bf4-9aff-8e6a942c22cb service nova] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:01.401682 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5f1e9b-717e-4bf4-9aff-8e6a942c22cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:01.403358 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b65ad25-3459-4fe5-ae8e-75e005730367 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:01.403651 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b65ad25-3459-4fe5-ae8e-75e005730367 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:01.403936 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b65ad25-3459-4fe5-ae8e-75e005730367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:01.410379 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5f1e9b-717e-4bf4-9aff-8e6a942c22cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:09:01.411988 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5f1e9b-717e-4bf4-9aff-8e6a942c22cb service nova] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:09:01.422135 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 700/1405] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:09:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:09:01.454895 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-7b65ad25-3459-4fe5-ae8e-75e005730367 None None] MFA Rules not processed for user `317e7e7dd5c741d49d34a1fd949a7c07`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:09:01.456151 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-7b65ad25-3459-4fe5-ae8e-75e005730367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:09:01.529678 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 706/1406] 10.222.0.43 () {58 vars in 1009 bytes} [Wed Jun 22 10:09:01 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:09:01.577452 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa79ee5-7ad1-4e8a-99a5-0c9ab6318e31 None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:01.578040 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa79ee5-7ad1-4e8a-99a5-0c9ab6318e31 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:01.578306 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa79ee5-7ad1-4e8a-99a5-0c9ab6318e31 None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:01.579795 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 701/1407] 10.222.0.43 () {54 vars in 942 bytes} [Wed Jun 22 10:09:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:09:01.587981 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb146e3-3641-4c11-a286-a01bd961ee4c None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:01.588433 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb146e3-3641-4c11-a286-a01bd961ee4c None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:01.588719 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb146e3-3641-4c11-a286-a01bd961ee4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:01.641865 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-eeb146e3-3641-4c11-a286-a01bd961ee4c None None] MFA Rules not processed for user `9566f8cca2574f4cb5edcbf384f368a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:09:01.643054 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-eeb146e3-3641-4c11-a286-a01bd961ee4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:09:01.716303 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 707/1408] 10.222.0.43 () {58 vars in 1039 bytes} [Wed Jun 22 10:09:01 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:09:01.725812 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa79ee5-7ad1-4e8a-99a5-0c9ab6318e31 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:09:01.739088 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa79ee5-7ad1-4e8a-99a5-0c9ab6318e31 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:09:01.744634 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2a94b9-cf9d-4638-80d6-98f2dda9cf54 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9566f8cca2574f4cb5edcbf384f368a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:09:01.745264 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2a94b9-cf9d-4638-80d6-98f2dda9cf54 service swift] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:01.745551 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2a94b9-cf9d-4638-80d6-98f2dda9cf54 service swift] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:01.745865 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2a94b9-cf9d-4638-80d6-98f2dda9cf54 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:01.753828 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2a94b9-cf9d-4638-80d6-98f2dda9cf54 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:09:01.755420 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2a94b9-cf9d-4638-80d6-98f2dda9cf54 service swift] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:09:01.764228 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 702/1409] 10.222.0.43 () {60 vars in 1384 bytes} [Wed Jun 22 10:09:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 22 10:09:11.713427 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=86 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:09:11.761020 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=81 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:09:24.407333 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0abb6cb-e284-447a-98aa-73c1042e1787 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:24.407926 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0abb6cb-e284-447a-98aa-73c1042e1787 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:24.407926 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0abb6cb-e284-447a-98aa-73c1042e1787 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:24.409301 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 708/1410] 10.222.0.43 () {54 vars in 918 bytes} [Wed Jun 22 10:09:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:09:24.415038 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b07f3d-3b45-4b5a-bdaa-5ea14cb042a0 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:24.415495 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b07f3d-3b45-4b5a-bdaa-5ea14cb042a0 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:24.415608 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b07f3d-3b45-4b5a-bdaa-5ea14cb042a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:24.433365 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-52b07f3d-3b45-4b5a-bdaa-5ea14cb042a0 None None] MFA Rules not processed for user `341ec95408c94dae8539ccff7225e3ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:09:24.434572 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-52b07f3d-3b45-4b5a-bdaa-5ea14cb042a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:09:24.442820 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 703/1411] 10.222.0.43 () {58 vars in 1015 bytes} [Wed Jun 22 10:09:24 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:09:24.456576 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f09c82c-04bf-46b4-bcbb-35f610cab8ad None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:24.456863 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f09c82c-04bf-46b4-bcbb-35f610cab8ad None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:24.457143 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f09c82c-04bf-46b4-bcbb-35f610cab8ad None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:24.458518 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 709/1412] 10.222.0.43 () {54 vars in 918 bytes} [Wed Jun 22 10:09:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:09:24.463504 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156e351a-62ca-467d-9510-21674cd71a64 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:24.463806 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156e351a-62ca-467d-9510-21674cd71a64 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:24.464092 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156e351a-62ca-467d-9510-21674cd71a64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:24.483371 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-156e351a-62ca-467d-9510-21674cd71a64 None None] MFA Rules not processed for user `158a49aa3750478a84bf71b9aad24397`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:09:24.484562 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-156e351a-62ca-467d-9510-21674cd71a64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:09:24.493887 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 704/1413] 10.222.0.43 () {58 vars in 1015 bytes} [Wed Jun 22 10:09:24 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:09:26.978826 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ca40e2-eb99-4256-8626-0e5fd0785dd5 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:26.979388 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ca40e2-eb99-4256-8626-0e5fd0785dd5 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:26.979388 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ca40e2-eb99-4256-8626-0e5fd0785dd5 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:26.980818 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 710/1414] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 22 10:09:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:09:26.986272 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b33bd95-a098-46cd-806c-ba9ed37650a3 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:26.986711 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b33bd95-a098-46cd-806c-ba9ed37650a3 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:26.986821 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b33bd95-a098-46cd-806c-ba9ed37650a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:27.004208 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-9b33bd95-a098-46cd-806c-ba9ed37650a3 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:09:27.005390 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-9b33bd95-a098-46cd-806c-ba9ed37650a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:09:27.013714 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 705/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 22 10:09:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:09:27.057457 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ca40e2-eb99-4256-8626-0e5fd0785dd5 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:09:27.072993 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ca40e2-eb99-4256-8626-0e5fd0785dd5 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:09:27.078240 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0953a57-6ff1-4a3f-80fc-c48377426266 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '158a49aa3750478a84bf71b9aad24397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:09:27.078873 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0953a57-6ff1-4a3f-80fc-c48377426266 service nova] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:27.079162 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0953a57-6ff1-4a3f-80fc-c48377426266 service nova] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:27.079439 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0953a57-6ff1-4a3f-80fc-c48377426266 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:27.088613 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0953a57-6ff1-4a3f-80fc-c48377426266 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:09:27.090235 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0953a57-6ff1-4a3f-80fc-c48377426266 service nova] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:09:27.100975 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 711/1416] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:09:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:09:28.037154 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dbc1ee-2c2e-4538-8fe9-cafa9198d473 None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:28.037759 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dbc1ee-2c2e-4538-8fe9-cafa9198d473 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:28.037759 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dbc1ee-2c2e-4538-8fe9-cafa9198d473 None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:28.039775 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 706/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 22 10:09:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:09:28.045045 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57159ae-35b9-45aa-8601-3ba1717b6bff None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:28.045485 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57159ae-35b9-45aa-8601-3ba1717b6bff None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:28.045668 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57159ae-35b9-45aa-8601-3ba1717b6bff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:28.064816 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-b57159ae-35b9-45aa-8601-3ba1717b6bff None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:09:28.066121 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-b57159ae-35b9-45aa-8601-3ba1717b6bff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:09:28.074257 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 712/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 22 10:09:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:09:28.232998 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dbc1ee-2c2e-4538-8fe9-cafa9198d473 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:09:28.251747 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dbc1ee-2c2e-4538-8fe9-cafa9198d473 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:09:28.261539 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d265684-c630-483e-acb0-bc5122556892 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '158a49aa3750478a84bf71b9aad24397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:09:28.263230 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d265684-c630-483e-acb0-bc5122556892 service nova] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:28.263518 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d265684-c630-483e-acb0-bc5122556892 service nova] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:28.263803 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d265684-c630-483e-acb0-bc5122556892 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:28.273365 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d265684-c630-483e-acb0-bc5122556892 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:09:28.275060 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d265684-c630-483e-acb0-bc5122556892 service nova] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:09:28.286294 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 707/1419] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:09:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:09:29.196301 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c882ab-b7ed-4061-8397-19a8ca7a43f0 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:29.196833 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c882ab-b7ed-4061-8397-19a8ca7a43f0 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:29.196950 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c882ab-b7ed-4061-8397-19a8ca7a43f0 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:29.198344 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 713/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 22 10:09:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:09:29.203122 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed05a63b-b922-4527-a541-aef9ca80f870 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:29.203551 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed05a63b-b922-4527-a541-aef9ca80f870 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:29.203684 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed05a63b-b922-4527-a541-aef9ca80f870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:29.222231 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-ed05a63b-b922-4527-a541-aef9ca80f870 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:09:29.223461 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-ed05a63b-b922-4527-a541-aef9ca80f870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:09:29.232225 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 708/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 22 10:09:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:09:29.383706 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c882ab-b7ed-4061-8397-19a8ca7a43f0 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:09:29.398985 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c882ab-b7ed-4061-8397-19a8ca7a43f0 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:09:29.404336 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fd769d-8d45-459d-bb4d-c850845117de service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '158a49aa3750478a84bf71b9aad24397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:09:29.404972 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fd769d-8d45-459d-bb4d-c850845117de service nova] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:29.405255 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fd769d-8d45-459d-bb4d-c850845117de service nova] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:29.405604 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fd769d-8d45-459d-bb4d-c850845117de service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:29.413967 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fd769d-8d45-459d-bb4d-c850845117de service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:09:29.415552 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fd769d-8d45-459d-bb4d-c850845117de service nova] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:09:29.425131 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 714/1422] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:09:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:09:30.281337 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4a7642-1c2e-4fff-b5b6-928f69d3601c None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:30.281939 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4a7642-1c2e-4fff-b5b6-928f69d3601c None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:30.281939 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4a7642-1c2e-4fff-b5b6-928f69d3601c None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:30.283286 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 709/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 22 10:09:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 10:09:30.288507 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9af2e5b-ad7a-4509-b62f-36e328bab6d9 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:30.288934 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9af2e5b-ad7a-4509-b62f-36e328bab6d9 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:30.289076 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9af2e5b-ad7a-4509-b62f-36e328bab6d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:30.307188 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-d9af2e5b-ad7a-4509-b62f-36e328bab6d9 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:09:30.308387 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-d9af2e5b-ad7a-4509-b62f-36e328bab6d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:09:30.316166 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 715/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 22 10:09:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:09:30.467741 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4a7642-1c2e-4fff-b5b6-928f69d3601c None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:09:30.482620 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4a7642-1c2e-4fff-b5b6-928f69d3601c None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:09:30.487935 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d941ce0d-a24d-4a2d-a235-e6aa106adf7b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '158a49aa3750478a84bf71b9aad24397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:09:30.488728 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d941ce0d-a24d-4a2d-a235-e6aa106adf7b service nova] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:30.489011 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d941ce0d-a24d-4a2d-a235-e6aa106adf7b service nova] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:30.489289 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d941ce0d-a24d-4a2d-a235-e6aa106adf7b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:30.498340 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d941ce0d-a24d-4a2d-a235-e6aa106adf7b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:09:30.499918 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d941ce0d-a24d-4a2d-a235-e6aa106adf7b service nova] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:09:30.510285 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 710/1425] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:09:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:09:31.377633 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ec0e73-c35b-498e-a711-ffcc12d17c3c None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:31.378196 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ec0e73-c35b-498e-a711-ffcc12d17c3c None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:31.378196 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ec0e73-c35b-498e-a711-ffcc12d17c3c None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:31.379546 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 716/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 22 10:09:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:09:31.385226 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb745aa-2f84-43a3-952b-83c42935e502 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:31.385634 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb745aa-2f84-43a3-952b-83c42935e502 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:31.385833 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb745aa-2f84-43a3-952b-83c42935e502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:31.404135 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-3bb745aa-2f84-43a3-952b-83c42935e502 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:09:31.405320 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-3bb745aa-2f84-43a3-952b-83c42935e502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:09:31.414106 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 711/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 22 10:09:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:09:31.563637 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ec0e73-c35b-498e-a711-ffcc12d17c3c None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:09:31.578496 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ec0e73-c35b-498e-a711-ffcc12d17c3c None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:09:31.583783 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1b641d-70e1-4178-8695-4d2133a8a550 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '158a49aa3750478a84bf71b9aad24397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:09:31.584657 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1b641d-70e1-4178-8695-4d2133a8a550 service nova] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:31.584997 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1b641d-70e1-4178-8695-4d2133a8a550 service nova] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:31.585278 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1b641d-70e1-4178-8695-4d2133a8a550 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:31.596167 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1b641d-70e1-4178-8695-4d2133a8a550 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:09:31.598639 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1b641d-70e1-4178-8695-4d2133a8a550 service nova] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:09:31.612996 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 717/1428] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:09:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:09:32.424630 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a8cab3-ad1e-454c-9b29-54ff78fb9b22 None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:32.425158 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a8cab3-ad1e-454c-9b29-54ff78fb9b22 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:32.425158 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a8cab3-ad1e-454c-9b29-54ff78fb9b22 None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:32.426576 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 712/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 22 10:09:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:09:32.432139 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5703aa85-04b7-4f16-b6ab-44cda6253455 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:32.432585 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5703aa85-04b7-4f16-b6ab-44cda6253455 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:32.432708 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5703aa85-04b7-4f16-b6ab-44cda6253455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:32.451474 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-5703aa85-04b7-4f16-b6ab-44cda6253455 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:09:32.452663 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-5703aa85-04b7-4f16-b6ab-44cda6253455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:09:32.460840 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 718/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 22 10:09:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:09:32.610174 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a8cab3-ad1e-454c-9b29-54ff78fb9b22 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:09:32.624327 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a8cab3-ad1e-454c-9b29-54ff78fb9b22 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:09:32.629562 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f49f0d2-a58a-428d-94fb-7a91cd6044e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '158a49aa3750478a84bf71b9aad24397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:09:32.630220 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f49f0d2-a58a-428d-94fb-7a91cd6044e9 service nova] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:32.630500 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f49f0d2-a58a-428d-94fb-7a91cd6044e9 service nova] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:32.630776 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f49f0d2-a58a-428d-94fb-7a91cd6044e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:32.638676 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f49f0d2-a58a-428d-94fb-7a91cd6044e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:09:32.640256 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f49f0d2-a58a-428d-94fb-7a91cd6044e9 service nova] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:09:32.650143 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 713/1431] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:09:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:09:33.450755 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7051c571-39ca-446a-b40b-fcf22ae1c867 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:33.451309 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7051c571-39ca-446a-b40b-fcf22ae1c867 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:33.451309 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7051c571-39ca-446a-b40b-fcf22ae1c867 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:33.452694 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 719/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 22 10:09:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:09:33.457556 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42448746-6ef2-4024-89c5-d1fc99b6cbd1 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:33.458019 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42448746-6ef2-4024-89c5-d1fc99b6cbd1 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:33.458220 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42448746-6ef2-4024-89c5-d1fc99b6cbd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:33.477108 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-42448746-6ef2-4024-89c5-d1fc99b6cbd1 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:09:33.478329 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-42448746-6ef2-4024-89c5-d1fc99b6cbd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:09:33.486322 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 714/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 22 10:09:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:09:33.636739 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7051c571-39ca-446a-b40b-fcf22ae1c867 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:09:33.651456 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7051c571-39ca-446a-b40b-fcf22ae1c867 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:09:33.656886 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ed1a82-81f6-44be-99ae-ae825eb134fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '158a49aa3750478a84bf71b9aad24397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:09:33.657518 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ed1a82-81f6-44be-99ae-ae825eb134fe service nova] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:33.657838 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ed1a82-81f6-44be-99ae-ae825eb134fe service nova] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:33.658115 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ed1a82-81f6-44be-99ae-ae825eb134fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:33.666578 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ed1a82-81f6-44be-99ae-ae825eb134fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:09:33.668151 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ed1a82-81f6-44be-99ae-ae825eb134fe service nova] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:09:33.677480 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 720/1434] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:09:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:09:34.498482 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032f4304-c6a4-40bb-bd3d-44974d0afeb6 None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:34.499050 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032f4304-c6a4-40bb-bd3d-44974d0afeb6 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:34.499050 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032f4304-c6a4-40bb-bd3d-44974d0afeb6 None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:34.500427 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 715/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 22 10:09:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:09:34.505416 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3874763c-db67-46f8-bc02-dbb4bfc12056 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:34.505854 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3874763c-db67-46f8-bc02-dbb4bfc12056 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:34.506002 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3874763c-db67-46f8-bc02-dbb4bfc12056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:34.523837 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-3874763c-db67-46f8-bc02-dbb4bfc12056 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:09:34.525022 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-3874763c-db67-46f8-bc02-dbb4bfc12056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:09:34.532751 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 721/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 22 10:09:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:09:34.682084 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032f4304-c6a4-40bb-bd3d-44974d0afeb6 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:09:34.697251 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032f4304-c6a4-40bb-bd3d-44974d0afeb6 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:09:34.703403 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03019ac7-3220-493a-8e57-d062fbcae319 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '158a49aa3750478a84bf71b9aad24397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:09:34.704274 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03019ac7-3220-493a-8e57-d062fbcae319 service nova] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:34.704639 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03019ac7-3220-493a-8e57-d062fbcae319 service nova] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:34.704921 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03019ac7-3220-493a-8e57-d062fbcae319 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:34.714288 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03019ac7-3220-493a-8e57-d062fbcae319 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:09:34.715880 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03019ac7-3220-493a-8e57-d062fbcae319 service nova] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:09:34.730440 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 716/1437] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:09:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:09:35.544121 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23336dd3-d720-45e8-833b-6f125acd3015 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:35.544615 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23336dd3-d720-45e8-833b-6f125acd3015 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:35.544727 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23336dd3-d720-45e8-833b-6f125acd3015 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:35.546111 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 722/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 22 10:09:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:09:35.550887 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57fe156-ec17-4644-a57f-41ab2277b1ad None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:35.551296 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57fe156-ec17-4644-a57f-41ab2277b1ad None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:35.551437 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57fe156-ec17-4644-a57f-41ab2277b1ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:35.570379 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-b57fe156-ec17-4644-a57f-41ab2277b1ad None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:09:35.571556 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-b57fe156-ec17-4644-a57f-41ab2277b1ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:09:35.579311 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 717/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 22 10:09:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:09:35.727218 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23336dd3-d720-45e8-833b-6f125acd3015 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:09:35.741453 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23336dd3-d720-45e8-833b-6f125acd3015 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:09:35.746814 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756923d8-c5dd-4935-918b-56c2eb64b457 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '158a49aa3750478a84bf71b9aad24397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:09:35.747450 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756923d8-c5dd-4935-918b-56c2eb64b457 service nova] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:35.747731 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756923d8-c5dd-4935-918b-56c2eb64b457 service nova] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:35.748008 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756923d8-c5dd-4935-918b-56c2eb64b457 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:35.756353 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756923d8-c5dd-4935-918b-56c2eb64b457 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:09:35.757970 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756923d8-c5dd-4935-918b-56c2eb64b457 service nova] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:09:35.767225 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 723/1440] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:09:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:09:37.742934 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8979333-cf1e-49ec-b845-b0587b44b124 None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:37.743509 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8979333-cf1e-49ec-b845-b0587b44b124 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:37.743509 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8979333-cf1e-49ec-b845-b0587b44b124 None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:37.745026 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 718/1441] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 22 10:09:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:09:37.750292 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2b6691-e2e9-4185-b351-cad0183f83d7 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:37.750704 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2b6691-e2e9-4185-b351-cad0183f83d7 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:37.750849 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2b6691-e2e9-4185-b351-cad0183f83d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:37.769289 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-6d2b6691-e2e9-4185-b351-cad0183f83d7 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:09:37.770431 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-6d2b6691-e2e9-4185-b351-cad0183f83d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:09:37.780410 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 724/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 22 10:09:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:09:37.818212 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8979333-cf1e-49ec-b845-b0587b44b124 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:09:37.820599 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-c8979333-cf1e-49ec-b845-b0587b44b124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:09:37.833396 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8979333-cf1e-49ec-b845-b0587b44b124 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:09:37.837199 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0644c40-7b1a-4fa2-be90-00163cbad17b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe93d4c0737249fd8623bb5ce188e34e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:09:37.837872 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0644c40-7b1a-4fa2-be90-00163cbad17b service neutron] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:37.838158 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0644c40-7b1a-4fa2-be90-00163cbad17b service neutron] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:37.838438 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0644c40-7b1a-4fa2-be90-00163cbad17b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:37.847319 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0644c40-7b1a-4fa2-be90-00163cbad17b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:09:37.848740 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0644c40-7b1a-4fa2-be90-00163cbad17b service neutron] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:09:37.858468 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 719/1443] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:09:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:09:40.038612 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b6462c-37f1-4b23-966f-732891123a79 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:40.039199 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b6462c-37f1-4b23-966f-732891123a79 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:40.039199 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b6462c-37f1-4b23-966f-732891123a79 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:40.040739 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 725/1444] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 22 10:09:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:09:40.046214 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438056e2-15df-468b-a50e-21b67b92b4d1 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:40.046648 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438056e2-15df-468b-a50e-21b67b92b4d1 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:40.046768 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438056e2-15df-468b-a50e-21b67b92b4d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:40.064214 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-438056e2-15df-468b-a50e-21b67b92b4d1 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:09:40.065402 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-438056e2-15df-468b-a50e-21b67b92b4d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:09:40.073260 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 720/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 22 10:09:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:09:40.114831 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b6462c-37f1-4b23-966f-732891123a79 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:09:40.126280 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b6462c-37f1-4b23-966f-732891123a79 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:09:40.129912 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7476ca7d-3d24-418c-b6c6-ec51bea43998 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe93d4c0737249fd8623bb5ce188e34e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:09:40.130549 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7476ca7d-3d24-418c-b6c6-ec51bea43998 service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:40.130832 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7476ca7d-3d24-418c-b6c6-ec51bea43998 service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:40.131395 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7476ca7d-3d24-418c-b6c6-ec51bea43998 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:40.140277 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7476ca7d-3d24-418c-b6c6-ec51bea43998 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:09:40.141707 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7476ca7d-3d24-418c-b6c6-ec51bea43998 service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:09:40.151562 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 726/1446] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:09:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:09:42.534935 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc936e4e-fbff-415f-9c80-cafabe7465f1 None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:42.535542 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc936e4e-fbff-415f-9c80-cafabe7465f1 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:42.535542 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc936e4e-fbff-415f-9c80-cafabe7465f1 None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:42.536864 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 721/1447] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 22 10:09:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:09:42.542195 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cdbcbb-753b-428e-a9b1-48edeb79095d None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:42.542616 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cdbcbb-753b-428e-a9b1-48edeb79095d None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:42.542752 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cdbcbb-753b-428e-a9b1-48edeb79095d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:42.560652 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-c1cdbcbb-753b-428e-a9b1-48edeb79095d None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:09:42.561872 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-c1cdbcbb-753b-428e-a9b1-48edeb79095d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:09:42.570249 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 727/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 22 10:09:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:09:42.607955 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc936e4e-fbff-415f-9c80-cafabe7465f1 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:09:42.619228 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc936e4e-fbff-415f-9c80-cafabe7465f1 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:09:42.622725 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4670bb8f-d2df-45f5-9280-653ebbb45aac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe93d4c0737249fd8623bb5ce188e34e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:09:42.623365 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4670bb8f-d2df-45f5-9280-653ebbb45aac service neutron] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:42.623651 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4670bb8f-d2df-45f5-9280-653ebbb45aac service neutron] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:42.623932 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4670bb8f-d2df-45f5-9280-653ebbb45aac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:42.633992 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4670bb8f-d2df-45f5-9280-653ebbb45aac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:09:42.635438 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4670bb8f-d2df-45f5-9280-653ebbb45aac service neutron] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:09:42.644765 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 722/1449] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:09:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:09:44.805435 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6525a14-ce77-481a-a26a-39645ec57fb6 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:44.806015 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6525a14-ce77-481a-a26a-39645ec57fb6 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:44.806015 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6525a14-ce77-481a-a26a-39645ec57fb6 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:44.807381 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 728/1450] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 22 10:09:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 10:09:44.812505 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cfad78-2ed1-4a1f-9c2b-d69750e4463c None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:44.812953 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cfad78-2ed1-4a1f-9c2b-d69750e4463c None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:44.813076 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cfad78-2ed1-4a1f-9c2b-d69750e4463c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:44.835604 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-30cfad78-2ed1-4a1f-9c2b-d69750e4463c None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:09:44.837163 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-30cfad78-2ed1-4a1f-9c2b-d69750e4463c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:09:44.845528 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 723/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 22 10:09:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:09:44.884266 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6525a14-ce77-481a-a26a-39645ec57fb6 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:09:44.894991 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6525a14-ce77-481a-a26a-39645ec57fb6 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:09:44.899075 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64923bca-93c0-40a8-8993-9c673f839643 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe93d4c0737249fd8623bb5ce188e34e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:09:44.899713 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64923bca-93c0-40a8-8993-9c673f839643 service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:44.899998 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64923bca-93c0-40a8-8993-9c673f839643 service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:44.900275 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64923bca-93c0-40a8-8993-9c673f839643 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:44.909080 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64923bca-93c0-40a8-8993-9c673f839643 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:09:44.910531 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64923bca-93c0-40a8-8993-9c673f839643 service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:09:44.920853 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 729/1452] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:09:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:09:46.989608 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0b9b91-92ee-4587-8d53-7ae9899c4abc None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:46.990229 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0b9b91-92ee-4587-8d53-7ae9899c4abc None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:46.990229 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0b9b91-92ee-4587-8d53-7ae9899c4abc None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:46.991572 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 724/1453] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 22 10:09:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:09:46.996713 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf53e80-aa9a-4a95-9c71-5ba76544a1bb None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:46.997126 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf53e80-aa9a-4a95-9c71-5ba76544a1bb None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:46.997283 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf53e80-aa9a-4a95-9c71-5ba76544a1bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:47.014778 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-fcf53e80-aa9a-4a95-9c71-5ba76544a1bb None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:09:47.015972 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-fcf53e80-aa9a-4a95-9c71-5ba76544a1bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:09:47.024433 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 730/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 22 10:09:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:09:47.063438 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0b9b91-92ee-4587-8d53-7ae9899c4abc None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:09:47.074516 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0b9b91-92ee-4587-8d53-7ae9899c4abc None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:09:47.078014 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8aa3756-f0fb-4927-a47d-97e671815c54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe93d4c0737249fd8623bb5ce188e34e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:09:47.078650 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aa3756-f0fb-4927-a47d-97e671815c54 service neutron] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:47.078938 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aa3756-f0fb-4927-a47d-97e671815c54 service neutron] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:47.079222 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aa3756-f0fb-4927-a47d-97e671815c54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:47.090411 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8aa3756-f0fb-4927-a47d-97e671815c54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:09:47.091975 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8aa3756-f0fb-4927-a47d-97e671815c54 service neutron] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:09:47.102973 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 725/1455] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:09:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:09:49.217496 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b28a1ea-d728-496b-b694-68c6ea8b41a4 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:49.218080 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b28a1ea-d728-496b-b694-68c6ea8b41a4 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:49.218080 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b28a1ea-d728-496b-b694-68c6ea8b41a4 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:49.219460 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 731/1456] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 22 10:09:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:09:49.224949 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64819e71-fb2e-4785-a9d1-d42c7b88e96c None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:49.225381 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64819e71-fb2e-4785-a9d1-d42c7b88e96c None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:49.225515 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64819e71-fb2e-4785-a9d1-d42c7b88e96c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:49.244080 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-64819e71-fb2e-4785-a9d1-d42c7b88e96c None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:09:49.245331 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-64819e71-fb2e-4785-a9d1-d42c7b88e96c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:09:49.253147 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 726/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 22 10:09:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:09:49.291248 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b28a1ea-d728-496b-b694-68c6ea8b41a4 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:09:49.301745 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b28a1ea-d728-496b-b694-68c6ea8b41a4 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:09:49.305820 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1d6e5e-c54d-4f99-924d-cbee306cb580 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe93d4c0737249fd8623bb5ce188e34e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:09:49.306463 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1d6e5e-c54d-4f99-924d-cbee306cb580 service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:49.306748 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1d6e5e-c54d-4f99-924d-cbee306cb580 service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:49.307028 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1d6e5e-c54d-4f99-924d-cbee306cb580 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:49.316156 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1d6e5e-c54d-4f99-924d-cbee306cb580 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:09:49.317568 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1d6e5e-c54d-4f99-924d-cbee306cb580 service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:09:49.327635 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 732/1458] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:09:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:09:51.447607 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f2ed25-3720-4926-af66-8d4d37368de9 None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:51.448176 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f2ed25-3720-4926-af66-8d4d37368de9 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:51.448176 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f2ed25-3720-4926-af66-8d4d37368de9 None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:51.449528 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 727/1459] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 22 10:09:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:09:51.454635 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2fa46a-2a71-4f3d-8491-ba1ff19837c3 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:51.455066 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2fa46a-2a71-4f3d-8491-ba1ff19837c3 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:51.455180 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2fa46a-2a71-4f3d-8491-ba1ff19837c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:51.472888 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-cc2fa46a-2a71-4f3d-8491-ba1ff19837c3 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:09:51.474132 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-cc2fa46a-2a71-4f3d-8491-ba1ff19837c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:09:51.482686 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 733/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 22 10:09:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:09:51.518726 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f2ed25-3720-4926-af66-8d4d37368de9 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:09:51.530081 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f2ed25-3720-4926-af66-8d4d37368de9 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:09:51.533545 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899d1a60-4065-4672-a242-9e4ce8e18c55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe93d4c0737249fd8623bb5ce188e34e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:09:51.534208 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899d1a60-4065-4672-a242-9e4ce8e18c55 service neutron] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:51.534494 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899d1a60-4065-4672-a242-9e4ce8e18c55 service neutron] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:51.534774 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899d1a60-4065-4672-a242-9e4ce8e18c55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:51.544224 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899d1a60-4065-4672-a242-9e4ce8e18c55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:09:51.545663 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899d1a60-4065-4672-a242-9e4ce8e18c55 service neutron] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:09:51.555175 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 728/1461] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:09:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:09:53.672687 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd69d930-4a03-421e-8219-d147d45521f4 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:53.673241 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd69d930-4a03-421e-8219-d147d45521f4 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:53.673241 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd69d930-4a03-421e-8219-d147d45521f4 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:53.674655 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 734/1462] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 22 10:09:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:09:53.680719 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6def603b-3e9d-4039-a580-beb02117d008 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:53.681129 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6def603b-3e9d-4039-a580-beb02117d008 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:53.681358 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6def603b-3e9d-4039-a580-beb02117d008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:53.687378 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=79 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:09:53.701211 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-6def603b-3e9d-4039-a580-beb02117d008 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:09:53.702435 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-6def603b-3e9d-4039-a580-beb02117d008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:09:53.710596 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 729/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 22 10:09:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:09:53.749918 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd69d930-4a03-421e-8219-d147d45521f4 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:09:53.755199 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=73 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:09:53.762586 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd69d930-4a03-421e-8219-d147d45521f4 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:09:53.766061 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57167c06-bf04-4098-9de8-1ddcd2bf962c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe93d4c0737249fd8623bb5ce188e34e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:09:53.766712 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57167c06-bf04-4098-9de8-1ddcd2bf962c service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:53.766978 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57167c06-bf04-4098-9de8-1ddcd2bf962c service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:53.767252 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57167c06-bf04-4098-9de8-1ddcd2bf962c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:53.776779 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57167c06-bf04-4098-9de8-1ddcd2bf962c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:09:53.778190 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57167c06-bf04-4098-9de8-1ddcd2bf962c service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:09:53.787732 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 735/1464] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:09:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:09:55.843075 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984cc88f-11b6-48e2-8431-3f7ed05d51ef None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:55.843624 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984cc88f-11b6-48e2-8431-3f7ed05d51ef None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:55.843624 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984cc88f-11b6-48e2-8431-3f7ed05d51ef None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:55.844952 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 730/1465] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 22 10:09:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:09:55.851163 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8ef0ca-607d-4858-ae2e-76ced0cc6f4f None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:55.851609 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8ef0ca-607d-4858-ae2e-76ced0cc6f4f None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:55.851708 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8ef0ca-607d-4858-ae2e-76ced0cc6f4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:55.869471 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-ad8ef0ca-607d-4858-ae2e-76ced0cc6f4f None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:09:55.870713 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-ad8ef0ca-607d-4858-ae2e-76ced0cc6f4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:09:55.878693 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 736/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 22 10:09:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:09:55.916788 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984cc88f-11b6-48e2-8431-3f7ed05d51ef None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:09:55.927511 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984cc88f-11b6-48e2-8431-3f7ed05d51ef None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:09:55.931577 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c80934-7c21-4186-aaf3-824fbe705d79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe93d4c0737249fd8623bb5ce188e34e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:09:55.932205 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c80934-7c21-4186-aaf3-824fbe705d79 service neutron] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:55.932490 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c80934-7c21-4186-aaf3-824fbe705d79 service neutron] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:55.932771 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c80934-7c21-4186-aaf3-824fbe705d79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:55.941539 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c80934-7c21-4186-aaf3-824fbe705d79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:09:55.943009 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c80934-7c21-4186-aaf3-824fbe705d79 service neutron] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:09:55.952908 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 731/1467] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:09:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:09:58.000702 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf21b5c-9396-49d5-90a3-d84e1a7b61bb None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:58.001240 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf21b5c-9396-49d5-90a3-d84e1a7b61bb None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:58.001367 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf21b5c-9396-49d5-90a3-d84e1a7b61bb None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:58.002707 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 737/1468] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 22 10:09:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:09:58.007941 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bc505a-5aad-4d95-8146-d6600d05ad89 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:58.008391 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bc505a-5aad-4d95-8146-d6600d05ad89 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:58.008495 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bc505a-5aad-4d95-8146-d6600d05ad89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:58.026684 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-a5bc505a-5aad-4d95-8146-d6600d05ad89 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:09:58.027893 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-a5bc505a-5aad-4d95-8146-d6600d05ad89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:09:58.035705 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 732/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 22 10:09:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:09:58.071727 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf21b5c-9396-49d5-90a3-d84e1a7b61bb None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:09:58.082202 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf21b5c-9396-49d5-90a3-d84e1a7b61bb None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:09:58.087254 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9996aad3-927f-439b-93b7-68485feb59ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe93d4c0737249fd8623bb5ce188e34e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:09:58.087901 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9996aad3-927f-439b-93b7-68485feb59ea service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:09:58.088184 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9996aad3-927f-439b-93b7-68485feb59ea service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:09:58.088462 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9996aad3-927f-439b-93b7-68485feb59ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:09:58.097869 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9996aad3-927f-439b-93b7-68485feb59ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:09:58.099319 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9996aad3-927f-439b-93b7-68485feb59ea service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:09:58.109821 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 738/1470] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:09:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:10:08.021004 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=11 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:10:08.105635 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=14 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:10:17.998671 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22cbe17-fc74-455e-8037-d9a8478a7f5a None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:10:17.999274 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22cbe17-fc74-455e-8037-d9a8478a7f5a None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:10:17.999274 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22cbe17-fc74-455e-8037-d9a8478a7f5a None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:10:18.000652 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 733/1471] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:10:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:10:18.006288 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fa2e8d-8a80-418d-b6fb-bb4f602283c5 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:10:18.006751 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fa2e8d-8a80-418d-b6fb-bb4f602283c5 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:10:18.006924 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fa2e8d-8a80-418d-b6fb-bb4f602283c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:10:18.028999 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-34fa2e8d-8a80-418d-b6fb-bb4f602283c5 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:10:18.030220 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-34fa2e8d-8a80-418d-b6fb-bb4f602283c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:10:18.039364 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 739/1472] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:10:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:10:18.090761 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2c0e3a-1088-45e6-9279-a246e6829700 None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:10:18.091058 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2c0e3a-1088-45e6-9279-a246e6829700 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:10:18.091344 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2c0e3a-1088-45e6-9279-a246e6829700 None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:10:18.092747 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 734/1473] 10.222.0.43 () {54 vars in 962 bytes} [Wed Jun 22 10:10:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:10:18.097530 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9ae427-e699-4a06-a96f-c8329b7e7b9f None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:10:18.097857 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9ae427-e699-4a06-a96f-c8329b7e7b9f None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:10:18.098141 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9ae427-e699-4a06-a96f-c8329b7e7b9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:10:18.116891 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-df9ae427-e699-4a06-a96f-c8329b7e7b9f None None] MFA Rules not processed for user `a2418acec46b4db48346129004827853`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:10:18.118119 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-df9ae427-e699-4a06-a96f-c8329b7e7b9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:10:18.124540 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 740/1474] 10.222.0.43 () {58 vars in 1059 bytes} [Wed Jun 22 10:10:18 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:10:18.132275 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2c0e3a-1088-45e6-9279-a246e6829700 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:10:18.142823 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2c0e3a-1088-45e6-9279-a246e6829700 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:10:18.146771 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d8e7ae-0e5d-4ac7-8ac7-8e5145a01e7c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2418acec46b4db48346129004827853', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:10:18.147562 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d8e7ae-0e5d-4ac7-8ac7-8e5145a01e7c service glance] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:10:18.147857 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d8e7ae-0e5d-4ac7-8ac7-8e5145a01e7c service glance] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:10:18.148138 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d8e7ae-0e5d-4ac7-8ac7-8e5145a01e7c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:10:18.157150 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d8e7ae-0e5d-4ac7-8ac7-8e5145a01e7c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:10:18.158654 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d8e7ae-0e5d-4ac7-8ac7-8e5145a01e7c service glance] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:10:18.169420 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 735/1475] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:10:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:10:20.285397 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6c84ac-92ba-436d-bf69-a3936a71e435 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:10:20.285962 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6c84ac-92ba-436d-bf69-a3936a71e435 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:10:20.285962 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6c84ac-92ba-436d-bf69-a3936a71e435 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:10:20.287826 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 741/1476] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:10:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:10:20.293079 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bddce0-1992-4322-84b0-111acad7acd6 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:10:20.293494 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bddce0-1992-4322-84b0-111acad7acd6 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:10:20.293652 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bddce0-1992-4322-84b0-111acad7acd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:10:20.311353 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-55bddce0-1992-4322-84b0-111acad7acd6 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:10:20.312550 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-55bddce0-1992-4322-84b0-111acad7acd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:10:20.320385 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 736/1477] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:10:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:10:20.345437 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6c84ac-92ba-436d-bf69-a3936a71e435 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:10:20.358745 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6c84ac-92ba-436d-bf69-a3936a71e435 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:10:20.363126 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91952b7-25e2-43ae-b63b-3d20b158c12f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:10:20.363767 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91952b7-25e2-43ae-b63b-3d20b158c12f admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:10:20.364050 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91952b7-25e2-43ae-b63b-3d20b158c12f admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:10:20.364328 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91952b7-25e2-43ae-b63b-3d20b158c12f admin admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:10:20.365056 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91952b7-25e2-43ae-b63b-3d20b158c12f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:10:20.367010 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: WARNING py.warnings [None req-b91952b7-25e2-43ae-b63b-3d20b158c12f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 22 10:10:20.367010 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: warnings.warn(msg) Jun 22 10:10:20.367010 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: Jun 22 10:10:20.368155 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91952b7-25e2-43ae-b63b-3d20b158c12f admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:10:20.387109 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 742/1478] 10.222.0.43 () {56 vars in 1108 bytes} [Wed Jun 22 10:10:20 2022] GET /identity/v3/projects => generated 2553 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:10:22.468050 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed768b97-aed6-4c05-a8d3-5df019432299 None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:10:22.468619 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed768b97-aed6-4c05-a8d3-5df019432299 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:10:22.468619 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed768b97-aed6-4c05-a8d3-5df019432299 None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:10:22.470021 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 737/1479] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:10:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:10:22.475235 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6dff30-9ee2-4e39-a464-26857ac5df05 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:10:22.475835 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6dff30-9ee2-4e39-a464-26857ac5df05 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:10:22.475961 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6dff30-9ee2-4e39-a464-26857ac5df05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:10:22.494217 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-8c6dff30-9ee2-4e39-a464-26857ac5df05 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:10:22.495435 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-8c6dff30-9ee2-4e39-a464-26857ac5df05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:10:22.503284 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 743/1480] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:10:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:10:22.546897 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed768b97-aed6-4c05-a8d3-5df019432299 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:10:22.564688 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed768b97-aed6-4c05-a8d3-5df019432299 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:10:22.570910 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b392a2d6-8899-4289-aa58-4ca7ee2bb799 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '158a49aa3750478a84bf71b9aad24397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:10:22.571554 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b392a2d6-8899-4289-aa58-4ca7ee2bb799 service nova] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:10:22.571843 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b392a2d6-8899-4289-aa58-4ca7ee2bb799 service nova] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:10:22.572125 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b392a2d6-8899-4289-aa58-4ca7ee2bb799 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:10:22.580438 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b392a2d6-8899-4289-aa58-4ca7ee2bb799 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:10:22.582079 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b392a2d6-8899-4289-aa58-4ca7ee2bb799 service nova] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:10:22.591760 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 738/1481] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:10:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:10:24.838711 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b479e2e8-187e-4c63-a13a-06d8517b5551 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:10:24.839361 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b479e2e8-187e-4c63-a13a-06d8517b5551 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:10:24.839361 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b479e2e8-187e-4c63-a13a-06d8517b5551 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:10:24.840653 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 744/1482] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:10:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:10:24.845923 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745fec66-ace3-43d9-88fd-23acd2b9546e None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:10:24.846394 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745fec66-ace3-43d9-88fd-23acd2b9546e None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:10:24.846516 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745fec66-ace3-43d9-88fd-23acd2b9546e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:10:24.865218 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-745fec66-ace3-43d9-88fd-23acd2b9546e None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:10:24.866493 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-745fec66-ace3-43d9-88fd-23acd2b9546e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:10:24.874129 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 739/1483] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:10:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:10:24.910163 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b479e2e8-187e-4c63-a13a-06d8517b5551 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:10:24.921274 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b479e2e8-187e-4c63-a13a-06d8517b5551 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:10:24.924746 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09480c67-2d56-4e25-98e7-cf29369bdf55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe93d4c0737249fd8623bb5ce188e34e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:10:24.925383 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09480c67-2d56-4e25-98e7-cf29369bdf55 service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:10:24.925666 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09480c67-2d56-4e25-98e7-cf29369bdf55 service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:10:24.925972 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09480c67-2d56-4e25-98e7-cf29369bdf55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:10:24.934790 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09480c67-2d56-4e25-98e7-cf29369bdf55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:10:24.936209 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09480c67-2d56-4e25-98e7-cf29369bdf55 service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:10:24.945664 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 745/1484] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:10:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:10:27.027276 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d36508-9bfd-48ca-9971-989fe4b32eea None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:10:27.027878 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d36508-9bfd-48ca-9971-989fe4b32eea None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:10:27.027878 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d36508-9bfd-48ca-9971-989fe4b32eea None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:10:27.029239 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 740/1485] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:10:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:10:27.034294 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184df517-f858-496b-abd2-c1e7bc423b97 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:10:27.034684 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184df517-f858-496b-abd2-c1e7bc423b97 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:10:27.034857 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184df517-f858-496b-abd2-c1e7bc423b97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:10:27.055703 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-184df517-f858-496b-abd2-c1e7bc423b97 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:10:27.056902 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-184df517-f858-496b-abd2-c1e7bc423b97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:10:27.065097 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 746/1486] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:10:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:10:27.103313 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d36508-9bfd-48ca-9971-989fe4b32eea None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:10:27.113928 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d36508-9bfd-48ca-9971-989fe4b32eea None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:10:27.117790 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5247867c-cfb1-4159-a3ce-7c9b81caf865 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe93d4c0737249fd8623bb5ce188e34e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:10:27.118420 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5247867c-cfb1-4159-a3ce-7c9b81caf865 service neutron] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:10:27.118698 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5247867c-cfb1-4159-a3ce-7c9b81caf865 service neutron] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:10:27.118971 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5247867c-cfb1-4159-a3ce-7c9b81caf865 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:10:27.127630 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5247867c-cfb1-4159-a3ce-7c9b81caf865 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:10:27.129049 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5247867c-cfb1-4159-a3ce-7c9b81caf865 service neutron] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:10:27.138710 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 741/1487] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:10:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:10:29.349376 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c189862a-77ab-4eb7-aa72-f6c0391d5543 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:10:29.349971 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c189862a-77ab-4eb7-aa72-f6c0391d5543 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:10:29.349971 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c189862a-77ab-4eb7-aa72-f6c0391d5543 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:10:29.352441 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 747/1488] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:10:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:10:29.358296 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d29925-16fe-4b80-b4ad-9abb1d3e34c4 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:10:29.358887 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d29925-16fe-4b80-b4ad-9abb1d3e34c4 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:10:29.358887 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d29925-16fe-4b80-b4ad-9abb1d3e34c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:10:29.380247 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-b4d29925-16fe-4b80-b4ad-9abb1d3e34c4 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:10:29.382125 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-b4d29925-16fe-4b80-b4ad-9abb1d3e34c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:10:29.391963 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 742/1489] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:10:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:10:29.438860 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c189862a-77ab-4eb7-aa72-f6c0391d5543 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:10:29.456646 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c189862a-77ab-4eb7-aa72-f6c0391d5543 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:10:29.460885 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5753107b-0394-4738-9629-c6681855cb11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe93d4c0737249fd8623bb5ce188e34e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:10:29.461538 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5753107b-0394-4738-9629-c6681855cb11 service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:10:29.461862 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5753107b-0394-4738-9629-c6681855cb11 service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:10:29.462145 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5753107b-0394-4738-9629-c6681855cb11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:10:29.472975 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5753107b-0394-4738-9629-c6681855cb11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:10:29.474449 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5753107b-0394-4738-9629-c6681855cb11 service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:10:29.488549 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 748/1490] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:10:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 10:10:31.804230 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2440f39-9a48-45bb-8fe6-4fd5477a0740 None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:10:31.804773 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2440f39-9a48-45bb-8fe6-4fd5477a0740 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:10:31.804773 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2440f39-9a48-45bb-8fe6-4fd5477a0740 None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:10:31.806242 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 743/1491] 10.222.0.43 () {54 vars in 926 bytes} [Wed Jun 22 10:10:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:10:31.811547 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfa560b-888a-4490-91b7-1625128ce884 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:10:31.811977 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfa560b-888a-4490-91b7-1625128ce884 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:10:31.812134 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfa560b-888a-4490-91b7-1625128ce884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:10:31.831066 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-abfa560b-888a-4490-91b7-1625128ce884 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:10:31.832254 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-abfa560b-888a-4490-91b7-1625128ce884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:10:31.840224 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 749/1492] 10.222.0.43 () {58 vars in 1023 bytes} [Wed Jun 22 10:10:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:10:31.880566 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2440f39-9a48-45bb-8fe6-4fd5477a0740 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:10:31.891802 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2440f39-9a48-45bb-8fe6-4fd5477a0740 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:10:31.895381 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c361fa43-a49e-4c16-b753-f2f326159373 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe93d4c0737249fd8623bb5ce188e34e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:10:31.896019 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c361fa43-a49e-4c16-b753-f2f326159373 service neutron] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:10:31.896337 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c361fa43-a49e-4c16-b753-f2f326159373 service neutron] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:10:31.896619 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c361fa43-a49e-4c16-b753-f2f326159373 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:10:31.905785 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c361fa43-a49e-4c16-b753-f2f326159373 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:10:31.907250 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c361fa43-a49e-4c16-b753-f2f326159373 service neutron] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:10:31.917116 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 744/1493] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:10:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:10:41.825208 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=33 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:10:41.912570 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=33 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:11:58.712258 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbe9a75-f88a-4a46-a148-fe974e6e0e64 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:11:58.712865 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbe9a75-f88a-4a46-a148-fe974e6e0e64 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:11:58.712966 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbe9a75-f88a-4a46-a148-fe974e6e0e64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:11:58.732833 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-ffbe9a75-f88a-4a46-a148-fe974e6e0e64 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:11:58.734061 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-ffbe9a75-f88a-4a46-a148-fe974e6e0e64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:11:58.742424 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 750/1494] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:11:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:11:58.751889 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa01f373-c6a2-4760-aae7-bfafe48a7703 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:11:58.752370 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa01f373-c6a2-4760-aae7-bfafe48a7703 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:11:58.752476 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa01f373-c6a2-4760-aae7-bfafe48a7703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:11:58.771946 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-aa01f373-c6a2-4760-aae7-bfafe48a7703 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:11:58.773129 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-aa01f373-c6a2-4760-aae7-bfafe48a7703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:11:58.780830 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 745/1495] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:11:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:11:58.785387 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbe9a75-f88a-4a46-a148-fe974e6e0e64 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:11:58.795030 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbe9a75-f88a-4a46-a148-fe974e6e0e64 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:11:58.799506 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2136b3a9-4ab2-46d9-a472-5d71ee6ddf9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:11:58.800156 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2136b3a9-4ab2-46d9-a472-5d71ee6ddf9c admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:11:58.800439 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2136b3a9-4ab2-46d9-a472-5d71ee6ddf9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:11:58.800718 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2136b3a9-4ab2-46d9-a472-5d71ee6ddf9c admin admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:11:58.801679 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2136b3a9-4ab2-46d9-a472-5d71ee6ddf9c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:11:58.802138 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2136b3a9-4ab2-46d9-a472-5d71ee6ddf9c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:11:58.803155 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: WARNING py.warnings [None req-2136b3a9-4ab2-46d9-a472-5d71ee6ddf9c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 22 10:11:58.803155 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: warnings.warn(msg) Jun 22 10:11:58.803155 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: Jun 22 10:11:58.804043 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2136b3a9-4ab2-46d9-a472-5d71ee6ddf9c admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:11:58.815404 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 751/1496] 10.222.0.43 () {58 vars in 1152 bytes} [Wed Jun 22 10:11:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:11:58.823952 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa01f373-c6a2-4760-aae7-bfafe48a7703 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:11:58.833959 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa01f373-c6a2-4760-aae7-bfafe48a7703 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:11:58.838683 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67e9467-bb8f-4f79-8e4c-a00b6cd51a2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:11:58.839364 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67e9467-bb8f-4f79-8e4c-a00b6cd51a2f admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:11:58.839655 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67e9467-bb8f-4f79-8e4c-a00b6cd51a2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:11:58.839932 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67e9467-bb8f-4f79-8e4c-a00b6cd51a2f admin admin] PATH_INFO: `/v3/projects` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:11:58.840627 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67e9467-bb8f-4f79-8e4c-a00b6cd51a2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:11:58.842486 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: WARNING py.warnings [None req-a67e9467-bb8f-4f79-8e4c-a00b6cd51a2f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 22 10:11:58.842486 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: warnings.warn(msg) Jun 22 10:11:58.842486 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: Jun 22 10:11:58.843691 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67e9467-bb8f-4f79-8e4c-a00b6cd51a2f admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:11:58.881232 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 746/1497] 10.222.0.43 () {60 vars in 1152 bytes} [Wed Jun 22 10:11:58 2022] POST /identity/v3/projects => generated 379 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:11:58.885900 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2136b3a9-4ab2-46d9-a472-5d71ee6ddf9c admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:11:58.896820 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2136b3a9-4ab2-46d9-a472-5d71ee6ddf9c admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:11:58.951632 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e814827a-daad-4775-935d-7b1c8b9b8570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:11:58.952304 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e814827a-daad-4775-935d-7b1c8b9b8570 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:11:58.952597 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e814827a-daad-4775-935d-7b1c8b9b8570 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:11:58.952866 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e814827a-daad-4775-935d-7b1c8b9b8570 admin admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:11:58.953577 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e814827a-daad-4775-935d-7b1c8b9b8570 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:11:58.954602 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: WARNING py.warnings [None req-e814827a-daad-4775-935d-7b1c8b9b8570 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 22 10:11:58.954602 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: warnings.warn(msg) Jun 22 10:11:58.954602 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: Jun 22 10:11:58.955843 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e814827a-daad-4775-935d-7b1c8b9b8570 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:11:58.976125 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 752/1498] 10.222.0.43 () {60 vars in 1143 bytes} [Wed Jun 22 10:11:58 2022] POST /identity/v3/users => generated 290 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:11:58.980586 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67e9467-bb8f-4f79-8e4c-a00b6cd51a2f admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:11:58.990710 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67e9467-bb8f-4f79-8e4c-a00b6cd51a2f admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:11:58.995207 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978f648d-fdba-47f4-af4a-2d1752dec51a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:11:58.995856 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978f648d-fdba-47f4-af4a-2d1752dec51a admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:11:58.996138 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978f648d-fdba-47f4-af4a-2d1752dec51a admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:11:58.996413 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978f648d-fdba-47f4-af4a-2d1752dec51a admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:11:58.997128 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978f648d-fdba-47f4-af4a-2d1752dec51a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:11:58.998168 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: WARNING py.warnings [None req-978f648d-fdba-47f4-af4a-2d1752dec51a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 22 10:11:58.998168 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: warnings.warn(msg) Jun 22 10:11:58.998168 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: Jun 22 10:11:58.999035 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978f648d-fdba-47f4-af4a-2d1752dec51a admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:11:59.013472 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 747/1499] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:11:58 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:11:59.017607 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e814827a-daad-4775-935d-7b1c8b9b8570 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:11:59.028238 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e814827a-daad-4775-935d-7b1c8b9b8570 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:11:59.032691 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b4eb08-d353-471a-b62f-bad9973f4c09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:11:59.033344 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b4eb08-d353-471a-b62f-bad9973f4c09 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:11:59.033627 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b4eb08-d353-471a-b62f-bad9973f4c09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:11:59.033935 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b4eb08-d353-471a-b62f-bad9973f4c09 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:11:59.034657 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b4eb08-d353-471a-b62f-bad9973f4c09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:11:59.035662 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: WARNING py.warnings [None req-27b4eb08-d353-471a-b62f-bad9973f4c09 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 22 10:11:59.035662 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: warnings.warn(msg) Jun 22 10:11:59.035662 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: Jun 22 10:11:59.036582 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b4eb08-d353-471a-b62f-bad9973f4c09 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:11:59.049800 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 753/1500] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:11:59 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:11:59.054014 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978f648d-fdba-47f4-af4a-2d1752dec51a admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:11:59.063852 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978f648d-fdba-47f4-af4a-2d1752dec51a admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:11:59.069322 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ae847e-4426-48c4-97a7-1098192e4674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:11:59.070227 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ae847e-4426-48c4-97a7-1098192e4674 admin admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:11:59.070511 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ae847e-4426-48c4-97a7-1098192e4674 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:11:59.070787 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ae847e-4426-48c4-97a7-1098192e4674 admin admin] PATH_INFO: `/v3/projects/cdb8d2eb05fc46b4b9886a7420dcc0ad/users/883f22540aff45e8bebb4f1264a3b631/roles/9f88c83743f745a9a785a2f454753f06` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:11:59.086580 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ae847e-4426-48c4-97a7-1098192e4674 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdb8d2eb05fc46b4b9886a7420dcc0ad, user_id=883f22540aff45e8bebb4f1264a3b631, role_id=9f88c83743f745a9a785a2f454753f06)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:11:59.087691 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: WARNING py.warnings [None req-22ae847e-4426-48c4-97a7-1098192e4674 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 22 10:11:59.087691 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: warnings.warn(msg) Jun 22 10:11:59.087691 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: Jun 22 10:11:59.089637 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ae847e-4426-48c4-97a7-1098192e4674 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:11:59.103797 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 748/1501] 10.222.0.43 () {60 vars in 1482 bytes} [Wed Jun 22 10:11:59 2022] PUT /identity/v3/projects/cdb8d2eb05fc46b4b9886a7420dcc0ad/users/883f22540aff45e8bebb4f1264a3b631/roles/9f88c83743f745a9a785a2f454753f06 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:11:59.115337 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2278596b-4ca3-4991-841f-1201b5599be9 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:11:59.115629 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2278596b-4ca3-4991-841f-1201b5599be9 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:11:59.115903 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2278596b-4ca3-4991-841f-1201b5599be9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:11:59.141796 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-2278596b-4ca3-4991-841f-1201b5599be9 None None] MFA Rules not processed for user `883f22540aff45e8bebb4f1264a3b631`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:11:59.142989 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-2278596b-4ca3-4991-841f-1201b5599be9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:11:59.206004 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 754/1502] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:11:59 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:11:59.219503 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcd9d99-19a4-4fd2-bd48-1abc9c194b8d None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:11:59.219795 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcd9d99-19a4-4fd2-bd48-1abc9c194b8d None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:11:59.220073 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcd9d99-19a4-4fd2-bd48-1abc9c194b8d None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:11:59.221435 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 749/1503] 10.222.0.43 () {54 vars in 963 bytes} [Wed Jun 22 10:11:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:11:59.226484 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c69cc71-8a20-41dc-b3fe-08c90663216b None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:11:59.226723 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c69cc71-8a20-41dc-b3fe-08c90663216b None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:11:59.227004 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c69cc71-8a20-41dc-b3fe-08c90663216b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:11:59.245708 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-1c69cc71-8a20-41dc-b3fe-08c90663216b None None] MFA Rules not processed for user `9bbcb3d4dc704dfdb0097abc594ca855`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:11:59.246916 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-1c69cc71-8a20-41dc-b3fe-08c90663216b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:11:59.289309 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:11:59.297422 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 755/1504] 10.222.0.43 () {58 vars in 1060 bytes} [Wed Jun 22 10:11:59 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:11:59.305558 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcd9d99-19a4-4fd2-bd48-1abc9c194b8d None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:11:59.316111 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcd9d99-19a4-4fd2-bd48-1abc9c194b8d None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:11:59.320613 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963b123d-96ea-4335-9ea0-e3444111a5fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bbcb3d4dc704dfdb0097abc594ca855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:11:59.321239 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963b123d-96ea-4335-9ea0-e3444111a5fe service cinder] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:11:59.321525 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963b123d-96ea-4335-9ea0-e3444111a5fe service cinder] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:11:59.321910 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963b123d-96ea-4335-9ea0-e3444111a5fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:11:59.330022 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963b123d-96ea-4335-9ea0-e3444111a5fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:11:59.331461 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963b123d-96ea-4335-9ea0-e3444111a5fe service cinder] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:11:59.340555 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 750/1505] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:11:59 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:11:59.383775 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fd5024-c1fa-4089-96f7-28b3d53ca46d None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:11:59.384066 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fd5024-c1fa-4089-96f7-28b3d53ca46d None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:11:59.384348 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fd5024-c1fa-4089-96f7-28b3d53ca46d None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:11:59.385639 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 756/1506] 10.222.0.43 () {52 vars in 829 bytes} [Wed Jun 22 10:11:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:11:59.389241 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963b123d-96ea-4335-9ea0-e3444111a5fe service cinder] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:11:59.454048 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963b123d-96ea-4335-9ea0-e3444111a5fe service cinder] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:11:59.458485 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762c7395-d8cb-4336-848f-aee058de8934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:11:59.459346 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762c7395-d8cb-4336-848f-aee058de8934 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:11:59.459632 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762c7395-d8cb-4336-848f-aee058de8934 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:11:59.459911 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762c7395-d8cb-4336-848f-aee058de8934 admin admin] PATH_INFO: `/v3/users/883f22540aff45e8bebb4f1264a3b631` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:11:59.461077 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762c7395-d8cb-4336-848f-aee058de8934 admin admin] RBAC: Authorizing `identity:delete_user(user_id=883f22540aff45e8bebb4f1264a3b631)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:11:59.462156 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: WARNING py.warnings [None req-762c7395-d8cb-4336-848f-aee058de8934 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 22 10:11:59.462156 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: warnings.warn(msg) Jun 22 10:11:59.462156 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: Jun 22 10:11:59.463350 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762c7395-d8cb-4336-848f-aee058de8934 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:11:59.527662 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-762c7395-d8cb-4336-848f-aee058de8934 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '883f22540aff45e8bebb4f1264a3b631'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:11:59.546845 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-762c7395-d8cb-4336-848f-aee058de8934 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '883f22540aff45e8bebb4f1264a3b631'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:11:59.557041 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-762c7395-d8cb-4336-848f-aee058de8934 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '883f22540aff45e8bebb4f1264a3b631'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:11:59.566185 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:11:59.572053 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-762c7395-d8cb-4336-848f-aee058de8934 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '883f22540aff45e8bebb4f1264a3b631'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:11:59.572969 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-762c7395-d8cb-4336-848f-aee058de8934 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '883f22540aff45e8bebb4f1264a3b631'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:11:59.579905 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 751/1507] 10.222.0.43 () {58 vars in 1223 bytes} [Wed Jun 22 10:11:59 2022] DELETE /identity/v3/users/883f22540aff45e8bebb4f1264a3b631 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:11:59.584954 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d504b392-b390-4c99-8fde-30ade13c2b28 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:11:59.585242 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d504b392-b390-4c99-8fde-30ade13c2b28 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:11:59.585517 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d504b392-b390-4c99-8fde-30ade13c2b28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:11:59.602325 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-d504b392-b390-4c99-8fde-30ade13c2b28 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:11:59.603772 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-d504b392-b390-4c99-8fde-30ade13c2b28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:11:59.663799 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 757/1508] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:11:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:11:59.673250 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762c7395-d8cb-4336-848f-aee058de8934 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:11:59.674742 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-762c7395-d8cb-4336-848f-aee058de8934 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:11:59.735402 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762c7395-d8cb-4336-848f-aee058de8934 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:11:59.739854 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e376931-9a16-4a9a-8f38-43c7adfa8305 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe93d4c0737249fd8623bb5ce188e34e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:11:59.740779 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e376931-9a16-4a9a-8f38-43c7adfa8305 service neutron] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:11:59.741070 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e376931-9a16-4a9a-8f38-43c7adfa8305 service neutron] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:11:59.741355 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e376931-9a16-4a9a-8f38-43c7adfa8305 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:11:59.750821 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e376931-9a16-4a9a-8f38-43c7adfa8305 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:11:59.752271 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e376931-9a16-4a9a-8f38-43c7adfa8305 service neutron] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:11:59.762757 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 752/1509] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:11:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:12:00.123795 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d504b392-b390-4c99-8fde-30ade13c2b28 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:12:00.125883 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-d504b392-b390-4c99-8fde-30ade13c2b28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:12:00.138674 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d504b392-b390-4c99-8fde-30ade13c2b28 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:12:00.143230 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a5aca7-1570-477b-994d-2bccc432f11d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:12:00.144107 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a5aca7-1570-477b-994d-2bccc432f11d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:12:00.144393 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a5aca7-1570-477b-994d-2bccc432f11d admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:12:00.144673 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a5aca7-1570-477b-994d-2bccc432f11d admin admin] PATH_INFO: `/v3/projects/cdb8d2eb05fc46b4b9886a7420dcc0ad` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:12:00.146028 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a5aca7-1570-477b-994d-2bccc432f11d admin admin] RBAC: Authorizing `identity:delete_project(project_id=cdb8d2eb05fc46b4b9886a7420dcc0ad)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:12:00.147069 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: WARNING py.warnings [None req-04a5aca7-1570-477b-994d-2bccc432f11d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 22 10:12:00.147069 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: warnings.warn(msg) Jun 22 10:12:00.147069 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: Jun 22 10:12:00.148297 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a5aca7-1570-477b-994d-2bccc432f11d admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:12:00.210836 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-04a5aca7-1570-477b-994d-2bccc432f11d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cdb8d2eb05fc46b4b9886a7420dcc0ad', 'request_id': 'req-04a5aca7-1570-477b-994d-2bccc432f11d'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:12:00.216852 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-04a5aca7-1570-477b-994d-2bccc432f11d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cdb8d2eb05fc46b4b9886a7420dcc0ad', 'request_id': 'req-04a5aca7-1570-477b-994d-2bccc432f11d'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:12:00.230491 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-04a5aca7-1570-477b-994d-2bccc432f11d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cdb8d2eb05fc46b4b9886a7420dcc0ad', 'request_id': 'req-04a5aca7-1570-477b-994d-2bccc432f11d'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:12:00.257708 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-04a5aca7-1570-477b-994d-2bccc432f11d admin admin] The token cache is being invalidate because project cdb8d2eb05fc46b4b9886a7420dcc0ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:12:00.258005 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-04a5aca7-1570-477b-994d-2bccc432f11d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:12:00.258769 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-04a5aca7-1570-477b-994d-2bccc432f11d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:12:00.260306 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 758/1510] 10.222.0.43 () {58 vars in 1232 bytes} [Wed Jun 22 10:12:00 2022] DELETE /identity/v3/projects/cdb8d2eb05fc46b4b9886a7420dcc0ad => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:12:09.758590 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=29 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:12:10.252847 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:13:40.525318 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d799ab5-66bf-43de-9513-3583ee515e52 None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:13:40.525957 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d799ab5-66bf-43de-9513-3583ee515e52 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:13:40.525957 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d799ab5-66bf-43de-9513-3583ee515e52 None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:13:40.527273 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 753/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 22 10:13:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:13:40.532285 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82efca1-b8e7-4af6-8dab-400faf1fb94e None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:13:40.532704 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82efca1-b8e7-4af6-8dab-400faf1fb94e None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:13:40.532852 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82efca1-b8e7-4af6-8dab-400faf1fb94e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:13:40.550891 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-b82efca1-b8e7-4af6-8dab-400faf1fb94e None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:13:40.552124 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-b82efca1-b8e7-4af6-8dab-400faf1fb94e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:13:40.612092 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 759/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 22 10:13:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:13:40.772789 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d799ab5-66bf-43de-9513-3583ee515e52 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:13:40.774503 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-3d799ab5-66bf-43de-9513-3583ee515e52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:13:40.865468 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d799ab5-66bf-43de-9513-3583ee515e52 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:13:40.872065 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7084df0-d264-49cc-8b51-fbe8eca1d2d0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '158a49aa3750478a84bf71b9aad24397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:13:40.872724 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7084df0-d264-49cc-8b51-fbe8eca1d2d0 service nova] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:13:40.873004 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7084df0-d264-49cc-8b51-fbe8eca1d2d0 service nova] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:13:40.873276 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7084df0-d264-49cc-8b51-fbe8eca1d2d0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:13:40.882457 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7084df0-d264-49cc-8b51-fbe8eca1d2d0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:13:40.884106 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7084df0-d264-49cc-8b51-fbe8eca1d2d0 service nova] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:13:40.893437 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 754/1513] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:13:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:13:41.741493 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64ba6e3-e058-43c5-a67a-bc1fba595f2e None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:13:41.742079 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64ba6e3-e058-43c5-a67a-bc1fba595f2e None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:13:41.742191 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64ba6e3-e058-43c5-a67a-bc1fba595f2e None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:13:41.743558 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 760/1514] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 22 10:13:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:13:41.748301 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a598fa-be91-4731-ba5e-65d95b92d88e None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:13:41.748700 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a598fa-be91-4731-ba5e-65d95b92d88e None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:13:41.748864 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a598fa-be91-4731-ba5e-65d95b92d88e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:13:41.766978 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-27a598fa-be91-4731-ba5e-65d95b92d88e None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:13:41.768213 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-27a598fa-be91-4731-ba5e-65d95b92d88e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:13:41.776924 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 755/1515] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 22 10:13:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:13:41.931271 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64ba6e3-e058-43c5-a67a-bc1fba595f2e None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:13:41.946398 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64ba6e3-e058-43c5-a67a-bc1fba595f2e None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:13:41.951794 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc369e11-154b-452b-82b8-9d6f6a08cf72 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '158a49aa3750478a84bf71b9aad24397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:13:41.952463 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc369e11-154b-452b-82b8-9d6f6a08cf72 service nova] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:13:41.952748 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc369e11-154b-452b-82b8-9d6f6a08cf72 service nova] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:13:41.953025 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc369e11-154b-452b-82b8-9d6f6a08cf72 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:13:41.961533 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc369e11-154b-452b-82b8-9d6f6a08cf72 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:13:41.963157 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc369e11-154b-452b-82b8-9d6f6a08cf72 service nova] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:13:41.972448 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 761/1516] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:13:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:13:42.682674 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bdd28e-0ee7-463e-89b5-c1f9c3816044 None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:13:42.682963 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bdd28e-0ee7-463e-89b5-c1f9c3816044 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:13:42.683239 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bdd28e-0ee7-463e-89b5-c1f9c3816044 None None] PATH_INFO: `/v3` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:13:42.684552 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 756/1517] 10.222.0.59 () {54 vars in 925 bytes} [Wed Jun 22 10:13:42 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:13:42.690796 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c15906-b9e7-42b7-9436-b3954528f6f4 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:13:42.691088 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c15906-b9e7-42b7-9436-b3954528f6f4 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:13:42.691372 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c15906-b9e7-42b7-9436-b3954528f6f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:13:42.709715 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-60c15906-b9e7-42b7-9436-b3954528f6f4 None None] MFA Rules not processed for user `341ec95408c94dae8539ccff7225e3ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:13:42.711537 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-60c15906-b9e7-42b7-9436-b3954528f6f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:13:42.776512 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 762/1518] 10.222.0.59 () {58 vars in 1015 bytes} [Wed Jun 22 10:13:42 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:13:46.544519 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e3b263-feae-4371-a5e8-145d4234627a None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:13:46.545039 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e3b263-feae-4371-a5e8-145d4234627a None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:13:46.545039 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e3b263-feae-4371-a5e8-145d4234627a None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:13:46.546395 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 757/1519] 10.222.0.43 () {54 vars in 960 bytes} [Wed Jun 22 10:13:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 10:13:46.551174 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb38fc6-3624-40ba-8840-dcc7fffd1eff None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:13:46.551600 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb38fc6-3624-40ba-8840-dcc7fffd1eff None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:13:46.551749 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb38fc6-3624-40ba-8840-dcc7fffd1eff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:13:46.570180 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-9cb38fc6-3624-40ba-8840-dcc7fffd1eff None None] MFA Rules not processed for user `341ec95408c94dae8539ccff7225e3ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:13:46.571381 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-9cb38fc6-3624-40ba-8840-dcc7fffd1eff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:13:46.579779 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 763/1520] 10.222.0.43 () {58 vars in 1057 bytes} [Wed Jun 22 10:13:46 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:13:46.587748 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e3b263-feae-4371-a5e8-145d4234627a None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:13:46.600771 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e3b263-feae-4371-a5e8-145d4234627a None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:13:46.606063 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efc89f1-686d-4b56-9deb-e6204329b644 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '341ec95408c94dae8539ccff7225e3ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:13:46.606693 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efc89f1-686d-4b56-9deb-e6204329b644 service placement] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:13:46.606974 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efc89f1-686d-4b56-9deb-e6204329b644 service placement] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:13:46.607247 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efc89f1-686d-4b56-9deb-e6204329b644 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:13:46.615508 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efc89f1-686d-4b56-9deb-e6204329b644 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:13:46.617321 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efc89f1-686d-4b56-9deb-e6204329b644 service placement] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:13:46.626735 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 758/1521] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:13:46 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 10:13:53.233123 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a63c54-8bfa-45e3-a27d-7c3c52e83384 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:13:53.233679 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a63c54-8bfa-45e3-a27d-7c3c52e83384 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:13:53.233679 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a63c54-8bfa-45e3-a27d-7c3c52e83384 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:13:53.235110 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 764/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 22 10:13:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:13:53.240030 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe89629-0eb3-4bdf-be27-fbcc851ebe84 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:13:53.240432 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe89629-0eb3-4bdf-be27-fbcc851ebe84 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:13:53.240593 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe89629-0eb3-4bdf-be27-fbcc851ebe84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:13:53.258903 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-fbe89629-0eb3-4bdf-be27-fbcc851ebe84 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:13:53.260089 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-fbe89629-0eb3-4bdf-be27-fbcc851ebe84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:13:53.267772 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 759/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 22 10:13:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:13:53.421080 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a63c54-8bfa-45e3-a27d-7c3c52e83384 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:13:53.436901 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a63c54-8bfa-45e3-a27d-7c3c52e83384 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:13:53.442257 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9b800d-0f07-4c67-a433-b5b40d131e18 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '158a49aa3750478a84bf71b9aad24397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:13:53.442893 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9b800d-0f07-4c67-a433-b5b40d131e18 service nova] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:13:53.443180 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9b800d-0f07-4c67-a433-b5b40d131e18 service nova] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:13:53.443461 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9b800d-0f07-4c67-a433-b5b40d131e18 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:13:53.451809 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9b800d-0f07-4c67-a433-b5b40d131e18 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:13:53.453403 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9b800d-0f07-4c67-a433-b5b40d131e18 service nova] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:13:53.463429 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 765/1524] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:13:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:13:54.320726 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b79875-b5b5-4eed-ae62-095d182624e0 None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:13:54.321268 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b79875-b5b5-4eed-ae62-095d182624e0 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:13:54.321268 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b79875-b5b5-4eed-ae62-095d182624e0 None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:13:54.322718 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 760/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 22 10:13:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:13:54.327408 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8864332c-91af-4885-9b83-5f1bee6770d7 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:13:54.327840 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8864332c-91af-4885-9b83-5f1bee6770d7 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:13:54.327975 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8864332c-91af-4885-9b83-5f1bee6770d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:13:54.346615 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-8864332c-91af-4885-9b83-5f1bee6770d7 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:13:54.347800 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-8864332c-91af-4885-9b83-5f1bee6770d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:13:54.356452 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 766/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 22 10:13:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:13:54.508559 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b79875-b5b5-4eed-ae62-095d182624e0 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:13:54.523590 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b79875-b5b5-4eed-ae62-095d182624e0 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:13:54.528891 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9932a7df-09e6-4608-b86f-53a7338dc568 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '158a49aa3750478a84bf71b9aad24397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:13:54.529551 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9932a7df-09e6-4608-b86f-53a7338dc568 service nova] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:13:54.529876 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9932a7df-09e6-4608-b86f-53a7338dc568 service nova] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:13:54.530157 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9932a7df-09e6-4608-b86f-53a7338dc568 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:13:54.538913 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9932a7df-09e6-4608-b86f-53a7338dc568 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:13:54.540487 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9932a7df-09e6-4608-b86f-53a7338dc568 service nova] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:13:54.550028 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 761/1527] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:13:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:13:58.645882 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d2d862-7c02-47e4-92ec-7cc521b726df None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:13:58.646486 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d2d862-7c02-47e4-92ec-7cc521b726df None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:13:58.646486 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d2d862-7c02-47e4-92ec-7cc521b726df None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:13:58.647885 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 767/1528] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 22 10:13:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:13:58.653334 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85abce1-a2bb-4004-a871-859094e0d1e0 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:13:58.653780 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85abce1-a2bb-4004-a871-859094e0d1e0 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:13:58.653933 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85abce1-a2bb-4004-a871-859094e0d1e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:13:58.672100 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-e85abce1-a2bb-4004-a871-859094e0d1e0 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:13:58.673285 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-e85abce1-a2bb-4004-a871-859094e0d1e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:13:58.682133 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 762/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 22 10:13:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:13:58.718166 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d2d862-7c02-47e4-92ec-7cc521b726df None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:13:58.719808 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-38d2d862-7c02-47e4-92ec-7cc521b726df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:13:58.785161 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d2d862-7c02-47e4-92ec-7cc521b726df None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:13:58.789679 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c954a6a-4d9d-408d-a7a7-73f59a873f64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe93d4c0737249fd8623bb5ce188e34e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:13:58.790366 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c954a6a-4d9d-408d-a7a7-73f59a873f64 service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:13:58.790652 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c954a6a-4d9d-408d-a7a7-73f59a873f64 service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:13:58.790933 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c954a6a-4d9d-408d-a7a7-73f59a873f64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:13:58.800098 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c954a6a-4d9d-408d-a7a7-73f59a873f64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:13:58.801525 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c954a6a-4d9d-408d-a7a7-73f59a873f64 service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:13:58.806617 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:13:58.811964 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 768/1530] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:13:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:14:00.880906 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39becdf-7dd2-48f4-b09a-6e870f5547ff None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:14:00.881966 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39becdf-7dd2-48f4-b09a-6e870f5547ff None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:14:00.882073 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39becdf-7dd2-48f4-b09a-6e870f5547ff None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:14:00.883403 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 763/1531] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 22 10:14:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:14:00.888603 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3927d6-c6cf-410a-b4b9-232bfa25b6f6 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:14:00.889011 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3927d6-c6cf-410a-b4b9-232bfa25b6f6 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:14:00.889167 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3927d6-c6cf-410a-b4b9-232bfa25b6f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:14:00.907875 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-9d3927d6-c6cf-410a-b4b9-232bfa25b6f6 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:14:00.909085 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-9d3927d6-c6cf-410a-b4b9-232bfa25b6f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:14:00.917496 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 769/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 22 10:14:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:14:00.955903 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39becdf-7dd2-48f4-b09a-6e870f5547ff None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:14:00.957673 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-a39becdf-7dd2-48f4-b09a-6e870f5547ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:14:00.971082 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39becdf-7dd2-48f4-b09a-6e870f5547ff None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:14:00.974563 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3922adfa-ae7e-4c2e-a939-d0eb31b312fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe93d4c0737249fd8623bb5ce188e34e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:14:00.975314 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3922adfa-ae7e-4c2e-a939-d0eb31b312fd service neutron] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:14:00.975314 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3922adfa-ae7e-4c2e-a939-d0eb31b312fd service neutron] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:14:00.975805 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3922adfa-ae7e-4c2e-a939-d0eb31b312fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:14:00.984810 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3922adfa-ae7e-4c2e-a939-d0eb31b312fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:14:00.986298 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3922adfa-ae7e-4c2e-a939-d0eb31b312fd service neutron] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:14:00.996251 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 764/1533] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:14:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:14:04.576328 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11759da8-36e9-409f-9804-7f0d6b741aff None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:14:04.576897 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11759da8-36e9-409f-9804-7f0d6b741aff None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:14:04.576897 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11759da8-36e9-409f-9804-7f0d6b741aff None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:14:04.578326 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 770/1534] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 22 10:14:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:14:04.583536 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c3d61f-31c5-4546-a2a2-5dc133b8941a None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:14:04.583960 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c3d61f-31c5-4546-a2a2-5dc133b8941a None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:14:04.584110 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c3d61f-31c5-4546-a2a2-5dc133b8941a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:14:04.602513 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-00c3d61f-31c5-4546-a2a2-5dc133b8941a None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:14:04.603709 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-00c3d61f-31c5-4546-a2a2-5dc133b8941a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:14:04.611757 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 765/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 22 10:14:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:14:04.918191 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11759da8-36e9-409f-9804-7f0d6b741aff None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:14:04.919860 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-11759da8-36e9-409f-9804-7f0d6b741aff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:14:04.977047 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11759da8-36e9-409f-9804-7f0d6b741aff None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:14:04.980838 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3a1e93-2c00-4c3a-a349-1cbc18420812 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bbcb3d4dc704dfdb0097abc594ca855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:14:04.981532 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3a1e93-2c00-4c3a-a349-1cbc18420812 service cinder] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:14:04.981853 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3a1e93-2c00-4c3a-a349-1cbc18420812 service cinder] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:14:04.982132 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3a1e93-2c00-4c3a-a349-1cbc18420812 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:14:04.991398 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3a1e93-2c00-4c3a-a349-1cbc18420812 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:14:04.992824 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3a1e93-2c00-4c3a-a349-1cbc18420812 service cinder] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:14:05.002179 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 771/1536] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:14:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:14:07.045528 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a212d4-14b3-467c-b1e4-738283d928db None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:14:07.046240 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a212d4-14b3-467c-b1e4-738283d928db None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:14:07.046240 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a212d4-14b3-467c-b1e4-738283d928db None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:14:07.047494 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 766/1537] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 22 10:14:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:14:07.052610 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6fb5e9-0b0a-47d9-9762-a167f6854a13 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:14:07.053020 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6fb5e9-0b0a-47d9-9762-a167f6854a13 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:14:07.053177 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6fb5e9-0b0a-47d9-9762-a167f6854a13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:14:07.071211 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-9c6fb5e9-0b0a-47d9-9762-a167f6854a13 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:14:07.072707 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-9c6fb5e9-0b0a-47d9-9762-a167f6854a13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:14:07.080565 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 772/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 22 10:14:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:14:07.380995 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a212d4-14b3-467c-b1e4-738283d928db None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:14:07.382883 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-b1a212d4-14b3-467c-b1e4-738283d928db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:14:07.395561 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a212d4-14b3-467c-b1e4-738283d928db None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:14:07.399094 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb39290-5e75-486d-a590-251719bce8fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bbcb3d4dc704dfdb0097abc594ca855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:14:07.399724 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb39290-5e75-486d-a590-251719bce8fa service cinder] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:14:07.400005 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb39290-5e75-486d-a590-251719bce8fa service cinder] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:14:07.400282 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb39290-5e75-486d-a590-251719bce8fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:14:07.408976 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb39290-5e75-486d-a590-251719bce8fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:14:07.410425 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb39290-5e75-486d-a590-251719bce8fa service cinder] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:14:07.420318 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 767/1539] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:14:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:14:17.066065 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=32 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:14:17.416235 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=70 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:15:34.758407 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04872a59-92a4-45d3-8e66-b2e08b258432 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:34.759085 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04872a59-92a4-45d3-8e66-b2e08b258432 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:34.759085 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04872a59-92a4-45d3-8e66-b2e08b258432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:34.783474 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-04872a59-92a4-45d3-8e66-b2e08b258432 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:15:34.784894 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-04872a59-92a4-45d3-8e66-b2e08b258432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:15:34.797093 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 773/1540] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:15:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:15:34.808514 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2035b9d4-820c-4e5d-a5a4-a5b05d2894b0 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:34.809331 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2035b9d4-820c-4e5d-a5a4-a5b05d2894b0 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:34.809331 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2035b9d4-820c-4e5d-a5a4-a5b05d2894b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:34.822376 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5079624f-4272-40fe-990d-f4ce2d2c9652 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:34.823178 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5079624f-4272-40fe-990d-f4ce2d2c9652 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:34.823463 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5079624f-4272-40fe-990d-f4ce2d2c9652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:34.851409 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-2035b9d4-820c-4e5d-a5a4-a5b05d2894b0 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:15:34.852657 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-2035b9d4-820c-4e5d-a5a4-a5b05d2894b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:15:34.862186 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-5079624f-4272-40fe-990d-f4ce2d2c9652 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:15:34.870896 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-5079624f-4272-40fe-990d-f4ce2d2c9652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:15:34.880450 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 768/1541] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:15:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:15:34.889566 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2035b9d4-820c-4e5d-a5a4-a5b05d2894b0 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:15:34.905256 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 774/1542] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:15:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:15:34.910251 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2035b9d4-820c-4e5d-a5a4-a5b05d2894b0 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:15:34.924438 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cf53dc-7728-4580-a6d5-943d9d66b1d6 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:34.924807 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cf53dc-7728-4580-a6d5-943d9d66b1d6 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:34.925544 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cf53dc-7728-4580-a6d5-943d9d66b1d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:34.927141 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c68c34-7c23-4c5f-a021-e2f4a27e9d63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:15:34.931010 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c68c34-7c23-4c5f-a021-e2f4a27e9d63 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:34.932541 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c68c34-7c23-4c5f-a021-e2f4a27e9d63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:34.932844 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c68c34-7c23-4c5f-a021-e2f4a27e9d63 admin admin] PATH_INFO: `/v3/domains` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:34.933624 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c68c34-7c23-4c5f-a021-e2f4a27e9d63 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:15:34.933967 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c68c34-7c23-4c5f-a021-e2f4a27e9d63 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:15:34.935092 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: WARNING py.warnings [None req-95c68c34-7c23-4c5f-a021-e2f4a27e9d63 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 22 10:15:34.935092 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: warnings.warn(msg) Jun 22 10:15:34.935092 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: Jun 22 10:15:34.936730 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c68c34-7c23-4c5f-a021-e2f4a27e9d63 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:15:34.960023 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 769/1543] 10.222.0.43 () {58 vars in 1152 bytes} [Wed Jun 22 10:15:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:15:34.988281 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c68c34-7c23-4c5f-a021-e2f4a27e9d63 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:15:35.004691 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c68c34-7c23-4c5f-a021-e2f4a27e9d63 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:15:35.021262 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eedd079-9536-4607-9742-19503148af06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:15:35.021907 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eedd079-9536-4607-9742-19503148af06 admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:35.022201 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eedd079-9536-4607-9742-19503148af06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:35.022483 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eedd079-9536-4607-9742-19503148af06 admin admin] PATH_INFO: `/v3/projects` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:35.023200 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eedd079-9536-4607-9742-19503148af06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:15:35.026127 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eedd079-9536-4607-9742-19503148af06 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:15:35.071629 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 770/1544] 10.222.0.43 () {60 vars in 1152 bytes} [Wed Jun 22 10:15:34 2022] POST /identity/v3/projects => generated 381 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:15:35.077837 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eedd079-9536-4607-9742-19503148af06 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:15:35.106598 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-a7cf53dc-7728-4580-a6d5-943d9d66b1d6 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:15:35.110733 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-a7cf53dc-7728-4580-a6d5-943d9d66b1d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:15:35.216878 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eedd079-9536-4607-9742-19503148af06 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:15:35.222435 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ddb4ba-e80f-4117-b98e-d5c13a3b03fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:15:35.223384 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ddb4ba-e80f-4117-b98e-d5c13a3b03fd admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:35.223772 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ddb4ba-e80f-4117-b98e-d5c13a3b03fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:35.224120 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ddb4ba-e80f-4117-b98e-d5c13a3b03fd admin admin] PATH_INFO: `/v3/users` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:35.224889 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ddb4ba-e80f-4117-b98e-d5c13a3b03fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:15:35.226033 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: WARNING py.warnings [None req-25ddb4ba-e80f-4117-b98e-d5c13a3b03fd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 22 10:15:35.226033 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: warnings.warn(msg) Jun 22 10:15:35.226033 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: Jun 22 10:15:35.227658 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ddb4ba-e80f-4117-b98e-d5c13a3b03fd admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:15:35.230025 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 775/1545] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:15:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:15:35.231619 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6635eb4d-a87d-4321-98e7-06d4fcd62ce6 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:35.232228 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6635eb4d-a87d-4321-98e7-06d4fcd62ce6 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:35.232707 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6635eb4d-a87d-4321-98e7-06d4fcd62ce6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:35.253041 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 771/1546] 10.222.0.43 () {60 vars in 1143 bytes} [Wed Jun 22 10:15:35 2022] POST /identity/v3/users => generated 291 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 10:15:35.255032 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9e6800-05ae-4cf9-b8ff-af8516ff0af9 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:35.255400 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9e6800-05ae-4cf9-b8ff-af8516ff0af9 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:35.255829 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9e6800-05ae-4cf9-b8ff-af8516ff0af9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:35.256692 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-6635eb4d-a87d-4321-98e7-06d4fcd62ce6 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:15:35.258228 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-6635eb4d-a87d-4321-98e7-06d4fcd62ce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:15:35.270403 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 776/1547] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:15:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:15:35.272197 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884f11af-b183-4c2d-b331-9e0833dee6d7 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:35.272838 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884f11af-b183-4c2d-b331-9e0833dee6d7 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:35.273344 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884f11af-b183-4c2d-b331-9e0833dee6d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:35.283018 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-ba9e6800-05ae-4cf9-b8ff-af8516ff0af9 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:15:35.285148 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-ba9e6800-05ae-4cf9-b8ff-af8516ff0af9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:15:35.294012 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 772/1548] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:15:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:15:35.295832 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be56721-5a9f-48e5-932c-ddd93abf8abe None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:35.296129 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be56721-5a9f-48e5-932c-ddd93abf8abe None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:35.296409 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be56721-5a9f-48e5-932c-ddd93abf8abe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:35.296655 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-884f11af-b183-4c2d-b331-9e0833dee6d7 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:15:35.298232 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-884f11af-b183-4c2d-b331-9e0833dee6d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:15:35.308386 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 777/1549] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:15:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:15:35.313773 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884f11af-b183-4c2d-b331-9e0833dee6d7 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:15:35.323626 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884f11af-b183-4c2d-b331-9e0833dee6d7 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:15:35.324395 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-4be56721-5a9f-48e5-932c-ddd93abf8abe None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:15:35.325599 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-4be56721-5a9f-48e5-932c-ddd93abf8abe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:15:35.328785 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4273df0-2eba-4dda-8852-087d1b134b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:15:35.329455 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4273df0-2eba-4dda-8852-087d1b134b89 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:35.329759 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4273df0-2eba-4dda-8852-087d1b134b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:35.330038 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4273df0-2eba-4dda-8852-087d1b134b89 admin admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:35.330767 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4273df0-2eba-4dda-8852-087d1b134b89 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:15:35.331125 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4273df0-2eba-4dda-8852-087d1b134b89 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:15:35.332767 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4273df0-2eba-4dda-8852-087d1b134b89 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:15:35.334727 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 773/1550] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:15:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:15:35.336114 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be56721-5a9f-48e5-932c-ddd93abf8abe None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:15:35.345998 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 778/1551] 10.222.0.43 () {58 vars in 1152 bytes} [Wed Jun 22 10:15:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:15:35.347965 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b303cf89-a4c0-40eb-80b7-7cd1f986b458 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:35.348256 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b303cf89-a4c0-40eb-80b7-7cd1f986b458 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:35.348379 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be56721-5a9f-48e5-932c-ddd93abf8abe None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:15:35.348557 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b303cf89-a4c0-40eb-80b7-7cd1f986b458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:35.352866 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8473fa61-93a2-47f8-813a-9896ff7ee8c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:15:35.353533 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8473fa61-93a2-47f8-813a-9896ff7ee8c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:35.353892 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8473fa61-93a2-47f8-813a-9896ff7ee8c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:35.354176 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8473fa61-93a2-47f8-813a-9896ff7ee8c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:35.355161 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8473fa61-93a2-47f8-813a-9896ff7ee8c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:15:35.356956 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8473fa61-93a2-47f8-813a-9896ff7ee8c0 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:15:35.368071 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 774/1552] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:15:35 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:15:35.371059 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-b303cf89-a4c0-40eb-80b7-7cd1f986b458 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:15:35.371175 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e314590-5711-4296-9a3b-24e761e61ecd None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:35.371276 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-b303cf89-a4c0-40eb-80b7-7cd1f986b458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:15:35.371377 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e314590-5711-4296-9a3b-24e761e61ecd None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:35.371377 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e314590-5711-4296-9a3b-24e761e61ecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:35.377597 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 779/1553] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:15:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:15:35.378902 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3044f79-f1da-4d9d-a756-86072683728f None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:35.379178 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3044f79-f1da-4d9d-a756-86072683728f None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:35.379459 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3044f79-f1da-4d9d-a756-86072683728f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:35.388767 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-4e314590-5711-4296-9a3b-24e761e61ecd None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:15:35.389995 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-4e314590-5711-4296-9a3b-24e761e61ecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:15:35.397250 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-b3044f79-f1da-4d9d-a756-86072683728f None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:15:35.397956 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 775/1554] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:15:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:15:35.398467 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-b3044f79-f1da-4d9d-a756-86072683728f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:15:35.399189 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91666dc-6050-4e8b-b460-0331327aabe9 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:35.399483 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91666dc-6050-4e8b-b460-0331327aabe9 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:35.399767 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91666dc-6050-4e8b-b460-0331327aabe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:35.408804 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 780/1555] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:15:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:15:35.410610 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c68b71d-6475-4408-b6bb-17b7ab187f67 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:35.410889 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c68b71d-6475-4408-b6bb-17b7ab187f67 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:35.411164 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c68b71d-6475-4408-b6bb-17b7ab187f67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:35.419225 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-c91666dc-6050-4e8b-b460-0331327aabe9 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:15:35.420434 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-c91666dc-6050-4e8b-b460-0331327aabe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:15:35.429161 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 776/1556] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:15:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:15:35.430406 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-6c68b71d-6475-4408-b6bb-17b7ab187f67 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:15:35.430538 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c94a70a-d61f-4020-9927-bbc8bd9ad5ee None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:35.430795 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c94a70a-d61f-4020-9927-bbc8bd9ad5ee None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:35.431079 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c94a70a-d61f-4020-9927-bbc8bd9ad5ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:35.431585 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-6c68b71d-6475-4408-b6bb-17b7ab187f67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:15:35.439609 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 781/1557] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:15:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:15:35.440214 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c68b71d-6475-4408-b6bb-17b7ab187f67 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:15:35.450409 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c68b71d-6475-4408-b6bb-17b7ab187f67 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:15:35.450726 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-4c94a70a-d61f-4020-9927-bbc8bd9ad5ee None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:15:35.451941 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-4c94a70a-d61f-4020-9927-bbc8bd9ad5ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:15:35.454980 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912e60df-a52b-4295-9368-9c91df99641f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:15:35.455651 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912e60df-a52b-4295-9368-9c91df99641f admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:35.455942 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912e60df-a52b-4295-9368-9c91df99641f admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:35.456262 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912e60df-a52b-4295-9368-9c91df99641f admin admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:35.457174 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912e60df-a52b-4295-9368-9c91df99641f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:15:35.458199 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: WARNING py.warnings [None req-912e60df-a52b-4295-9368-9c91df99641f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 22 10:15:35.458199 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: warnings.warn(msg) Jun 22 10:15:35.458199 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: Jun 22 10:15:35.459365 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912e60df-a52b-4295-9368-9c91df99641f admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:15:35.460010 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 777/1558] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:15:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:15:35.460785 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c94a70a-d61f-4020-9927-bbc8bd9ad5ee None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:15:35.469811 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c94a70a-d61f-4020-9927-bbc8bd9ad5ee None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:15:35.475507 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f625bb-6198-456a-805d-2300d1166cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:15:35.476515 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f625bb-6198-456a-805d-2300d1166cbe admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:35.477130 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f625bb-6198-456a-805d-2300d1166cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:35.477490 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f625bb-6198-456a-805d-2300d1166cbe admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:35.478598 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f625bb-6198-456a-805d-2300d1166cbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:15:35.481339 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f625bb-6198-456a-805d-2300d1166cbe admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:15:35.487046 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 782/1559] 10.222.0.43 () {60 vars in 1152 bytes} [Wed Jun 22 10:15:35 2022] POST /identity/v3/projects => generated 381 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:15:35.488053 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912e60df-a52b-4295-9368-9c91df99641f admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:15:35.492163 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 778/1560] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:15:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:15:35.492865 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f625bb-6198-456a-805d-2300d1166cbe admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:15:35.502307 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f625bb-6198-456a-805d-2300d1166cbe admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:15:35.550465 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:15:35.551425 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912e60df-a52b-4295-9368-9c91df99641f admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:15:35.556967 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb67975-66e7-4dc9-a07f-f1f6ade72b0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:15:35.557631 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb67975-66e7-4dc9-a07f-f1f6ade72b0d admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:35.558043 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb67975-66e7-4dc9-a07f-f1f6ade72b0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:35.558321 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb67975-66e7-4dc9-a07f-f1f6ade72b0d admin admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:35.559052 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb67975-66e7-4dc9-a07f-f1f6ade72b0d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:15:35.559360 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb67975-66e7-4dc9-a07f-f1f6ade72b0d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:15:35.560589 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3082a03a-389d-4031-ac65-1bfd4e439001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:15:35.560966 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb67975-66e7-4dc9-a07f-f1f6ade72b0d admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:15:35.561247 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3082a03a-389d-4031-ac65-1bfd4e439001 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:35.561532 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3082a03a-389d-4031-ac65-1bfd4e439001 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:35.561847 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3082a03a-389d-4031-ac65-1bfd4e439001 admin admin] PATH_INFO: `/v3/domains` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:35.562564 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3082a03a-389d-4031-ac65-1bfd4e439001 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:15:35.562868 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3082a03a-389d-4031-ac65-1bfd4e439001 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:15:35.564455 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3082a03a-389d-4031-ac65-1bfd4e439001 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:15:35.572859 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 783/1561] 10.222.0.43 () {58 vars in 1152 bytes} [Wed Jun 22 10:15:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:15:35.574338 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc809a48-9633-4df7-8d83-7ccfb8ac0c7f None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:35.574623 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc809a48-9633-4df7-8d83-7ccfb8ac0c7f None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:35.574900 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc809a48-9633-4df7-8d83-7ccfb8ac0c7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:35.582754 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 779/1562] 10.222.0.43 () {58 vars in 1152 bytes} [Wed Jun 22 10:15:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:15:35.583648 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3082a03a-389d-4031-ac65-1bfd4e439001 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:15:35.593568 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3082a03a-389d-4031-ac65-1bfd4e439001 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:15:35.598770 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610d16a1-9cb0-48de-a219-55ea6d37dc5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:15:35.599556 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610d16a1-9cb0-48de-a219-55ea6d37dc5e admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:35.599850 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610d16a1-9cb0-48de-a219-55ea6d37dc5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:35.600073 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-dc809a48-9633-4df7-8d83-7ccfb8ac0c7f None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:15:35.600201 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610d16a1-9cb0-48de-a219-55ea6d37dc5e admin admin] PATH_INFO: `/v3/domains` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:35.600838 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610d16a1-9cb0-48de-a219-55ea6d37dc5e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:15:35.601147 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610d16a1-9cb0-48de-a219-55ea6d37dc5e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:15:35.601278 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-dc809a48-9633-4df7-8d83-7ccfb8ac0c7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:15:35.602783 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610d16a1-9cb0-48de-a219-55ea6d37dc5e admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:15:35.609295 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 784/1563] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:15:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:15:35.610531 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798ab49e-8c57-4c54-8a8e-115d9a6b031e None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:35.610815 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798ab49e-8c57-4c54-8a8e-115d9a6b031e None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:35.611112 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798ab49e-8c57-4c54-8a8e-115d9a6b031e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:35.626011 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 780/1564] 10.222.0.43 () {58 vars in 1152 bytes} [Wed Jun 22 10:15:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:15:35.626011 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610d16a1-9cb0-48de-a219-55ea6d37dc5e admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:15:35.626682 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:15:35.628872 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-798ab49e-8c57-4c54-8a8e-115d9a6b031e None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:15:35.630993 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-798ab49e-8c57-4c54-8a8e-115d9a6b031e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:15:35.631196 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610d16a1-9cb0-48de-a219-55ea6d37dc5e admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:15:35.635773 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046055f4-967c-45c7-b037-ff9c3266f567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:15:35.636423 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046055f4-967c-45c7-b037-ff9c3266f567 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:35.636709 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046055f4-967c-45c7-b037-ff9c3266f567 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:35.636986 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046055f4-967c-45c7-b037-ff9c3266f567 admin admin] PATH_INFO: `/v3/domains` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:35.637728 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046055f4-967c-45c7-b037-ff9c3266f567 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:15:35.638038 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046055f4-967c-45c7-b037-ff9c3266f567 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:15:35.639638 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 785/1565] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:15:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:15:35.639752 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046055f4-967c-45c7-b037-ff9c3266f567 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:15:35.640229 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798ab49e-8c57-4c54-8a8e-115d9a6b031e None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:15:35.650271 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798ab49e-8c57-4c54-8a8e-115d9a6b031e None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:15:35.654276 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 781/1566] 10.222.0.43 () {58 vars in 1152 bytes} [Wed Jun 22 10:15:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:15:35.655068 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046055f4-967c-45c7-b037-ff9c3266f567 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:15:35.655600 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00552625-75c2-4d3e-b806-ef920849a93f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:15:35.656476 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00552625-75c2-4d3e-b806-ef920849a93f admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:35.656861 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00552625-75c2-4d3e-b806-ef920849a93f admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:35.657240 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00552625-75c2-4d3e-b806-ef920849a93f admin admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:35.658070 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00552625-75c2-4d3e-b806-ef920849a93f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:15:35.660699 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00552625-75c2-4d3e-b806-ef920849a93f admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:15:35.667544 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046055f4-967c-45c7-b037-ff9c3266f567 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:15:35.675476 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49d71b0-d494-4297-909a-def766e39702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:15:35.676607 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49d71b0-d494-4297-909a-def766e39702 admin admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:35.676901 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49d71b0-d494-4297-909a-def766e39702 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:35.677185 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49d71b0-d494-4297-909a-def766e39702 admin admin] PATH_INFO: `/v3/projects/18756f7eccc64437bf9b22f0fe967a1c/users/175789ab31f14363b7b04629954447c8/roles/9f88c83743f745a9a785a2f454753f06` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:35.681366 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 786/1567] 10.222.0.43 () {60 vars in 1143 bytes} [Wed Jun 22 10:15:35 2022] POST /identity/v3/users => generated 291 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:15:35.682748 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00552625-75c2-4d3e-b806-ef920849a93f admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:15:35.692617 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49d71b0-d494-4297-909a-def766e39702 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18756f7eccc64437bf9b22f0fe967a1c, user_id=175789ab31f14363b7b04629954447c8, role_id=9f88c83743f745a9a785a2f454753f06)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:15:35.693101 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00552625-75c2-4d3e-b806-ef920849a93f admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:15:35.695682 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49d71b0-d494-4297-909a-def766e39702 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:15:35.697644 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540e0bee-2f4e-419f-b6a3-559f8050b610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:15:35.698318 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540e0bee-2f4e-419f-b6a3-559f8050b610 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:35.698601 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540e0bee-2f4e-419f-b6a3-559f8050b610 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:35.698877 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540e0bee-2f4e-419f-b6a3-559f8050b610 admin admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:35.699688 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540e0bee-2f4e-419f-b6a3-559f8050b610 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:15:35.701894 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540e0bee-2f4e-419f-b6a3-559f8050b610 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:15:35.710625 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 782/1568] 10.222.0.43 () {60 vars in 1482 bytes} [Wed Jun 22 10:15:35 2022] PUT /identity/v3/projects/18756f7eccc64437bf9b22f0fe967a1c/users/175789ab31f14363b7b04629954447c8/roles/9f88c83743f745a9a785a2f454753f06 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:15:35.711487 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49d71b0-d494-4297-909a-def766e39702 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:15:35.736201 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 787/1569] 10.222.0.43 () {60 vars in 1152 bytes} [Wed Jun 22 10:15:35 2022] POST /identity/v3/projects => generated 377 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:15:35.736201 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540e0bee-2f4e-419f-b6a3-559f8050b610 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:15:35.797303 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540e0bee-2f4e-419f-b6a3-559f8050b610 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:15:35.798437 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49d71b0-d494-4297-909a-def766e39702 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:15:35.802079 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58952ff9-804b-44f5-8025-6036dfe97c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:15:35.802599 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58952ff9-804b-44f5-8025-6036dfe97c88 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:35.802879 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58952ff9-804b-44f5-8025-6036dfe97c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:35.803155 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58952ff9-804b-44f5-8025-6036dfe97c88 admin admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:35.803251 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba67b107-4378-4b2d-9bb1-d7c0e079c287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:15:35.803886 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58952ff9-804b-44f5-8025-6036dfe97c88 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:15:35.804004 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba67b107-4378-4b2d-9bb1-d7c0e079c287 admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:35.804219 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58952ff9-804b-44f5-8025-6036dfe97c88 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:15:35.804336 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba67b107-4378-4b2d-9bb1-d7c0e079c287 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:35.804494 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba67b107-4378-4b2d-9bb1-d7c0e079c287 admin admin] PATH_INFO: `/v3/projects` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:35.805191 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba67b107-4378-4b2d-9bb1-d7c0e079c287 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:15:35.805842 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58952ff9-804b-44f5-8025-6036dfe97c88 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:15:35.807178 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba67b107-4378-4b2d-9bb1-d7c0e079c287 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:15:35.817603 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 788/1570] 10.222.0.43 () {58 vars in 1152 bytes} [Wed Jun 22 10:15:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:15:35.818489 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58952ff9-804b-44f5-8025-6036dfe97c88 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:15:35.828336 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58952ff9-804b-44f5-8025-6036dfe97c88 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:15:35.834080 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a48006-e98a-484c-af88-b333cc93fc03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:15:35.834779 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a48006-e98a-484c-af88-b333cc93fc03 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:35.835079 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a48006-e98a-484c-af88-b333cc93fc03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:35.835357 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a48006-e98a-484c-af88-b333cc93fc03 admin admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:35.836035 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a48006-e98a-484c-af88-b333cc93fc03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:15:35.837771 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 783/1571] 10.222.0.43 () {60 vars in 1152 bytes} [Wed Jun 22 10:15:35 2022] POST /identity/v3/projects => generated 389 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:15:35.838301 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a48006-e98a-484c-af88-b333cc93fc03 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:15:35.841513 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba67b107-4378-4b2d-9bb1-d7c0e079c287 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:15:35.871195 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 789/1572] 10.222.0.43 () {60 vars in 1152 bytes} [Wed Jun 22 10:15:35 2022] POST /identity/v3/projects => generated 393 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:15:35.871195 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a48006-e98a-484c-af88-b333cc93fc03 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:15:35.906068 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba67b107-4378-4b2d-9bb1-d7c0e079c287 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:15:35.932388 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:15:35.936587 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a48006-e98a-484c-af88-b333cc93fc03 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:15:35.942688 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e933d7-df4b-4b42-b0a1-fec694508412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:15:35.943355 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e933d7-df4b-4b42-b0a1-fec694508412 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:35.943652 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e933d7-df4b-4b42-b0a1-fec694508412 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:35.943929 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e933d7-df4b-4b42-b0a1-fec694508412 admin admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:35.944618 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e933d7-df4b-4b42-b0a1-fec694508412 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:15:35.946575 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e933d7-df4b-4b42-b0a1-fec694508412 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:15:35.964903 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a25e22-9afc-4871-a039-7c7307316169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:15:35.965587 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a25e22-9afc-4871-a039-7c7307316169 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:35.965983 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a25e22-9afc-4871-a039-7c7307316169 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:35.966262 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a25e22-9afc-4871-a039-7c7307316169 admin admin] PATH_INFO: `/v3/domains` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:35.967006 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a25e22-9afc-4871-a039-7c7307316169 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:15:35.967322 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a25e22-9afc-4871-a039-7c7307316169 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:15:35.968964 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a25e22-9afc-4871-a039-7c7307316169 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:15:35.974398 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 790/1573] 10.222.0.43 () {60 vars in 1152 bytes} [Wed Jun 22 10:15:35 2022] POST /identity/v3/projects => generated 377 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:15:35.975249 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e933d7-df4b-4b42-b0a1-fec694508412 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:15:35.989911 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 784/1574] 10.222.0.43 () {58 vars in 1152 bytes} [Wed Jun 22 10:15:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:15:35.989911 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39edfe0-b352-40b3-b77a-6fc72778f4b1 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:35.989911 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39edfe0-b352-40b3-b77a-6fc72778f4b1 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:35.989911 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39edfe0-b352-40b3-b77a-6fc72778f4b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:36.009597 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:15:36.011372 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-c39edfe0-b352-40b3-b77a-6fc72778f4b1 None None] MFA Rules not processed for user `175789ab31f14363b7b04629954447c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:15:36.012660 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-c39edfe0-b352-40b3-b77a-6fc72778f4b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:15:36.056075 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e933d7-df4b-4b42-b0a1-fec694508412 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:15:36.061766 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0e56f5-622c-46a2-b6a2-7f1d5d3d32e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:15:36.062580 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0e56f5-622c-46a2-b6a2-7f1d5d3d32e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:36.062966 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0e56f5-622c-46a2-b6a2-7f1d5d3d32e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:36.063321 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0e56f5-622c-46a2-b6a2-7f1d5d3d32e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:36.064126 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0e56f5-622c-46a2-b6a2-7f1d5d3d32e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:15:36.066110 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0e56f5-622c-46a2-b6a2-7f1d5d3d32e5 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:15:36.080329 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 791/1575] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:15:35 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:15:36.080329 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0e56f5-622c-46a2-b6a2-7f1d5d3d32e5 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:15:36.084629 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 785/1576] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:15:35 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:15:36.085450 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39edfe0-b352-40b3-b77a-6fc72778f4b1 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:15:36.093488 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0e56f5-622c-46a2-b6a2-7f1d5d3d32e5 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:15:36.098858 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09129c53-9c4a-4ca0-8abb-90a4dc9c443f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:15:36.102963 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09129c53-9c4a-4ca0-8abb-90a4dc9c443f admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:36.102963 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09129c53-9c4a-4ca0-8abb-90a4dc9c443f admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:36.102963 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09129c53-9c4a-4ca0-8abb-90a4dc9c443f admin admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:36.102963 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09129c53-9c4a-4ca0-8abb-90a4dc9c443f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:15:36.103371 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39edfe0-b352-40b3-b77a-6fc72778f4b1 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:15:36.103467 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09129c53-9c4a-4ca0-8abb-90a4dc9c443f admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:15:36.108840 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd92c1b9-6470-41e1-90c5-facdbf05eff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:15:36.109611 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd92c1b9-6470-41e1-90c5-facdbf05eff0 admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:36.110049 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd92c1b9-6470-41e1-90c5-facdbf05eff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:36.110428 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd92c1b9-6470-41e1-90c5-facdbf05eff0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:36.111385 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd92c1b9-6470-41e1-90c5-facdbf05eff0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:15:36.114392 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd92c1b9-6470-41e1-90c5-facdbf05eff0 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:15:36.130759 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 792/1577] 10.222.0.43 () {60 vars in 1143 bytes} [Wed Jun 22 10:15:36 2022] POST /identity/v3/users => generated 289 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:15:36.131564 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09129c53-9c4a-4ca0-8abb-90a4dc9c443f admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:15:36.141586 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09129c53-9c4a-4ca0-8abb-90a4dc9c443f admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:15:36.145348 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 786/1578] 10.222.0.43 () {60 vars in 1152 bytes} [Wed Jun 22 10:15:36 2022] POST /identity/v3/projects => generated 377 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:15:36.146189 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd92c1b9-6470-41e1-90c5-facdbf05eff0 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:15:36.146602 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dde3380-db9e-4ac6-9e55-5fe99c0052ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:15:36.147370 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dde3380-db9e-4ac6-9e55-5fe99c0052ea admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:36.147754 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dde3380-db9e-4ac6-9e55-5fe99c0052ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:36.148147 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dde3380-db9e-4ac6-9e55-5fe99c0052ea admin admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:36.148888 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dde3380-db9e-4ac6-9e55-5fe99c0052ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:15:36.150846 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dde3380-db9e-4ac6-9e55-5fe99c0052ea admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:15:36.173103 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 793/1579] 10.222.0.43 () {60 vars in 1143 bytes} [Wed Jun 22 10:15:36 2022] POST /identity/v3/users => generated 295 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:15:36.174395 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dde3380-db9e-4ac6-9e55-5fe99c0052ea admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:15:36.184762 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dde3380-db9e-4ac6-9e55-5fe99c0052ea admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:15:36.213065 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd92c1b9-6470-41e1-90c5-facdbf05eff0 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:15:36.217738 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7756e6e3-f23e-4089-bbd5-c2c195aee30d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:15:36.218400 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7756e6e3-f23e-4089-bbd5-c2c195aee30d admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:36.218688 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7756e6e3-f23e-4089-bbd5-c2c195aee30d admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:36.218968 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7756e6e3-f23e-4089-bbd5-c2c195aee30d admin admin] PATH_INFO: `/v3/users` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:36.219661 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7756e6e3-f23e-4089-bbd5-c2c195aee30d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:15:36.221620 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7756e6e3-f23e-4089-bbd5-c2c195aee30d admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:15:36.243231 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 787/1580] 10.222.0.43 () {60 vars in 1143 bytes} [Wed Jun 22 10:15:36 2022] POST /identity/v3/users => generated 297 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:15:36.244460 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7756e6e3-f23e-4089-bbd5-c2c195aee30d admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:15:36.244796 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20e1fc9-b97e-4e1f-b826-5cd1c585c7b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:15:36.245500 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20e1fc9-b97e-4e1f-b826-5cd1c585c7b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:36.245805 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20e1fc9-b97e-4e1f-b826-5cd1c585c7b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:36.246089 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20e1fc9-b97e-4e1f-b826-5cd1c585c7b1 admin admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:36.247142 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20e1fc9-b97e-4e1f-b826-5cd1c585c7b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:15:36.249775 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20e1fc9-b97e-4e1f-b826-5cd1c585c7b1 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:15:36.257344 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7756e6e3-f23e-4089-bbd5-c2c195aee30d admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:15:36.263341 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae056b9e-df53-41a2-b96e-ab9a99278ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:15:36.264377 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae056b9e-df53-41a2-b96e-ab9a99278ee5 admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:36.264706 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae056b9e-df53-41a2-b96e-ab9a99278ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:36.264903 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae056b9e-df53-41a2-b96e-ab9a99278ee5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:36.265843 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae056b9e-df53-41a2-b96e-ab9a99278ee5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:15:36.268093 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae056b9e-df53-41a2-b96e-ab9a99278ee5 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:15:36.275259 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 794/1581] 10.222.0.43 () {60 vars in 1143 bytes} [Wed Jun 22 10:15:36 2022] POST /identity/v3/users => generated 289 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:15:36.275259 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20e1fc9-b97e-4e1f-b826-5cd1c585c7b1 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:15:36.286029 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20e1fc9-b97e-4e1f-b826-5cd1c585c7b1 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:15:36.291590 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:15:36.291880 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830e6c37-32c4-418d-ac65-df8a7340d900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:15:36.292808 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830e6c37-32c4-418d-ac65-df8a7340d900 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:36.293197 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830e6c37-32c4-418d-ac65-df8a7340d900 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:36.293503 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830e6c37-32c4-418d-ac65-df8a7340d900 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:36.294536 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830e6c37-32c4-418d-ac65-df8a7340d900 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:15:36.296187 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830e6c37-32c4-418d-ac65-df8a7340d900 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:15:36.300452 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 788/1582] 10.222.0.43 () {60 vars in 1152 bytes} [Wed Jun 22 10:15:36 2022] POST /identity/v3/projects => generated 383 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:15:36.305131 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f607990-e403-4226-9b39-e847d3f6b9d2 None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:36.305420 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f607990-e403-4226-9b39-e847d3f6b9d2 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:36.305729 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f607990-e403-4226-9b39-e847d3f6b9d2 None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:36.307088 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 789/1583] 10.222.0.43 () {54 vars in 961 bytes} [Wed Jun 22 10:15:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:15:36.310468 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 795/1584] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:15:36 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:15:36.310468 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830e6c37-32c4-418d-ac65-df8a7340d900 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:15:36.310695 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f607990-e403-4226-9b39-e847d3f6b9d2 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:15:36.320139 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830e6c37-32c4-418d-ac65-df8a7340d900 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:15:36.381822 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:15:36.384613 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f607990-e403-4226-9b39-e847d3f6b9d2 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:15:36.389573 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b896e85e-2da8-48e4-a4d8-b925c91e464a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:15:36.390305 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b896e85e-2da8-48e4-a4d8-b925c91e464a admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:36.390598 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b896e85e-2da8-48e4-a4d8-b925c91e464a admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:36.390810 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c30e14-5322-4365-9588-97eb4d560a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:15:36.391018 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b896e85e-2da8-48e4-a4d8-b925c91e464a admin admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:36.391582 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b896e85e-2da8-48e4-a4d8-b925c91e464a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:15:36.391766 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c30e14-5322-4365-9588-97eb4d560a0d admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:36.392191 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c30e14-5322-4365-9588-97eb4d560a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:36.392537 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c30e14-5322-4365-9588-97eb4d560a0d admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:36.393511 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c30e14-5322-4365-9588-97eb4d560a0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:15:36.393641 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b896e85e-2da8-48e4-a4d8-b925c91e464a admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:15:36.395989 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c30e14-5322-4365-9588-97eb4d560a0d admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:15:36.408411 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 790/1585] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:15:36 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:15:36.409254 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c30e14-5322-4365-9588-97eb4d560a0d admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:15:36.420773 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c30e14-5322-4365-9588-97eb4d560a0d admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:15:36.424446 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 796/1586] 10.222.0.43 () {60 vars in 1143 bytes} [Wed Jun 22 10:15:36 2022] POST /identity/v3/users => generated 289 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:15:36.424446 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b896e85e-2da8-48e4-a4d8-b925c91e464a admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:15:36.426919 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9811754d-da56-48a3-a98c-1b1e9c42aeb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:15:36.427672 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9811754d-da56-48a3-a98c-1b1e9c42aeb6 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:36.427961 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9811754d-da56-48a3-a98c-1b1e9c42aeb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:36.428218 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9811754d-da56-48a3-a98c-1b1e9c42aeb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:36.429056 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9811754d-da56-48a3-a98c-1b1e9c42aeb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:15:36.430760 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9811754d-da56-48a3-a98c-1b1e9c42aeb6 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:15:36.433793 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b896e85e-2da8-48e4-a4d8-b925c91e464a admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:15:36.438726 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f2ecbc-0077-46de-8e5d-a0dc19e4607b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:15:36.439418 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f2ecbc-0077-46de-8e5d-a0dc19e4607b admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:36.439701 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f2ecbc-0077-46de-8e5d-a0dc19e4607b admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:36.439977 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f2ecbc-0077-46de-8e5d-a0dc19e4607b admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:36.441322 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f2ecbc-0077-46de-8e5d-a0dc19e4607b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:15:36.442580 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 791/1587] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:15:36 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:15:36.442955 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f2ecbc-0077-46de-8e5d-a0dc19e4607b admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:15:36.443665 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9811754d-da56-48a3-a98c-1b1e9c42aeb6 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:15:36.455023 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9811754d-da56-48a3-a98c-1b1e9c42aeb6 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:15:36.456729 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 797/1588] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:15:36 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:15:36.459756 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f2ecbc-0077-46de-8e5d-a0dc19e4607b admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:15:36.461169 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383b0f4f-5956-4617-aecf-41d67527d59b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:15:36.461878 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383b0f4f-5956-4617-aecf-41d67527d59b admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:36.462161 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383b0f4f-5956-4617-aecf-41d67527d59b admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:36.462441 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383b0f4f-5956-4617-aecf-41d67527d59b admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:36.463168 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383b0f4f-5956-4617-aecf-41d67527d59b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:15:36.464792 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383b0f4f-5956-4617-aecf-41d67527d59b admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:15:36.471266 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f2ecbc-0077-46de-8e5d-a0dc19e4607b admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:15:36.477540 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf5088f-6d63-4ed5-9bfb-25d1349e63be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:15:36.478130 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 792/1589] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:15:36 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:15:36.478783 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf5088f-6d63-4ed5-9bfb-25d1349e63be admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:36.478966 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383b0f4f-5956-4617-aecf-41d67527d59b admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:15:36.479492 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf5088f-6d63-4ed5-9bfb-25d1349e63be admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:36.479948 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf5088f-6d63-4ed5-9bfb-25d1349e63be admin admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:36.481092 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf5088f-6d63-4ed5-9bfb-25d1349e63be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:15:36.484505 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf5088f-6d63-4ed5-9bfb-25d1349e63be admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:15:36.491577 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383b0f4f-5956-4617-aecf-41d67527d59b admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:15:36.496333 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02706096-592c-465d-ac0e-4f9c906c3721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:15:36.497231 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02706096-592c-465d-ac0e-4f9c906c3721 admin admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:36.497552 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02706096-592c-465d-ac0e-4f9c906c3721 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:36.498051 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02706096-592c-465d-ac0e-4f9c906c3721 admin admin] PATH_INFO: `/v3/projects/78629282e2b74418a2c1cdac32576ef1/users/7be3d844dcee4d19966fc7944463a0bc/roles/9f88c83743f745a9a785a2f454753f06` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:36.513870 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 798/1590] 10.222.0.43 () {60 vars in 1143 bytes} [Wed Jun 22 10:15:36 2022] POST /identity/v3/users => generated 292 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:15:36.513870 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555bdda2-041f-4b06-90e9-95fef9fab8c3 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:36.513870 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555bdda2-041f-4b06-90e9-95fef9fab8c3 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:36.513870 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555bdda2-041f-4b06-90e9-95fef9fab8c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:36.515703 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02706096-592c-465d-ac0e-4f9c906c3721 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78629282e2b74418a2c1cdac32576ef1, user_id=7be3d844dcee4d19966fc7944463a0bc, role_id=9f88c83743f745a9a785a2f454753f06)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:15:36.518430 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02706096-592c-465d-ac0e-4f9c906c3721 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:15:36.533997 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-555bdda2-041f-4b06-90e9-95fef9fab8c3 None None] MFA Rules not processed for user `158a49aa3750478a84bf71b9aad24397`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:15:36.534424 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 793/1591] 10.222.0.43 () {60 vars in 1482 bytes} [Wed Jun 22 10:15:36 2022] PUT /identity/v3/projects/78629282e2b74418a2c1cdac32576ef1/users/7be3d844dcee4d19966fc7944463a0bc/roles/9f88c83743f745a9a785a2f454753f06 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:15:36.535256 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-555bdda2-041f-4b06-90e9-95fef9fab8c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:15:36.539257 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02706096-592c-465d-ac0e-4f9c906c3721 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:15:36.609056 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02706096-592c-465d-ac0e-4f9c906c3721 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:15:36.615053 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedff8df-e46c-4bba-87be-ee2243a8db47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:15:36.616052 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedff8df-e46c-4bba-87be-ee2243a8db47 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:36.616195 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 799/1592] 10.222.0.43 () {58 vars in 1058 bytes} [Wed Jun 22 10:15:36 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:15:36.616342 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedff8df-e46c-4bba-87be-ee2243a8db47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:36.616624 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedff8df-e46c-4bba-87be-ee2243a8db47 admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:36.617368 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedff8df-e46c-4bba-87be-ee2243a8db47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:15:36.620306 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedff8df-e46c-4bba-87be-ee2243a8db47 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:15:36.620465 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555bdda2-041f-4b06-90e9-95fef9fab8c3 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:15:36.632475 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555bdda2-041f-4b06-90e9-95fef9fab8c3 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:15:36.634157 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 794/1593] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:15:36 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:15:36.635004 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedff8df-e46c-4bba-87be-ee2243a8db47 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:15:36.638642 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56390fae-e0ff-4d39-a58b-4c1b376e3ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:15:36.639317 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56390fae-e0ff-4d39-a58b-4c1b376e3ea3 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:36.639597 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56390fae-e0ff-4d39-a58b-4c1b376e3ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:36.639896 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56390fae-e0ff-4d39-a58b-4c1b376e3ea3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:36.640972 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56390fae-e0ff-4d39-a58b-4c1b376e3ea3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:15:36.642802 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56390fae-e0ff-4d39-a58b-4c1b376e3ea3 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:15:36.645399 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedff8df-e46c-4bba-87be-ee2243a8db47 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:15:36.651018 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ff5d1d-56f9-4036-ac0f-901c7955d632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:15:36.651697 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ff5d1d-56f9-4036-ac0f-901c7955d632 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:36.651983 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ff5d1d-56f9-4036-ac0f-901c7955d632 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:36.652253 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ff5d1d-56f9-4036-ac0f-901c7955d632 admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:36.652985 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ff5d1d-56f9-4036-ac0f-901c7955d632 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:15:36.656191 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 800/1594] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:15:36 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:15:36.656362 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ff5d1d-56f9-4036-ac0f-901c7955d632 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:15:36.656788 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56390fae-e0ff-4d39-a58b-4c1b376e3ea3 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:15:36.668387 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 795/1595] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:15:36 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:15:36.669273 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56390fae-e0ff-4d39-a58b-4c1b376e3ea3 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:15:36.669632 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ff5d1d-56f9-4036-ac0f-901c7955d632 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:15:36.676871 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faeafac-6267-4a7e-8973-ad1bd9856f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:15:36.677939 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faeafac-6267-4a7e-8973-ad1bd9856f10 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:36.678372 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faeafac-6267-4a7e-8973-ad1bd9856f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:36.678803 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faeafac-6267-4a7e-8973-ad1bd9856f10 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:36.679952 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faeafac-6267-4a7e-8973-ad1bd9856f10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:15:36.682673 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faeafac-6267-4a7e-8973-ad1bd9856f10 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:15:36.684064 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ff5d1d-56f9-4036-ac0f-901c7955d632 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:15:36.689123 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933808eb-e7b2-4fe5-bab8-1abfaae86bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:15:36.689820 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933808eb-e7b2-4fe5-bab8-1abfaae86bc5 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:36.690112 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933808eb-e7b2-4fe5-bab8-1abfaae86bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:36.690394 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933808eb-e7b2-4fe5-bab8-1abfaae86bc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:36.691294 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933808eb-e7b2-4fe5-bab8-1abfaae86bc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:15:36.693014 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933808eb-e7b2-4fe5-bab8-1abfaae86bc5 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:15:36.699376 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 801/1596] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:15:36 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:15:36.700757 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faeafac-6267-4a7e-8973-ad1bd9856f10 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:15:36.712077 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 796/1597] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:15:36 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:15:36.712077 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c088605-c78d-46fe-80dc-32c039ed2724 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:36.712077 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c088605-c78d-46fe-80dc-32c039ed2724 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:36.712077 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c088605-c78d-46fe-80dc-32c039ed2724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:36.718300 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faeafac-6267-4a7e-8973-ad1bd9856f10 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:15:36.724564 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd21c49-60ca-41c8-a281-23ecf4e97aa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:15:36.725325 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd21c49-60ca-41c8-a281-23ecf4e97aa1 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:36.725906 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd21c49-60ca-41c8-a281-23ecf4e97aa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:36.726445 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd21c49-60ca-41c8-a281-23ecf4e97aa1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:36.727191 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd21c49-60ca-41c8-a281-23ecf4e97aa1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:15:36.729601 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd21c49-60ca-41c8-a281-23ecf4e97aa1 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:15:36.732854 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-8c088605-c78d-46fe-80dc-32c039ed2724 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:15:36.734825 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-8c088605-c78d-46fe-80dc-32c039ed2724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:15:36.743016 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 802/1598] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:15:36 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:15:36.744815 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd21c49-60ca-41c8-a281-23ecf4e97aa1 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:15:36.746304 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 797/1599] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:15:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:15:36.747033 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c088605-c78d-46fe-80dc-32c039ed2724 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:15:36.757936 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c088605-c78d-46fe-80dc-32c039ed2724 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:15:36.762562 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdfac0f-19f3-489e-a9af-d57bcbac4919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:15:36.763479 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdfac0f-19f3-489e-a9af-d57bcbac4919 admin admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:36.763742 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdfac0f-19f3-489e-a9af-d57bcbac4919 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:36.764020 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdfac0f-19f3-489e-a9af-d57bcbac4919 admin admin] PATH_INFO: `/v3/projects/413e418950a44456839d99470ed27a69/users/d278ba2cd031466d93a83a133c61ff57/roles/9f88c83743f745a9a785a2f454753f06` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:36.765369 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd21c49-60ca-41c8-a281-23ecf4e97aa1 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:15:36.772902 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6310d55-0143-4c2e-b7f8-3048de334242 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '158a49aa3750478a84bf71b9aad24397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:15:36.773949 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6310d55-0143-4c2e-b7f8-3048de334242 service nova] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:36.774466 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6310d55-0143-4c2e-b7f8-3048de334242 service nova] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:36.774849 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6310d55-0143-4c2e-b7f8-3048de334242 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:36.779487 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:15:36.783807 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdfac0f-19f3-489e-a9af-d57bcbac4919 admin admin] RBAC: Authorizing `identity:create_grant(project_id=413e418950a44456839d99470ed27a69, user_id=d278ba2cd031466d93a83a133c61ff57, role_id=9f88c83743f745a9a785a2f454753f06)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:15:36.789912 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdfac0f-19f3-489e-a9af-d57bcbac4919 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:15:36.809185 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 798/1600] 10.222.0.43 () {60 vars in 1482 bytes} [Wed Jun 22 10:15:36 2022] PUT /identity/v3/projects/413e418950a44456839d99470ed27a69/users/d278ba2cd031466d93a83a133c61ff57/roles/9f88c83743f745a9a785a2f454753f06 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:15:36.810607 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdfac0f-19f3-489e-a9af-d57bcbac4919 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:15:36.840871 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6310d55-0143-4c2e-b7f8-3048de334242 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:15:36.842508 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6310d55-0143-4c2e-b7f8-3048de334242 service nova] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:15:36.855282 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 803/1601] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:15:36 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:15:36.855900 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6310d55-0143-4c2e-b7f8-3048de334242 service nova] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:15:36.867839 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6310d55-0143-4c2e-b7f8-3048de334242 service nova] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:15:36.881431 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:15:36.886158 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdfac0f-19f3-489e-a9af-d57bcbac4919 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:15:36.891191 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89287f32-7054-4eca-9a9b-7f1425e3972f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:15:36.891868 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89287f32-7054-4eca-9a9b-7f1425e3972f admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:36.892201 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89287f32-7054-4eca-9a9b-7f1425e3972f admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:36.892461 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89287f32-7054-4eca-9a9b-7f1425e3972f admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:36.893264 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89287f32-7054-4eca-9a9b-7f1425e3972f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:15:36.895231 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89287f32-7054-4eca-9a9b-7f1425e3972f admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:15:36.910013 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 799/1602] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:15:36 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:15:36.910907 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89287f32-7054-4eca-9a9b-7f1425e3972f admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:15:36.922414 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89287f32-7054-4eca-9a9b-7f1425e3972f admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:15:36.928388 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3ac564-57c2-4f81-a3f1-f26e30e409fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:15:36.929375 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3ac564-57c2-4f81-a3f1-f26e30e409fe admin admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:36.929664 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3ac564-57c2-4f81-a3f1-f26e30e409fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:36.930084 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3ac564-57c2-4f81-a3f1-f26e30e409fe admin admin] PATH_INFO: `/v3/projects/c3277b9cbc4b4a8bbacee8440cea1ed2/users/0d7292401816437fba46d073c4746e45/roles/9f88c83743f745a9a785a2f454753f06` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:36.940255 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaeb4a8-2406-4249-9538-af8aa7aa1bb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:15:36.941252 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaeb4a8-2406-4249-9538-af8aa7aa1bb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:36.941533 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaeb4a8-2406-4249-9538-af8aa7aa1bb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:36.941848 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaeb4a8-2406-4249-9538-af8aa7aa1bb1 admin admin] PATH_INFO: `/v3/projects/5ee9d603d9cc4a8797f55d544f189720/users/75753b29a78640df9622d4e2655baf9b/roles/9f88c83743f745a9a785a2f454753f06` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:36.947779 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3ac564-57c2-4f81-a3f1-f26e30e409fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3277b9cbc4b4a8bbacee8440cea1ed2, user_id=0d7292401816437fba46d073c4746e45, role_id=9f88c83743f745a9a785a2f454753f06)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:15:36.950941 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3ac564-57c2-4f81-a3f1-f26e30e409fe admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:15:36.958128 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaeb4a8-2406-4249-9538-af8aa7aa1bb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ee9d603d9cc4a8797f55d544f189720, user_id=75753b29a78640df9622d4e2655baf9b, role_id=9f88c83743f745a9a785a2f454753f06)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:15:36.959209 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: WARNING py.warnings [None req-cbaeb4a8-2406-4249-9538-af8aa7aa1bb1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 22 10:15:36.959209 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: warnings.warn(msg) Jun 22 10:15:36.959209 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: Jun 22 10:15:36.961100 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaeb4a8-2406-4249-9538-af8aa7aa1bb1 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:15:36.967757 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 800/1603] 10.222.0.43 () {60 vars in 1482 bytes} [Wed Jun 22 10:15:36 2022] PUT /identity/v3/projects/c3277b9cbc4b4a8bbacee8440cea1ed2/users/0d7292401816437fba46d073c4746e45/roles/9f88c83743f745a9a785a2f454753f06 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:15:36.968621 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3ac564-57c2-4f81-a3f1-f26e30e409fe admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:15:36.984744 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 804/1604] 10.222.0.43 () {60 vars in 1482 bytes} [Wed Jun 22 10:15:36 2022] PUT /identity/v3/projects/5ee9d603d9cc4a8797f55d544f189720/users/75753b29a78640df9622d4e2655baf9b/roles/9f88c83743f745a9a785a2f454753f06 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:15:36.984744 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaeb4a8-2406-4249-9538-af8aa7aa1bb1 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:15:37.049699 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaeb4a8-2406-4249-9538-af8aa7aa1bb1 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:15:37.050521 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3ac564-57c2-4f81-a3f1-f26e30e409fe admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:15:37.055424 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e253e6-0259-40fa-bb7e-e265b16cf361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:15:37.055591 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c1b98b-764a-465f-8bbe-55c352d33f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:15:37.056132 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e253e6-0259-40fa-bb7e-e265b16cf361 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:37.056414 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e253e6-0259-40fa-bb7e-e265b16cf361 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:37.056518 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c1b98b-764a-465f-8bbe-55c352d33f8b admin admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:37.056762 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c1b98b-764a-465f-8bbe-55c352d33f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:37.056864 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e253e6-0259-40fa-bb7e-e265b16cf361 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:37.057025 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c1b98b-764a-465f-8bbe-55c352d33f8b admin admin] PATH_INFO: `/v3/projects/d4765b82e21647a9b391a98f446a0e17/users/2b3af9bfaaaa4dcca0747f776115c826/roles/9f88c83743f745a9a785a2f454753f06` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:37.057525 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e253e6-0259-40fa-bb7e-e265b16cf361 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:15:37.059155 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e253e6-0259-40fa-bb7e-e265b16cf361 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:15:37.071213 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 805/1605] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:15:36 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:15:37.071992 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e253e6-0259-40fa-bb7e-e265b16cf361 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:15:37.077939 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c1b98b-764a-465f-8bbe-55c352d33f8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4765b82e21647a9b391a98f446a0e17, user_id=2b3af9bfaaaa4dcca0747f776115c826, role_id=9f88c83743f745a9a785a2f454753f06)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:15:37.080686 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c1b98b-764a-465f-8bbe-55c352d33f8b admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:15:37.102211 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 801/1606] 10.222.0.43 () {60 vars in 1482 bytes} [Wed Jun 22 10:15:36 2022] PUT /identity/v3/projects/d4765b82e21647a9b391a98f446a0e17/users/2b3af9bfaaaa4dcca0747f776115c826/roles/9f88c83743f745a9a785a2f454753f06 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:15:37.103628 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6da305-c35b-4b0c-a999-9894d08be8db None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:37.103896 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6da305-c35b-4b0c-a999-9894d08be8db None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:37.104174 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6da305-c35b-4b0c-a999-9894d08be8db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:37.140340 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-fe6da305-c35b-4b0c-a999-9894d08be8db None None] MFA Rules not processed for user `d278ba2cd031466d93a83a133c61ff57`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:15:37.142393 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-fe6da305-c35b-4b0c-a999-9894d08be8db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:15:37.149061 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e253e6-0259-40fa-bb7e-e265b16cf361 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:15:37.179056 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:15:37.204761 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a4288c-e63a-4a6b-850d-60dd505c47c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe93d4c0737249fd8623bb5ce188e34e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:15:37.205420 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a4288c-e63a-4a6b-850d-60dd505c47c5 service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:37.205735 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a4288c-e63a-4a6b-850d-60dd505c47c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:37.206019 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a4288c-e63a-4a6b-850d-60dd505c47c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:37.210374 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:15:37.212766 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 802/1607] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:15:37 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:15:37.213598 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6da305-c35b-4b0c-a999-9894d08be8db None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:15:37.273580 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a4288c-e63a-4a6b-850d-60dd505c47c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:15:37.276673 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a4288c-e63a-4a6b-850d-60dd505c47c5 service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:15:37.277743 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6da305-c35b-4b0c-a999-9894d08be8db None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:15:37.282598 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1b578f-f381-4fb6-80eb-6c559a0016e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:15:37.283523 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1b578f-f381-4fb6-80eb-6c559a0016e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:37.283813 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1b578f-f381-4fb6-80eb-6c559a0016e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:37.284094 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1b578f-f381-4fb6-80eb-6c559a0016e3 admin admin] PATH_INFO: `/v3/projects/ad52333bcbec425089c44c3e55df97ff/users/78fe3fc4334c43d7a5ef6d70f9f57523/roles/9f88c83743f745a9a785a2f454753f06` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:37.287460 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 806/1608] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:15:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:15:37.288831 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdea11b-7da5-49e8-8b4f-f39d041ceece None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:37.289126 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdea11b-7da5-49e8-8b4f-f39d041ceece None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:37.289467 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdea11b-7da5-49e8-8b4f-f39d041ceece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:37.302358 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1b578f-f381-4fb6-80eb-6c559a0016e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad52333bcbec425089c44c3e55df97ff, user_id=78fe3fc4334c43d7a5ef6d70f9f57523, role_id=9f88c83743f745a9a785a2f454753f06)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:15:37.309090 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-cfdea11b-7da5-49e8-8b4f-f39d041ceece None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:15:37.309342 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1b578f-f381-4fb6-80eb-6c559a0016e3 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:15:37.310468 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-cfdea11b-7da5-49e8-8b4f-f39d041ceece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:15:37.318883 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 807/1609] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:15:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:15:37.320135 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6403764-edd8-4e56-bd70-542ec79a4fab None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:37.320422 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6403764-edd8-4e56-bd70-542ec79a4fab None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:37.320699 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6403764-edd8-4e56-bd70-542ec79a4fab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:37.328210 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 803/1610] 10.222.0.43 () {60 vars in 1482 bytes} [Wed Jun 22 10:15:37 2022] PUT /identity/v3/projects/ad52333bcbec425089c44c3e55df97ff/users/78fe3fc4334c43d7a5ef6d70f9f57523/roles/9f88c83743f745a9a785a2f454753f06 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:15:37.329238 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1b578f-f381-4fb6-80eb-6c559a0016e3 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:15:37.342444 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-d6403764-edd8-4e56-bd70-542ec79a4fab None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:15:37.343668 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-d6403764-edd8-4e56-bd70-542ec79a4fab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:15:37.402640 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1b578f-f381-4fb6-80eb-6c559a0016e3 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:15:37.408433 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22715d5f-7e8e-4a98-9609-f14860d981ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:15:37.410095 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22715d5f-7e8e-4a98-9609-f14860d981ae admin admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:37.410696 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22715d5f-7e8e-4a98-9609-f14860d981ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:37.410991 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22715d5f-7e8e-4a98-9609-f14860d981ae admin admin] PATH_INFO: `/v3/projects/5a97feb0c6cc4ca2aa428e52e3c5c351/users/51b74e748286454682bc4067572004f7/roles/9f88c83743f745a9a785a2f454753f06` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:37.412339 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 808/1611] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:15:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:15:37.413443 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68fb0f2-7b3c-44a2-a12b-d47e0e159be5 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:37.413788 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68fb0f2-7b3c-44a2-a12b-d47e0e159be5 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:37.414136 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68fb0f2-7b3c-44a2-a12b-d47e0e159be5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:37.432407 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22715d5f-7e8e-4a98-9609-f14860d981ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a97feb0c6cc4ca2aa428e52e3c5c351, user_id=51b74e748286454682bc4067572004f7, role_id=9f88c83743f745a9a785a2f454753f06)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:15:37.435270 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22715d5f-7e8e-4a98-9609-f14860d981ae admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:15:37.435811 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-b68fb0f2-7b3c-44a2-a12b-d47e0e159be5 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:15:37.437053 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-b68fb0f2-7b3c-44a2-a12b-d47e0e159be5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:15:37.447444 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 809/1612] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:15:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:15:37.448769 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29faaab9-07a0-4086-9390-5a36c78b4dff None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:37.449059 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29faaab9-07a0-4086-9390-5a36c78b4dff None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:37.449339 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29faaab9-07a0-4086-9390-5a36c78b4dff None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:37.450820 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 810/1613] 10.222.0.43 () {54 vars in 912 bytes} [Wed Jun 22 10:15:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:15:37.454528 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29faaab9-07a0-4086-9390-5a36c78b4dff None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:15:37.461831 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 804/1614] 10.222.0.43 () {60 vars in 1482 bytes} [Wed Jun 22 10:15:37 2022] PUT /identity/v3/projects/5a97feb0c6cc4ca2aa428e52e3c5c351/users/51b74e748286454682bc4067572004f7/roles/9f88c83743f745a9a785a2f454753f06 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:15:37.462605 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22715d5f-7e8e-4a98-9609-f14860d981ae admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:15:37.530037 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:15:37.545480 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22715d5f-7e8e-4a98-9609-f14860d981ae admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:15:37.549172 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e32ea3-ded2-4f3f-b949-72667fdf9d7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe93d4c0737249fd8623bb5ce188e34e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:15:37.549892 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e32ea3-ded2-4f3f-b949-72667fdf9d7b service neutron] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:37.550190 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e32ea3-ded2-4f3f-b949-72667fdf9d7b service neutron] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:37.550481 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e32ea3-ded2-4f3f-b949-72667fdf9d7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:37.557930 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29faaab9-07a0-4086-9390-5a36c78b4dff None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:15:37.561873 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e32ea3-ded2-4f3f-b949-72667fdf9d7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:15:37.562911 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7813c0-7af9-4868-be1a-013904ebe634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:15:37.563365 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e32ea3-ded2-4f3f-b949-72667fdf9d7b service neutron] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:15:37.563576 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7813c0-7af9-4868-be1a-013904ebe634 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:37.563845 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7813c0-7af9-4868-be1a-013904ebe634 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:37.564336 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7813c0-7af9-4868-be1a-013904ebe634 admin admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:37.565122 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7813c0-7af9-4868-be1a-013904ebe634 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:15:37.568175 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7813c0-7af9-4868-be1a-013904ebe634 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:15:37.576475 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 805/1615] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:15:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:15:37.577724 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e4f91e-f1b4-4d63-b7ea-edb7552c8e12 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:37.578002 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e4f91e-f1b4-4d63-b7ea-edb7552c8e12 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:37.578877 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e4f91e-f1b4-4d63-b7ea-edb7552c8e12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:37.602814 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-d1e4f91e-f1b4-4d63-b7ea-edb7552c8e12 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:15:37.602814 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-d1e4f91e-f1b4-4d63-b7ea-edb7552c8e12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:15:37.603592 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 811/1616] 10.222.0.43 () {60 vars in 1152 bytes} [Wed Jun 22 10:15:37 2022] POST /identity/v3/projects => generated 379 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:15:37.605131 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7813c0-7af9-4868-be1a-013904ebe634 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:15:37.625020 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:15:37.696253 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 806/1617] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:15:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:15:37.698233 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b77d6a-76ca-46bf-9de5-9e2c56d86351 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:37.698879 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b77d6a-76ca-46bf-9de5-9e2c56d86351 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:37.699490 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b77d6a-76ca-46bf-9de5-9e2c56d86351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:37.702098 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7813c0-7af9-4868-be1a-013904ebe634 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:15:37.706629 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62fb083-5a90-4135-baa6-e85f5738bcee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe93d4c0737249fd8623bb5ce188e34e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:15:37.707289 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62fb083-5a90-4135-baa6-e85f5738bcee service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:37.707568 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62fb083-5a90-4135-baa6-e85f5738bcee service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:37.707850 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62fb083-5a90-4135-baa6-e85f5738bcee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:37.722992 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62fb083-5a90-4135-baa6-e85f5738bcee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:15:37.725461 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62fb083-5a90-4135-baa6-e85f5738bcee service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:15:37.733618 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-e6b77d6a-76ca-46bf-9de5-9e2c56d86351 None None] MFA Rules not processed for user `158a49aa3750478a84bf71b9aad24397`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:15:37.735392 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-e6b77d6a-76ca-46bf-9de5-9e2c56d86351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:15:37.739391 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 812/1618] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:15:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:15:37.740552 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62fb083-5a90-4135-baa6-e85f5738bcee service neutron] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:15:37.752002 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62fb083-5a90-4135-baa6-e85f5738bcee service neutron] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:15:37.757083 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e50a54-b816-4b4e-9d4b-3fb1b328133e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe93d4c0737249fd8623bb5ce188e34e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:15:37.758013 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e50a54-b816-4b4e-9d4b-3fb1b328133e service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:37.758465 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e50a54-b816-4b4e-9d4b-3fb1b328133e service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:37.758909 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e50a54-b816-4b4e-9d4b-3fb1b328133e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:37.770908 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e50a54-b816-4b4e-9d4b-3fb1b328133e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:15:37.773140 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e50a54-b816-4b4e-9d4b-3fb1b328133e service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:15:37.788715 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 813/1619] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:15:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:15:37.790270 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151bd636-617f-4401-a473-5f54e4308cbe None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:37.790676 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151bd636-617f-4401-a473-5f54e4308cbe None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:37.791022 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151bd636-617f-4401-a473-5f54e4308cbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:37.830614 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-151bd636-617f-4401-a473-5f54e4308cbe None None] MFA Rules not processed for user `51b74e748286454682bc4067572004f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:15:37.833741 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-151bd636-617f-4401-a473-5f54e4308cbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:15:37.885444 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 807/1620] 10.222.0.43 () {58 vars in 1009 bytes} [Wed Jun 22 10:15:37 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:15:37.886478 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b77d6a-76ca-46bf-9de5-9e2c56d86351 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:15:37.913103 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b77d6a-76ca-46bf-9de5-9e2c56d86351 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:15:37.920003 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f06710f-09a0-4559-b862-405a5ac9c369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:15:37.920876 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f06710f-09a0-4559-b862-405a5ac9c369 admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:37.921604 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f06710f-09a0-4559-b862-405a5ac9c369 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:37.921604 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f06710f-09a0-4559-b862-405a5ac9c369 admin admin] PATH_INFO: `/v3/users` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:37.922729 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f06710f-09a0-4559-b862-405a5ac9c369 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:15:37.925781 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f06710f-09a0-4559-b862-405a5ac9c369 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:15:37.949366 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 814/1621] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:15:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:15:37.950596 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151bd636-617f-4401-a473-5f54e4308cbe None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:15:37.957724 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 808/1622] 10.222.0.43 () {60 vars in 1143 bytes} [Wed Jun 22 10:15:37 2022] POST /identity/v3/users => generated 296 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:15:37.961850 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151bd636-617f-4401-a473-5f54e4308cbe None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:15:37.962172 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f06710f-09a0-4559-b862-405a5ac9c369 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:15:37.966882 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d58025-4834-4d91-8db7-aa664b628339 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe93d4c0737249fd8623bb5ce188e34e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:15:37.967938 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d58025-4834-4d91-8db7-aa664b628339 service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:37.968349 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d58025-4834-4d91-8db7-aa664b628339 service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:37.969081 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d58025-4834-4d91-8db7-aa664b628339 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:37.985478 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d58025-4834-4d91-8db7-aa664b628339 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:15:37.988551 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d58025-4834-4d91-8db7-aa664b628339 service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:15:38.003438 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 815/1623] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:15:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:15:38.005038 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d58025-4834-4d91-8db7-aa664b628339 service neutron] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:15:38.018142 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d58025-4834-4d91-8db7-aa664b628339 service neutron] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:15:38.026121 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b31f45-b40f-467c-a11f-14012a9a4077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:15:38.027864 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b31f45-b40f-467c-a11f-14012a9a4077 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:38.028154 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b31f45-b40f-467c-a11f-14012a9a4077 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:38.028433 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b31f45-b40f-467c-a11f-14012a9a4077 admin admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:38.029194 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b31f45-b40f-467c-a11f-14012a9a4077 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:15:38.031549 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b31f45-b40f-467c-a11f-14012a9a4077 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:15:38.063324 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f06710f-09a0-4559-b862-405a5ac9c369 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:15:38.068529 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50eb79a2-2335-4dc8-a6dd-7ae08e98eb2f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bbcb3d4dc704dfdb0097abc594ca855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:15:38.069545 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eb79a2-2335-4dc8-a6dd-7ae08e98eb2f service cinder] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:38.069882 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eb79a2-2335-4dc8-a6dd-7ae08e98eb2f service cinder] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:38.070359 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eb79a2-2335-4dc8-a6dd-7ae08e98eb2f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:38.072372 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 816/1624] 10.222.0.43 () {60 vars in 1152 bytes} [Wed Jun 22 10:15:38 2022] POST /identity/v3/projects => generated 387 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:15:38.073864 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b31f45-b40f-467c-a11f-14012a9a4077 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:15:38.089866 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50eb79a2-2335-4dc8-a6dd-7ae08e98eb2f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:15:38.089866 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50eb79a2-2335-4dc8-a6dd-7ae08e98eb2f service cinder] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:15:38.105522 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 809/1625] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:15:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:15:38.106667 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50eb79a2-2335-4dc8-a6dd-7ae08e98eb2f service cinder] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:15:38.113122 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:15:38.119808 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50eb79a2-2335-4dc8-a6dd-7ae08e98eb2f service cinder] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:15:38.193327 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:15:38.200285 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b31f45-b40f-467c-a11f-14012a9a4077 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:15:38.208629 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5da200-8020-47df-8419-d092e2c613c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:15:38.209486 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5da200-8020-47df-8419-d092e2c613c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:38.209887 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5da200-8020-47df-8419-d092e2c613c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:38.210182 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5da200-8020-47df-8419-d092e2c613c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:38.210929 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5da200-8020-47df-8419-d092e2c613c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:15:38.213848 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5da200-8020-47df-8419-d092e2c613c5 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:15:38.233635 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 817/1626] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:15:38 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:15:38.234174 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36085929-0267-49ee-a1dc-6da18e48d628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:15:38.234892 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5da200-8020-47df-8419-d092e2c613c5 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:15:38.235552 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36085929-0267-49ee-a1dc-6da18e48d628 admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:38.235927 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36085929-0267-49ee-a1dc-6da18e48d628 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:38.236857 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36085929-0267-49ee-a1dc-6da18e48d628 admin admin] PATH_INFO: `/v3/users` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:38.240595 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36085929-0267-49ee-a1dc-6da18e48d628 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:15:38.244436 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36085929-0267-49ee-a1dc-6da18e48d628 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:15:38.257401 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5da200-8020-47df-8419-d092e2c613c5 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:15:38.269501 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f55c00-9e74-4069-acb4-586bf58eab8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:15:38.272290 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f55c00-9e74-4069-acb4-586bf58eab8d admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:38.272644 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f55c00-9e74-4069-acb4-586bf58eab8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:38.272933 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f55c00-9e74-4069-acb4-586bf58eab8d admin admin] PATH_INFO: `/v3/projects/7859dca5fd7a4dd28b7c9b303bfa5817/users/1c1b8a040ee142f880bc2fcc4b204dd2/roles/26d9c2ab5dfc4e6d9ca80c6014123906` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:38.289752 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 810/1627] 10.222.0.43 () {60 vars in 1143 bytes} [Wed Jun 22 10:15:38 2022] POST /identity/v3/users => generated 300 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:15:38.293639 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36085929-0267-49ee-a1dc-6da18e48d628 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:15:38.307143 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36085929-0267-49ee-a1dc-6da18e48d628 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:15:38.311433 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f55c00-9e74-4069-acb4-586bf58eab8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7859dca5fd7a4dd28b7c9b303bfa5817, user_id=1c1b8a040ee142f880bc2fcc4b204dd2, role_id=26d9c2ab5dfc4e6d9ca80c6014123906)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:15:38.321788 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f55c00-9e74-4069-acb4-586bf58eab8d admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:15:38.343093 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 818/1628] 10.222.0.43 () {60 vars in 1482 bytes} [Wed Jun 22 10:15:38 2022] PUT /identity/v3/projects/7859dca5fd7a4dd28b7c9b303bfa5817/users/1c1b8a040ee142f880bc2fcc4b204dd2/roles/26d9c2ab5dfc4e6d9ca80c6014123906 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:15:38.347785 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f55c00-9e74-4069-acb4-586bf58eab8d admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:15:38.347933 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9a45cc-c1bc-4c88-8081-21e52491f154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:15:38.348771 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9a45cc-c1bc-4c88-8081-21e52491f154 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:38.349342 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9a45cc-c1bc-4c88-8081-21e52491f154 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:38.349623 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9a45cc-c1bc-4c88-8081-21e52491f154 admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:38.350413 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9a45cc-c1bc-4c88-8081-21e52491f154 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:15:38.352033 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9a45cc-c1bc-4c88-8081-21e52491f154 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:15:38.383317 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 811/1629] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:15:38 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:15:38.384300 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9a45cc-c1bc-4c88-8081-21e52491f154 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:15:38.407023 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9a45cc-c1bc-4c88-8081-21e52491f154 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:15:38.504045 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f55c00-9e74-4069-acb4-586bf58eab8d admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:15:38.519691 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50136275-0cb2-486d-b1da-b15035be3a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:15:38.522552 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50136275-0cb2-486d-b1da-b15035be3a19 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:38.523012 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50136275-0cb2-486d-b1da-b15035be3a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:38.523439 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50136275-0cb2-486d-b1da-b15035be3a19 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:38.524456 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50136275-0cb2-486d-b1da-b15035be3a19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:15:38.527475 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50136275-0cb2-486d-b1da-b15035be3a19 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:15:38.546785 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f816685e-4ded-4c48-a995-2586bc7bed82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:15:38.546785 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f816685e-4ded-4c48-a995-2586bc7bed82 admin admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:38.546785 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f816685e-4ded-4c48-a995-2586bc7bed82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:38.546785 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f816685e-4ded-4c48-a995-2586bc7bed82 admin admin] PATH_INFO: `/v3/projects/02163a91ad6249beb322641d082c9a85/users/507fbbcb00a54848adb48bd820f7eecf/roles/26d9c2ab5dfc4e6d9ca80c6014123906` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:38.561565 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 819/1630] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:15:38 2022] GET /identity/v3/roles => generated 1420 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 10:15:38.566703 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50136275-0cb2-486d-b1da-b15035be3a19 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:15:38.580420 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50136275-0cb2-486d-b1da-b15035be3a19 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:15:38.590287 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68a6fea-19bd-42b9-aad0-f75da3caf839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:15:38.591593 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68a6fea-19bd-42b9-aad0-f75da3caf839 admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:38.592211 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68a6fea-19bd-42b9-aad0-f75da3caf839 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:38.592805 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68a6fea-19bd-42b9-aad0-f75da3caf839 admin admin] PATH_INFO: `/v3/projects/7859dca5fd7a4dd28b7c9b303bfa5817/users/1c1b8a040ee142f880bc2fcc4b204dd2/roles/26d9c2ab5dfc4e6d9ca80c6014123906` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:38.595465 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f816685e-4ded-4c48-a995-2586bc7bed82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02163a91ad6249beb322641d082c9a85, user_id=507fbbcb00a54848adb48bd820f7eecf, role_id=26d9c2ab5dfc4e6d9ca80c6014123906)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:15:38.596417 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68a6fea-19bd-42b9-aad0-f75da3caf839 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7859dca5fd7a4dd28b7c9b303bfa5817, user_id=1c1b8a040ee142f880bc2fcc4b204dd2, role_id=26d9c2ab5dfc4e6d9ca80c6014123906)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:15:38.601316 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68a6fea-19bd-42b9-aad0-f75da3caf839 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:15:38.601881 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f816685e-4ded-4c48-a995-2586bc7bed82 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:15:38.631027 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 820/1631] 10.222.0.43 () {60 vars in 1482 bytes} [Wed Jun 22 10:15:38 2022] PUT /identity/v3/projects/7859dca5fd7a4dd28b7c9b303bfa5817/users/1c1b8a040ee142f880bc2fcc4b204dd2/roles/26d9c2ab5dfc4e6d9ca80c6014123906 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:15:38.632838 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db31c462-1319-4de3-8d6c-9f6d26db33aa None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:38.633038 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db31c462-1319-4de3-8d6c-9f6d26db33aa None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:38.633292 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db31c462-1319-4de3-8d6c-9f6d26db33aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:38.637571 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 812/1632] 10.222.0.43 () {60 vars in 1482 bytes} [Wed Jun 22 10:15:38 2022] PUT /identity/v3/projects/02163a91ad6249beb322641d082c9a85/users/507fbbcb00a54848adb48bd820f7eecf/roles/26d9c2ab5dfc4e6d9ca80c6014123906 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:15:38.643444 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f816685e-4ded-4c48-a995-2586bc7bed82 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:15:38.669478 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-db31c462-1319-4de3-8d6c-9f6d26db33aa None None] MFA Rules not processed for user `1c1b8a040ee142f880bc2fcc4b204dd2`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:15:38.670876 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-db31c462-1319-4de3-8d6c-9f6d26db33aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:15:38.759514 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f816685e-4ded-4c48-a995-2586bc7bed82 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:15:38.764435 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a7fa48-fec8-484f-a6ca-50692557cab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:15:38.765125 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a7fa48-fec8-484f-a6ca-50692557cab6 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:38.765408 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a7fa48-fec8-484f-a6ca-50692557cab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:38.765704 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a7fa48-fec8-484f-a6ca-50692557cab6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:38.766471 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a7fa48-fec8-484f-a6ca-50692557cab6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:15:38.768112 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a7fa48-fec8-484f-a6ca-50692557cab6 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:15:38.774262 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:15:38.780278 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 813/1633] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:15:38 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:15:38.786950 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a7fa48-fec8-484f-a6ca-50692557cab6 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:15:38.801272 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a7fa48-fec8-484f-a6ca-50692557cab6 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:15:38.806359 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c517ccc-27cb-436c-9de5-0315ff3c4868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:15:38.807263 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c517ccc-27cb-436c-9de5-0315ff3c4868 admin admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:38.807545 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c517ccc-27cb-436c-9de5-0315ff3c4868 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:38.807821 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c517ccc-27cb-436c-9de5-0315ff3c4868 admin admin] PATH_INFO: `/v3/projects/02163a91ad6249beb322641d082c9a85/users/507fbbcb00a54848adb48bd820f7eecf/roles/26d9c2ab5dfc4e6d9ca80c6014123906` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:38.810189 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c517ccc-27cb-436c-9de5-0315ff3c4868 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02163a91ad6249beb322641d082c9a85, user_id=507fbbcb00a54848adb48bd820f7eecf, role_id=26d9c2ab5dfc4e6d9ca80c6014123906)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:15:38.813770 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c517ccc-27cb-436c-9de5-0315ff3c4868 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:15:38.816170 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 821/1634] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:15:38 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:15:38.822299 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db31c462-1319-4de3-8d6c-9f6d26db33aa None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:15:38.836896 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 814/1635] 10.222.0.43 () {60 vars in 1482 bytes} [Wed Jun 22 10:15:38 2022] PUT /identity/v3/projects/02163a91ad6249beb322641d082c9a85/users/507fbbcb00a54848adb48bd820f7eecf/roles/26d9c2ab5dfc4e6d9ca80c6014123906 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:15:38.838857 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca7af23-0bc2-40d4-be31-766239257d44 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:38.839151 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca7af23-0bc2-40d4-be31-766239257d44 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:38.839509 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca7af23-0bc2-40d4-be31-766239257d44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:38.883102 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-0ca7af23-0bc2-40d4-be31-766239257d44 None None] MFA Rules not processed for user `507fbbcb00a54848adb48bd820f7eecf`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:15:38.884504 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-0ca7af23-0bc2-40d4-be31-766239257d44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:15:38.923258 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:15:38.961968 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db31c462-1319-4de3-8d6c-9f6d26db33aa None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:15:38.982384 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 815/1636] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:15:38 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:15:39.050349 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca7af23-0bc2-40d4-be31-766239257d44 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:15:39.081662 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c488ff-bb75-4f63-b8f9-47af9e84e4ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bbcb3d4dc704dfdb0097abc594ca855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:15:39.082427 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c488ff-bb75-4f63-b8f9-47af9e84e4ed service cinder] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:39.082719 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c488ff-bb75-4f63-b8f9-47af9e84e4ed service cinder] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:39.082999 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c488ff-bb75-4f63-b8f9-47af9e84e4ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:39.192410 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca7af23-0bc2-40d4-be31-766239257d44 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:15:39.216505 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c488ff-bb75-4f63-b8f9-47af9e84e4ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:15:39.217868 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db0425e-ed1d-4192-a915-a887af568658 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bbcb3d4dc704dfdb0097abc594ca855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:15:39.218030 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c488ff-bb75-4f63-b8f9-47af9e84e4ed service cinder] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:15:39.219735 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db0425e-ed1d-4192-a915-a887af568658 service cinder] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:39.223009 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db0425e-ed1d-4192-a915-a887af568658 service cinder] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:39.224753 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db0425e-ed1d-4192-a915-a887af568658 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:39.239728 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 822/1637] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:15:38 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:15:39.254873 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db0425e-ed1d-4192-a915-a887af568658 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:15:39.256377 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db0425e-ed1d-4192-a915-a887af568658 service cinder] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:15:39.269577 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 816/1638] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:15:39 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 10:15:39.317365 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c488ff-bb75-4f63-b8f9-47af9e84e4ed service cinder] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:15:39.425417 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db0425e-ed1d-4192-a915-a887af568658 service cinder] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:15:39.434911 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db0425e-ed1d-4192-a915-a887af568658 service cinder] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:15:39.459382 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aaef1f-0b1b-429e-bd03-bc706b4beb72 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bbcb3d4dc704dfdb0097abc594ca855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:15:39.460066 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aaef1f-0b1b-429e-bd03-bc706b4beb72 service cinder] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:39.460359 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aaef1f-0b1b-429e-bd03-bc706b4beb72 service cinder] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:39.460652 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aaef1f-0b1b-429e-bd03-bc706b4beb72 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:39.478768 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c488ff-bb75-4f63-b8f9-47af9e84e4ed service cinder] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:15:39.487212 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66d3af3-7dd5-4a0b-b4e8-3c45ea786f56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:15:39.490235 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66d3af3-7dd5-4a0b-b4e8-3c45ea786f56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:39.490710 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66d3af3-7dd5-4a0b-b4e8-3c45ea786f56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:39.491182 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66d3af3-7dd5-4a0b-b4e8-3c45ea786f56 admin admin] PATH_INFO: `/v3/users/51b74e748286454682bc4067572004f7` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:39.496426 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66d3af3-7dd5-4a0b-b4e8-3c45ea786f56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=51b74e748286454682bc4067572004f7)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:15:39.497843 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: WARNING py.warnings [None req-a66d3af3-7dd5-4a0b-b4e8-3c45ea786f56 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 22 10:15:39.497843 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: warnings.warn(msg) Jun 22 10:15:39.497843 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: Jun 22 10:15:39.499553 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66d3af3-7dd5-4a0b-b4e8-3c45ea786f56 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:15:39.603923 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10aaef1f-0b1b-429e-bd03-bc706b4beb72 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:15:39.607671 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10aaef1f-0b1b-429e-bd03-bc706b4beb72 service cinder] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:15:39.631096 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:15:39.635683 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-a66d3af3-7dd5-4a0b-b4e8-3c45ea786f56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51b74e748286454682bc4067572004f7'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:15:39.639966 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 817/1639] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:15:39 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:15:39.695215 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-a66d3af3-7dd5-4a0b-b4e8-3c45ea786f56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51b74e748286454682bc4067572004f7'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:15:39.708965 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-a66d3af3-7dd5-4a0b-b4e8-3c45ea786f56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51b74e748286454682bc4067572004f7'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:15:39.709647 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-a66d3af3-7dd5-4a0b-b4e8-3c45ea786f56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51b74e748286454682bc4067572004f7'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:15:39.731964 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-a66d3af3-7dd5-4a0b-b4e8-3c45ea786f56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51b74e748286454682bc4067572004f7'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:15:39.745675 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 823/1640] 10.222.0.43 () {58 vars in 1223 bytes} [Wed Jun 22 10:15:39 2022] DELETE /identity/v3/users/51b74e748286454682bc4067572004f7 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:15:39.750736 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70e8e8b-4f77-4801-ad38-6770454f8ea0 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:39.751328 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70e8e8b-4f77-4801-ad38-6770454f8ea0 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:39.751848 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70e8e8b-4f77-4801-ad38-6770454f8ea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:39.789111 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-d70e8e8b-4f77-4801-ad38-6770454f8ea0 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:15:39.791903 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-d70e8e8b-4f77-4801-ad38-6770454f8ea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:15:39.820564 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:15:39.960236 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 818/1641] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:15:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:15:39.965896 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d625f084-8da8-42cd-a2ca-06838bcdb8b2 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:39.966478 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d625f084-8da8-42cd-a2ca-06838bcdb8b2 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:39.966478 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d625f084-8da8-42cd-a2ca-06838bcdb8b2 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:39.968183 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 824/1642] 10.222.0.43 () {54 vars in 961 bytes} [Wed Jun 22 10:15:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:15:39.982895 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d625f084-8da8-42cd-a2ca-06838bcdb8b2 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:15:39.984342 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55728ac0-37c5-4707-aff6-a17fb8931e69 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:39.985033 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55728ac0-37c5-4707-aff6-a17fb8931e69 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:39.985033 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55728ac0-37c5-4707-aff6-a17fb8931e69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:39.986611 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-d625f084-8da8-42cd-a2ca-06838bcdb8b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:15:40.072572 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-55728ac0-37c5-4707-aff6-a17fb8931e69 None None] MFA Rules not processed for user `158a49aa3750478a84bf71b9aad24397`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:15:40.078857 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-55728ac0-37c5-4707-aff6-a17fb8931e69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:15:40.085057 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d625f084-8da8-42cd-a2ca-06838bcdb8b2 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:15:40.095087 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caee226b-f489-440d-8ed3-74968c082e21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe93d4c0737249fd8623bb5ce188e34e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:15:40.095897 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caee226b-f489-440d-8ed3-74968c082e21 service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:40.096322 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caee226b-f489-440d-8ed3-74968c082e21 service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:40.096800 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caee226b-f489-440d-8ed3-74968c082e21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:40.126116 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caee226b-f489-440d-8ed3-74968c082e21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:15:40.132998 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caee226b-f489-440d-8ed3-74968c082e21 service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:15:40.163310 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 825/1643] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:15:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:15:40.263140 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 819/1644] 10.222.0.43 () {58 vars in 1058 bytes} [Wed Jun 22 10:15:39 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:15:40.275157 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656c2795-a1b7-44c6-a3fb-8c450ef66ed1 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:40.275455 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656c2795-a1b7-44c6-a3fb-8c450ef66ed1 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:40.275747 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656c2795-a1b7-44c6-a3fb-8c450ef66ed1 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:40.277181 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 826/1645] 10.222.0.43 () {54 vars in 912 bytes} [Wed Jun 22 10:15:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 10:15:40.282962 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986a8995-0020-4fd3-a0d8-6196cbae4c00 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:40.283343 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986a8995-0020-4fd3-a0d8-6196cbae4c00 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:40.284874 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986a8995-0020-4fd3-a0d8-6196cbae4c00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:40.315535 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-986a8995-0020-4fd3-a0d8-6196cbae4c00 None None] MFA Rules not processed for user `158a49aa3750478a84bf71b9aad24397`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:15:40.317533 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-986a8995-0020-4fd3-a0d8-6196cbae4c00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:15:40.334190 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 820/1646] 10.222.0.43 () {58 vars in 1009 bytes} [Wed Jun 22 10:15:40 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:15:40.351679 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656c2795-a1b7-44c6-a3fb-8c450ef66ed1 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:15:40.353572 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-656c2795-a1b7-44c6-a3fb-8c450ef66ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:15:40.504058 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656c2795-a1b7-44c6-a3fb-8c450ef66ed1 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:15:40.504058 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a665f21-91d5-4c45-b4a1-5d9687992f11 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bbcb3d4dc704dfdb0097abc594ca855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:15:40.504058 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a665f21-91d5-4c45-b4a1-5d9687992f11 service cinder] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:40.504058 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a665f21-91d5-4c45-b4a1-5d9687992f11 service cinder] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:40.505625 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a665f21-91d5-4c45-b4a1-5d9687992f11 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:40.526875 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a665f21-91d5-4c45-b4a1-5d9687992f11 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:15:40.542172 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a665f21-91d5-4c45-b4a1-5d9687992f11 service cinder] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:15:40.564975 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 827/1647] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:15:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:15:41.674137 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986a8995-0020-4fd3-a0d8-6196cbae4c00 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:15:41.675665 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-986a8995-0020-4fd3-a0d8-6196cbae4c00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:15:41.699633 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986a8995-0020-4fd3-a0d8-6196cbae4c00 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:15:41.718432 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79e9d37-8ff1-4563-8cec-878f173fa77e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:15:41.723350 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79e9d37-8ff1-4563-8cec-878f173fa77e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:41.723911 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79e9d37-8ff1-4563-8cec-878f173fa77e admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:41.724434 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79e9d37-8ff1-4563-8cec-878f173fa77e admin admin] PATH_INFO: `/v3/projects/5a97feb0c6cc4ca2aa428e52e3c5c351` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:41.750464 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79e9d37-8ff1-4563-8cec-878f173fa77e admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a97feb0c6cc4ca2aa428e52e3c5c351)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:15:41.758586 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: WARNING py.warnings [None req-e79e9d37-8ff1-4563-8cec-878f173fa77e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 22 10:15:41.758586 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: warnings.warn(msg) Jun 22 10:15:41.758586 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: Jun 22 10:15:41.765586 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79e9d37-8ff1-4563-8cec-878f173fa77e admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:15:42.022476 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-e79e9d37-8ff1-4563-8cec-878f173fa77e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a97feb0c6cc4ca2aa428e52e3c5c351', 'request_id': 'req-e79e9d37-8ff1-4563-8cec-878f173fa77e'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:15:42.059159 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-e79e9d37-8ff1-4563-8cec-878f173fa77e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a97feb0c6cc4ca2aa428e52e3c5c351', 'request_id': 'req-e79e9d37-8ff1-4563-8cec-878f173fa77e'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:15:42.095410 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-e79e9d37-8ff1-4563-8cec-878f173fa77e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a97feb0c6cc4ca2aa428e52e3c5c351', 'request_id': 'req-e79e9d37-8ff1-4563-8cec-878f173fa77e'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:15:42.135083 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-e79e9d37-8ff1-4563-8cec-878f173fa77e admin admin] The token cache is being invalidate because project 5a97feb0c6cc4ca2aa428e52e3c5c351 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:15:42.135654 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-e79e9d37-8ff1-4563-8cec-878f173fa77e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:15:42.138141 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-e79e9d37-8ff1-4563-8cec-878f173fa77e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:15:42.144979 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a665f21-91d5-4c45-b4a1-5d9687992f11 service cinder] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:15:42.145571 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 821/1648] 10.222.0.43 () {58 vars in 1232 bytes} [Wed Jun 22 10:15:41 2022] DELETE /identity/v3/projects/5a97feb0c6cc4ca2aa428e52e3c5c351 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:15:42.160532 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a665f21-91d5-4c45-b4a1-5d9687992f11 service cinder] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:15:42.276391 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3430ec-3c8d-4777-bef5-a9a3dcf94ed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:15:42.277464 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3430ec-3c8d-4777-bef5-a9a3dcf94ed4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:42.277791 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3430ec-3c8d-4777-bef5-a9a3dcf94ed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:42.278079 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3430ec-3c8d-4777-bef5-a9a3dcf94ed4 admin admin] PATH_INFO: `/v3/users/507fbbcb00a54848adb48bd820f7eecf` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:42.279765 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3430ec-3c8d-4777-bef5-a9a3dcf94ed4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=507fbbcb00a54848adb48bd820f7eecf)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:15:42.283240 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3430ec-3c8d-4777-bef5-a9a3dcf94ed4 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:15:42.301448 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:15:42.399240 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-5a3430ec-3c8d-4777-bef5-a9a3dcf94ed4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '507fbbcb00a54848adb48bd820f7eecf'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:15:42.417313 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-5a3430ec-3c8d-4777-bef5-a9a3dcf94ed4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '507fbbcb00a54848adb48bd820f7eecf'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:15:42.459910 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-5a3430ec-3c8d-4777-bef5-a9a3dcf94ed4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '507fbbcb00a54848adb48bd820f7eecf'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:15:42.460676 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-5a3430ec-3c8d-4777-bef5-a9a3dcf94ed4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '507fbbcb00a54848adb48bd820f7eecf'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:15:42.470719 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-5a3430ec-3c8d-4777-bef5-a9a3dcf94ed4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '507fbbcb00a54848adb48bd820f7eecf'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:15:42.479623 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 828/1649] 10.222.0.43 () {58 vars in 1223 bytes} [Wed Jun 22 10:15:42 2022] DELETE /identity/v3/users/507fbbcb00a54848adb48bd820f7eecf => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:15:45.125123 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79e9d37-8ff1-4563-8cec-878f173fa77e admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:15:45.126270 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-e79e9d37-8ff1-4563-8cec-878f173fa77e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:15:45.157088 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79e9d37-8ff1-4563-8cec-878f173fa77e admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:15:45.211057 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:15:45.334085 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39122ce5-99bd-4615-b011-3d2bef33cfd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:15:45.338916 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39122ce5-99bd-4615-b011-3d2bef33cfd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:45.340017 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39122ce5-99bd-4615-b011-3d2bef33cfd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:45.340480 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39122ce5-99bd-4615-b011-3d2bef33cfd7 admin admin] PATH_INFO: `/v3/projects/02163a91ad6249beb322641d082c9a85` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:45.347518 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39122ce5-99bd-4615-b011-3d2bef33cfd7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=02163a91ad6249beb322641d082c9a85)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:15:45.350978 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39122ce5-99bd-4615-b011-3d2bef33cfd7 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:15:45.446722 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-39122ce5-99bd-4615-b011-3d2bef33cfd7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02163a91ad6249beb322641d082c9a85', 'request_id': 'req-39122ce5-99bd-4615-b011-3d2bef33cfd7'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:15:45.461239 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-39122ce5-99bd-4615-b011-3d2bef33cfd7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02163a91ad6249beb322641d082c9a85', 'request_id': 'req-39122ce5-99bd-4615-b011-3d2bef33cfd7'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:15:45.470833 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-39122ce5-99bd-4615-b011-3d2bef33cfd7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02163a91ad6249beb322641d082c9a85', 'request_id': 'req-39122ce5-99bd-4615-b011-3d2bef33cfd7'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:15:45.512241 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-39122ce5-99bd-4615-b011-3d2bef33cfd7 admin admin] The token cache is being invalidate because project 02163a91ad6249beb322641d082c9a85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:15:45.512583 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-39122ce5-99bd-4615-b011-3d2bef33cfd7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:15:45.520906 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-39122ce5-99bd-4615-b011-3d2bef33cfd7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:15:45.526885 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 822/1650] 10.222.0.43 () {58 vars in 1232 bytes} [Wed Jun 22 10:15:45 2022] DELETE /identity/v3/projects/02163a91ad6249beb322641d082c9a85 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:15:45.531651 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63badbc5-f769-4bf0-a892-af9c3c3d5be6 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:45.532082 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63badbc5-f769-4bf0-a892-af9c3c3d5be6 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:45.532432 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63badbc5-f769-4bf0-a892-af9c3c3d5be6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:45.577868 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-63badbc5-f769-4bf0-a892-af9c3c3d5be6 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:15:45.579502 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-63badbc5-f769-4bf0-a892-af9c3c3d5be6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:15:45.784049 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 829/1651] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:15:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:15:45.792108 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2081e623-e26a-4d39-b166-f36a2b2268a4 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:45.792772 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2081e623-e26a-4d39-b166-f36a2b2268a4 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:45.793238 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2081e623-e26a-4d39-b166-f36a2b2268a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:45.851880 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-2081e623-e26a-4d39-b166-f36a2b2268a4 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:15:45.855107 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-2081e623-e26a-4d39-b166-f36a2b2268a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:15:45.883459 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 823/1652] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:15:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:15:45.886685 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63badbc5-f769-4bf0-a892-af9c3c3d5be6 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:15:45.924332 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63badbc5-f769-4bf0-a892-af9c3c3d5be6 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:15:45.931755 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312abb4d-6c6d-4248-8d29-8b3ec81d68da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:15:45.932621 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312abb4d-6c6d-4248-8d29-8b3ec81d68da admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:45.933011 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312abb4d-6c6d-4248-8d29-8b3ec81d68da admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:45.933892 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312abb4d-6c6d-4248-8d29-8b3ec81d68da admin admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:45.935826 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312abb4d-6c6d-4248-8d29-8b3ec81d68da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:15:45.937055 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312abb4d-6c6d-4248-8d29-8b3ec81d68da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:15:45.940427 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312abb4d-6c6d-4248-8d29-8b3ec81d68da admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:15:45.976710 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 830/1653] 10.222.0.43 () {58 vars in 1152 bytes} [Wed Jun 22 10:15:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:15:45.979854 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2081e623-e26a-4d39-b166-f36a2b2268a4 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:15:46.013434 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2081e623-e26a-4d39-b166-f36a2b2268a4 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:15:46.027604 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db3d682-0b79-4929-9557-134fbc7630ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:15:46.029571 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db3d682-0b79-4929-9557-134fbc7630ab admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:46.030379 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db3d682-0b79-4929-9557-134fbc7630ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:46.031534 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db3d682-0b79-4929-9557-134fbc7630ab admin admin] PATH_INFO: `/v3/projects` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:46.032682 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db3d682-0b79-4929-9557-134fbc7630ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:15:46.050845 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db3d682-0b79-4929-9557-134fbc7630ab admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:15:46.142416 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 824/1654] 10.222.0.43 () {60 vars in 1152 bytes} [Wed Jun 22 10:15:45 2022] POST /identity/v3/projects => generated 379 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:15:46.146813 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312abb4d-6c6d-4248-8d29-8b3ec81d68da admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:15:46.169956 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312abb4d-6c6d-4248-8d29-8b3ec81d68da admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:15:46.299131 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baad15c6-0497-4194-8944-610a36280c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:15:46.299893 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baad15c6-0497-4194-8944-610a36280c00 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:46.301220 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baad15c6-0497-4194-8944-610a36280c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:46.301420 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baad15c6-0497-4194-8944-610a36280c00 admin admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:46.302256 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baad15c6-0497-4194-8944-610a36280c00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:15:46.312204 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baad15c6-0497-4194-8944-610a36280c00 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:15:46.379983 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 831/1655] 10.222.0.43 () {60 vars in 1143 bytes} [Wed Jun 22 10:15:46 2022] POST /identity/v3/users => generated 290 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:15:46.380665 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db3d682-0b79-4929-9557-134fbc7630ab admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:15:46.396870 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db3d682-0b79-4929-9557-134fbc7630ab admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:15:46.407634 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e01b746-ed88-46f7-8590-90736412a665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:15:46.408572 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e01b746-ed88-46f7-8590-90736412a665 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:46.409637 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e01b746-ed88-46f7-8590-90736412a665 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:46.410174 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e01b746-ed88-46f7-8590-90736412a665 admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:46.411892 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e01b746-ed88-46f7-8590-90736412a665 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:15:46.414043 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e01b746-ed88-46f7-8590-90736412a665 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:15:46.431525 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 825/1656] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:15:46 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:15:46.435314 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baad15c6-0497-4194-8944-610a36280c00 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:15:46.444963 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:15:46.451445 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baad15c6-0497-4194-8944-610a36280c00 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:15:46.460349 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e38da5b-52ae-42c9-ae0d-ca4fb53911c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:15:46.461145 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e38da5b-52ae-42c9-ae0d-ca4fb53911c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:46.462349 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e38da5b-52ae-42c9-ae0d-ca4fb53911c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:46.462712 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e38da5b-52ae-42c9-ae0d-ca4fb53911c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:46.463518 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e38da5b-52ae-42c9-ae0d-ca4fb53911c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:15:46.465524 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e38da5b-52ae-42c9-ae0d-ca4fb53911c2 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:15:46.485780 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 832/1657] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:15:46 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 10:15:46.490855 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e01b746-ed88-46f7-8590-90736412a665 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:15:46.531022 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e01b746-ed88-46f7-8590-90736412a665 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:15:46.540101 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205a4d53-4bee-41ab-9276-3ce378e6d0c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:15:46.541436 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205a4d53-4bee-41ab-9276-3ce378e6d0c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:46.541961 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205a4d53-4bee-41ab-9276-3ce378e6d0c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:46.542375 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205a4d53-4bee-41ab-9276-3ce378e6d0c3 admin admin] PATH_INFO: `/v3/projects/20d31137f3464ebbb8e42d3c173a9e6f/users/38ba2afe65534e3385285489ff36560d/roles/9f88c83743f745a9a785a2f454753f06` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:46.607833 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205a4d53-4bee-41ab-9276-3ce378e6d0c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20d31137f3464ebbb8e42d3c173a9e6f, user_id=38ba2afe65534e3385285489ff36560d, role_id=9f88c83743f745a9a785a2f454753f06)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:15:46.610710 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205a4d53-4bee-41ab-9276-3ce378e6d0c3 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:15:46.664708 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 826/1658] 10.222.0.43 () {60 vars in 1482 bytes} [Wed Jun 22 10:15:46 2022] PUT /identity/v3/projects/20d31137f3464ebbb8e42d3c173a9e6f/users/38ba2afe65534e3385285489ff36560d/roles/9f88c83743f745a9a785a2f454753f06 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:15:46.678575 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78234e5e-ad71-4d20-a4d4-cfeb3e22da59 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:46.679129 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78234e5e-ad71-4d20-a4d4-cfeb3e22da59 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:46.680679 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78234e5e-ad71-4d20-a4d4-cfeb3e22da59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:46.726180 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-78234e5e-ad71-4d20-a4d4-cfeb3e22da59 None None] MFA Rules not processed for user `38ba2afe65534e3385285489ff36560d`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:15:46.727551 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-78234e5e-ad71-4d20-a4d4-cfeb3e22da59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:15:46.851042 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 833/1659] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:15:46 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:15:46.856275 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205a4d53-4bee-41ab-9276-3ce378e6d0c3 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:15:46.958131 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:15:46.990146 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205a4d53-4bee-41ab-9276-3ce378e6d0c3 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:15:46.997738 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcf40eb-0bf8-452c-b5f0-a7fc790b8a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:15:46.997738 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcf40eb-0bf8-452c-b5f0-a7fc790b8a6f admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:46.998095 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcf40eb-0bf8-452c-b5f0-a7fc790b8a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:46.999214 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcf40eb-0bf8-452c-b5f0-a7fc790b8a6f admin admin] PATH_INFO: `/v3/projects` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:47.001488 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcf40eb-0bf8-452c-b5f0-a7fc790b8a6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:15:47.005862 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcf40eb-0bf8-452c-b5f0-a7fc790b8a6f admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:15:47.058369 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 827/1660] 10.222.0.43 () {60 vars in 1152 bytes} [Wed Jun 22 10:15:46 2022] POST /identity/v3/projects => generated 381 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:15:47.059010 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78234e5e-ad71-4d20-a4d4-cfeb3e22da59 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:15:47.072379 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78234e5e-ad71-4d20-a4d4-cfeb3e22da59 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:15:47.262472 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bbc568-6219-4166-b6df-113ce684d645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:15:47.263189 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bbc568-6219-4166-b6df-113ce684d645 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:47.263482 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bbc568-6219-4166-b6df-113ce684d645 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:47.266601 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bbc568-6219-4166-b6df-113ce684d645 admin admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:47.267353 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bbc568-6219-4166-b6df-113ce684d645 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:15:47.269388 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bbc568-6219-4166-b6df-113ce684d645 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:15:47.324523 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcf40eb-0bf8-452c-b5f0-a7fc790b8a6f admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:15:47.325312 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 834/1661] 10.222.0.43 () {60 vars in 1143 bytes} [Wed Jun 22 10:15:47 2022] POST /identity/v3/users => generated 297 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:15:47.338579 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcf40eb-0bf8-452c-b5f0-a7fc790b8a6f admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:15:47.352188 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a36d89e-6768-4d48-b397-3f8cc4b53212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:15:47.352890 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a36d89e-6768-4d48-b397-3f8cc4b53212 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:47.353891 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a36d89e-6768-4d48-b397-3f8cc4b53212 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:47.354918 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a36d89e-6768-4d48-b397-3f8cc4b53212 admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:47.356423 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a36d89e-6768-4d48-b397-3f8cc4b53212 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:15:47.359803 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a36d89e-6768-4d48-b397-3f8cc4b53212 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:15:47.389293 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 828/1662] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:15:47 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:15:47.393271 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bbc568-6219-4166-b6df-113ce684d645 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:15:47.412241 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bbc568-6219-4166-b6df-113ce684d645 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:15:47.425166 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b8b6bb-22de-45fa-8c79-3c0e37800da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:15:47.426125 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b8b6bb-22de-45fa-8c79-3c0e37800da0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:47.426817 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b8b6bb-22de-45fa-8c79-3c0e37800da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:47.427104 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b8b6bb-22de-45fa-8c79-3c0e37800da0 admin admin] PATH_INFO: `/v3/projects/a127baff57784ab297a28507c1c8208c/users/5bbffc713eba402b83760b26f02f10a6/roles/26d9c2ab5dfc4e6d9ca80c6014123906` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:47.466057 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b8b6bb-22de-45fa-8c79-3c0e37800da0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a127baff57784ab297a28507c1c8208c, user_id=5bbffc713eba402b83760b26f02f10a6, role_id=26d9c2ab5dfc4e6d9ca80c6014123906)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:15:47.470210 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b8b6bb-22de-45fa-8c79-3c0e37800da0 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:15:47.493564 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 835/1663] 10.222.0.43 () {60 vars in 1482 bytes} [Wed Jun 22 10:15:47 2022] PUT /identity/v3/projects/a127baff57784ab297a28507c1c8208c/users/5bbffc713eba402b83760b26f02f10a6/roles/26d9c2ab5dfc4e6d9ca80c6014123906 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:15:47.497923 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a36d89e-6768-4d48-b397-3f8cc4b53212 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:15:47.516671 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a36d89e-6768-4d48-b397-3f8cc4b53212 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:15:47.706945 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba8ce67-eb9f-451c-a1da-8a538d99ff64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:15:47.707974 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba8ce67-eb9f-451c-a1da-8a538d99ff64 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:47.708267 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba8ce67-eb9f-451c-a1da-8a538d99ff64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:47.708553 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba8ce67-eb9f-451c-a1da-8a538d99ff64 admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:47.709315 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba8ce67-eb9f-451c-a1da-8a538d99ff64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:15:47.711029 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba8ce67-eb9f-451c-a1da-8a538d99ff64 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:15:47.747620 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 829/1664] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:15:47 2022] GET /identity/v3/roles => generated 1420 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:15:47.748371 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b8b6bb-22de-45fa-8c79-3c0e37800da0 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:15:47.774897 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b8b6bb-22de-45fa-8c79-3c0e37800da0 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:15:47.801222 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a26e90-d41d-4f0c-b2c4-433583645bf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:15:47.810929 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a26e90-d41d-4f0c-b2c4-433583645bf7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:47.811901 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a26e90-d41d-4f0c-b2c4-433583645bf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:47.817746 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a26e90-d41d-4f0c-b2c4-433583645bf7 admin admin] PATH_INFO: `/v3/projects/a127baff57784ab297a28507c1c8208c/users/5bbffc713eba402b83760b26f02f10a6/roles/26d9c2ab5dfc4e6d9ca80c6014123906` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:47.823245 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a26e90-d41d-4f0c-b2c4-433583645bf7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a127baff57784ab297a28507c1c8208c, user_id=5bbffc713eba402b83760b26f02f10a6, role_id=26d9c2ab5dfc4e6d9ca80c6014123906)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:15:47.832837 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a26e90-d41d-4f0c-b2c4-433583645bf7 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:15:47.889995 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 836/1665] 10.222.0.43 () {60 vars in 1482 bytes} [Wed Jun 22 10:15:47 2022] PUT /identity/v3/projects/a127baff57784ab297a28507c1c8208c/users/5bbffc713eba402b83760b26f02f10a6/roles/26d9c2ab5dfc4e6d9ca80c6014123906 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:15:47.892506 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc07d5a-3f1d-4051-8db3-76196d20eed3 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:47.892961 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc07d5a-3f1d-4051-8db3-76196d20eed3 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:47.893432 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc07d5a-3f1d-4051-8db3-76196d20eed3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:47.982930 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-8bc07d5a-3f1d-4051-8db3-76196d20eed3 None None] MFA Rules not processed for user `5bbffc713eba402b83760b26f02f10a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:15:47.988215 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-8bc07d5a-3f1d-4051-8db3-76196d20eed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:15:48.247341 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 830/1666] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:15:47 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 356 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:15:48.262860 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a26e90-d41d-4f0c-b2c4-433583645bf7 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:15:48.268281 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-94a26e90-d41d-4f0c-b2c4-433583645bf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:15:48.360508 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:15:48.405202 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a26e90-d41d-4f0c-b2c4-433583645bf7 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:15:48.419272 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c6c590-0034-4be6-b87f-e7d9cd7cb976 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bbcb3d4dc704dfdb0097abc594ca855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:15:48.420012 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c6c590-0034-4be6-b87f-e7d9cd7cb976 service cinder] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:48.420533 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c6c590-0034-4be6-b87f-e7d9cd7cb976 service cinder] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:48.420820 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c6c590-0034-4be6-b87f-e7d9cd7cb976 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:48.434564 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c6c590-0034-4be6-b87f-e7d9cd7cb976 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:15:48.438455 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c6c590-0034-4be6-b87f-e7d9cd7cb976 service cinder] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:15:48.456543 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 837/1667] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:15:48 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:15:48.567722 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebee41f9-65d0-430f-b6e4-8d4b1c9fd925 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:48.567722 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebee41f9-65d0-430f-b6e4-8d4b1c9fd925 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:48.568178 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebee41f9-65d0-430f-b6e4-8d4b1c9fd925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:48.671625 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-ebee41f9-65d0-430f-b6e4-8d4b1c9fd925 None None] MFA Rules not processed for user `7be3d844dcee4d19966fc7944463a0bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:15:48.673099 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-ebee41f9-65d0-430f-b6e4-8d4b1c9fd925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:15:48.792469 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:15:48.888961 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 831/1668] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:15:48 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:15:48.905084 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c6c590-0034-4be6-b87f-e7d9cd7cb976 service cinder] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:15:48.906749 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-62c6c590-0034-4be6-b87f-e7d9cd7cb976 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:15:49.197407 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c6c590-0034-4be6-b87f-e7d9cd7cb976 service cinder] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:15:49.204554 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ed77bb-ea00-4ce5-98be-e6bff705537c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '158a49aa3750478a84bf71b9aad24397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:15:49.205529 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ed77bb-ea00-4ce5-98be-e6bff705537c service nova] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:49.206387 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ed77bb-ea00-4ce5-98be-e6bff705537c service nova] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:49.206836 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ed77bb-ea00-4ce5-98be-e6bff705537c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:49.233655 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ed77bb-ea00-4ce5-98be-e6bff705537c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:15:49.235592 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ed77bb-ea00-4ce5-98be-e6bff705537c service nova] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:15:49.292103 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 838/1669] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:15:48 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:15:49.329088 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebee41f9-65d0-430f-b6e4-8d4b1c9fd925 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:15:49.369741 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebee41f9-65d0-430f-b6e4-8d4b1c9fd925 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:15:49.381634 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281706eb-48f1-4514-881b-f28623a5f54e tempest-VolumeQuotaClassesTest-1460968106 tempest-VolumeQuotaClassesTest-1460968106-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bbffc713eba402b83760b26f02f10a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a127baff57784ab297a28507c1c8208c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:15:49.382525 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281706eb-48f1-4514-881b-f28623a5f54e tempest-VolumeQuotaClassesTest-1460968106 tempest-VolumeQuotaClassesTest-1460968106-project-admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:49.382927 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281706eb-48f1-4514-881b-f28623a5f54e tempest-VolumeQuotaClassesTest-1460968106 tempest-VolumeQuotaClassesTest-1460968106-project-admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:49.383313 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281706eb-48f1-4514-881b-f28623a5f54e tempest-VolumeQuotaClassesTest-1460968106 tempest-VolumeQuotaClassesTest-1460968106-project-admin] PATH_INFO: `/v3/domains` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:49.385415 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281706eb-48f1-4514-881b-f28623a5f54e tempest-VolumeQuotaClassesTest-1460968106 tempest-VolumeQuotaClassesTest-1460968106-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:15:49.387369 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281706eb-48f1-4514-881b-f28623a5f54e tempest-VolumeQuotaClassesTest-1460968106 tempest-VolumeQuotaClassesTest-1460968106-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:15:49.389135 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281706eb-48f1-4514-881b-f28623a5f54e tempest-VolumeQuotaClassesTest-1460968106 tempest-VolumeQuotaClassesTest-1460968106-project-admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:15:49.435578 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 832/1670] 10.222.0.43 () {58 vars in 1152 bytes} [Wed Jun 22 10:15:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:15:49.435864 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ed77bb-ea00-4ce5-98be-e6bff705537c service nova] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:15:49.460332 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ed77bb-ea00-4ce5-98be-e6bff705537c service nova] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:15:49.481367 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a929b66-5895-4229-b27a-c2a0d998e62c tempest-VolumeQuotaClassesTest-1460968106 tempest-VolumeQuotaClassesTest-1460968106-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bbffc713eba402b83760b26f02f10a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a127baff57784ab297a28507c1c8208c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:15:49.482097 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a929b66-5895-4229-b27a-c2a0d998e62c tempest-VolumeQuotaClassesTest-1460968106 tempest-VolumeQuotaClassesTest-1460968106-project-admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:49.482837 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a929b66-5895-4229-b27a-c2a0d998e62c tempest-VolumeQuotaClassesTest-1460968106 tempest-VolumeQuotaClassesTest-1460968106-project-admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:49.483135 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a929b66-5895-4229-b27a-c2a0d998e62c tempest-VolumeQuotaClassesTest-1460968106 tempest-VolumeQuotaClassesTest-1460968106-project-admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:49.485723 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a929b66-5895-4229-b27a-c2a0d998e62c tempest-VolumeQuotaClassesTest-1460968106 tempest-VolumeQuotaClassesTest-1460968106-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:15:49.494482 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a929b66-5895-4229-b27a-c2a0d998e62c tempest-VolumeQuotaClassesTest-1460968106 tempest-VolumeQuotaClassesTest-1460968106-project-admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:15:49.609090 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 839/1671] 10.222.0.43 () {60 vars in 1152 bytes} [Wed Jun 22 10:15:49 2022] POST /identity/v3/projects => generated 355 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:15:49.612554 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281706eb-48f1-4514-881b-f28623a5f54e tempest-VolumeQuotaClassesTest-1460968106 tempest-VolumeQuotaClassesTest-1460968106-project-admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:15:49.633622 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281706eb-48f1-4514-881b-f28623a5f54e tempest-VolumeQuotaClassesTest-1460968106 tempest-VolumeQuotaClassesTest-1460968106-project-admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:15:49.866891 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2238b87-216d-49b4-ab58-bd445dabb316 tempest-VolumeQuotaClassesTest-1460968106 tempest-VolumeQuotaClassesTest-1460968106-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bbffc713eba402b83760b26f02f10a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a127baff57784ab297a28507c1c8208c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:15:49.871543 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2238b87-216d-49b4-ab58-bd445dabb316 tempest-VolumeQuotaClassesTest-1460968106 tempest-VolumeQuotaClassesTest-1460968106-project-admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:49.872976 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2238b87-216d-49b4-ab58-bd445dabb316 tempest-VolumeQuotaClassesTest-1460968106 tempest-VolumeQuotaClassesTest-1460968106-project-admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:49.874329 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2238b87-216d-49b4-ab58-bd445dabb316 tempest-VolumeQuotaClassesTest-1460968106 tempest-VolumeQuotaClassesTest-1460968106-project-admin] PATH_INFO: `/v3/domains` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:49.879911 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2238b87-216d-49b4-ab58-bd445dabb316 tempest-VolumeQuotaClassesTest-1460968106 tempest-VolumeQuotaClassesTest-1460968106-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:15:49.884400 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2238b87-216d-49b4-ab58-bd445dabb316 tempest-VolumeQuotaClassesTest-1460968106 tempest-VolumeQuotaClassesTest-1460968106-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:15:49.894758 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2238b87-216d-49b4-ab58-bd445dabb316 tempest-VolumeQuotaClassesTest-1460968106 tempest-VolumeQuotaClassesTest-1460968106-project-admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:15:49.953835 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 833/1672] 10.222.0.43 () {58 vars in 1152 bytes} [Wed Jun 22 10:15:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:15:50.073743 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a929b66-5895-4229-b27a-c2a0d998e62c tempest-VolumeQuotaClassesTest-1460968106 tempest-VolumeQuotaClassesTest-1460968106-project-admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:15:50.102847 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2238b87-216d-49b4-ab58-bd445dabb316 tempest-VolumeQuotaClassesTest-1460968106 tempest-VolumeQuotaClassesTest-1460968106-project-admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:15:50.102847 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-c2238b87-216d-49b4-ab58-bd445dabb316 tempest-VolumeQuotaClassesTest-1460968106 tempest-VolumeQuotaClassesTest-1460968106-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:15:50.103851 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a929b66-5895-4229-b27a-c2a0d998e62c tempest-VolumeQuotaClassesTest-1460968106 tempest-VolumeQuotaClassesTest-1460968106-project-admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:15:50.121799 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48443089-d846-4a28-b142-863fbc7a06ce tempest-VolumeQuotaClassesTest-1460968106 tempest-VolumeQuotaClassesTest-1460968106-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5bbffc713eba402b83760b26f02f10a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a127baff57784ab297a28507c1c8208c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:15:50.123080 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48443089-d846-4a28-b142-863fbc7a06ce tempest-VolumeQuotaClassesTest-1460968106 tempest-VolumeQuotaClassesTest-1460968106-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:50.123369 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48443089-d846-4a28-b142-863fbc7a06ce tempest-VolumeQuotaClassesTest-1460968106 tempest-VolumeQuotaClassesTest-1460968106-project-admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:50.123654 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48443089-d846-4a28-b142-863fbc7a06ce tempest-VolumeQuotaClassesTest-1460968106 tempest-VolumeQuotaClassesTest-1460968106-project-admin] PATH_INFO: `/v3/projects/3ca23db630d74a228c5e3ac72752459d` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:50.136030 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48443089-d846-4a28-b142-863fbc7a06ce tempest-VolumeQuotaClassesTest-1460968106 tempest-VolumeQuotaClassesTest-1460968106-project-admin] RBAC: Authorizing `identity:delete_project(project_id=3ca23db630d74a228c5e3ac72752459d)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:15:50.140261 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48443089-d846-4a28-b142-863fbc7a06ce tempest-VolumeQuotaClassesTest-1460968106 tempest-VolumeQuotaClassesTest-1460968106-project-admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:15:50.260083 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-48443089-d846-4a28-b142-863fbc7a06ce tempest-VolumeQuotaClassesTest-1460968106 tempest-VolumeQuotaClassesTest-1460968106-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ca23db630d74a228c5e3ac72752459d', 'request_id': 'req-48443089-d846-4a28-b142-863fbc7a06ce'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:15:50.282970 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-48443089-d846-4a28-b142-863fbc7a06ce tempest-VolumeQuotaClassesTest-1460968106 tempest-VolumeQuotaClassesTest-1460968106-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ca23db630d74a228c5e3ac72752459d', 'request_id': 'req-48443089-d846-4a28-b142-863fbc7a06ce'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:15:50.318412 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-48443089-d846-4a28-b142-863fbc7a06ce tempest-VolumeQuotaClassesTest-1460968106 tempest-VolumeQuotaClassesTest-1460968106-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ca23db630d74a228c5e3ac72752459d', 'request_id': 'req-48443089-d846-4a28-b142-863fbc7a06ce'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:15:50.328749 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2238b87-216d-49b4-ab58-bd445dabb316 tempest-VolumeQuotaClassesTest-1460968106 tempest-VolumeQuotaClassesTest-1460968106-project-admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:15:50.339457 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-48443089-d846-4a28-b142-863fbc7a06ce tempest-VolumeQuotaClassesTest-1460968106 tempest-VolumeQuotaClassesTest-1460968106-project-admin] The token cache is being invalidate because project 3ca23db630d74a228c5e3ac72752459d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:15:50.339801 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-48443089-d846-4a28-b142-863fbc7a06ce tempest-VolumeQuotaClassesTest-1460968106 tempest-VolumeQuotaClassesTest-1460968106-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:15:50.340597 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-48443089-d846-4a28-b142-863fbc7a06ce tempest-VolumeQuotaClassesTest-1460968106 tempest-VolumeQuotaClassesTest-1460968106-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:15:50.360661 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 840/1673] 10.222.0.43 () {58 vars in 1232 bytes} [Wed Jun 22 10:15:50 2022] DELETE /identity/v3/projects/3ca23db630d74a228c5e3ac72752459d => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:15:50.535281 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5296b4db-dcf1-4d11-9cbd-55b4f97a74c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:15:50.536196 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5296b4db-dcf1-4d11-9cbd-55b4f97a74c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:50.536486 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5296b4db-dcf1-4d11-9cbd-55b4f97a74c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:50.536798 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5296b4db-dcf1-4d11-9cbd-55b4f97a74c2 admin admin] PATH_INFO: `/v3/users/175789ab31f14363b7b04629954447c8` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:50.545825 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5296b4db-dcf1-4d11-9cbd-55b4f97a74c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=175789ab31f14363b7b04629954447c8)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:15:50.547893 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5296b4db-dcf1-4d11-9cbd-55b4f97a74c2 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:15:50.555223 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:15:50.708149 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-5296b4db-dcf1-4d11-9cbd-55b4f97a74c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '175789ab31f14363b7b04629954447c8'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:15:50.750456 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-5296b4db-dcf1-4d11-9cbd-55b4f97a74c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '175789ab31f14363b7b04629954447c8'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:15:50.771682 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-5296b4db-dcf1-4d11-9cbd-55b4f97a74c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '175789ab31f14363b7b04629954447c8'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:15:50.795479 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-5296b4db-dcf1-4d11-9cbd-55b4f97a74c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '175789ab31f14363b7b04629954447c8'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:15:50.797017 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-5296b4db-dcf1-4d11-9cbd-55b4f97a74c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '175789ab31f14363b7b04629954447c8'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:15:50.812647 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 834/1674] 10.222.0.43 () {58 vars in 1223 bytes} [Wed Jun 22 10:15:50 2022] DELETE /identity/v3/users/175789ab31f14363b7b04629954447c8 => generated 0 bytes in 714 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:15:50.817868 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a674f44-0831-47f2-ab34-6d8d99d9fe9f None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:50.818393 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a674f44-0831-47f2-ab34-6d8d99d9fe9f None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:50.818819 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a674f44-0831-47f2-ab34-6d8d99d9fe9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:50.867831 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-9a674f44-0831-47f2-ab34-6d8d99d9fe9f None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:15:50.869377 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-9a674f44-0831-47f2-ab34-6d8d99d9fe9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:15:50.880124 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5296b4db-dcf1-4d11-9cbd-55b4f97a74c2 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:15:50.881786 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-5296b4db-dcf1-4d11-9cbd-55b4f97a74c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:15:50.965929 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:15:51.101083 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5296b4db-dcf1-4d11-9cbd-55b4f97a74c2 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:15:51.117865 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 841/1675] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:15:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:15:51.130685 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c6e2c1-6528-430e-a44c-f42f1a726b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:15:51.131608 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c6e2c1-6528-430e-a44c-f42f1a726b3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:51.133100 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c6e2c1-6528-430e-a44c-f42f1a726b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:51.133100 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c6e2c1-6528-430e-a44c-f42f1a726b3b admin admin] PATH_INFO: `/v3/users/38ba2afe65534e3385285489ff36560d` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:51.133841 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c6e2c1-6528-430e-a44c-f42f1a726b3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=38ba2afe65534e3385285489ff36560d)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:15:51.139077 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c6e2c1-6528-430e-a44c-f42f1a726b3b admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:15:51.180317 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a674f44-0831-47f2-ab34-6d8d99d9fe9f None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:15:51.181736 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-9a674f44-0831-47f2-ab34-6d8d99d9fe9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:15:51.288590 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-97c6e2c1-6528-430e-a44c-f42f1a726b3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38ba2afe65534e3385285489ff36560d'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:15:51.321525 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-97c6e2c1-6528-430e-a44c-f42f1a726b3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38ba2afe65534e3385285489ff36560d'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:15:51.342152 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a674f44-0831-47f2-ab34-6d8d99d9fe9f None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:15:51.346663 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5e9bf0-9f35-4cda-9977-dbd98a2a3462 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe93d4c0737249fd8623bb5ce188e34e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:15:51.347649 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5e9bf0-9f35-4cda-9977-dbd98a2a3462 service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:51.351835 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-97c6e2c1-6528-430e-a44c-f42f1a726b3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38ba2afe65534e3385285489ff36560d'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:15:51.354468 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5e9bf0-9f35-4cda-9977-dbd98a2a3462 service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:51.355362 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5e9bf0-9f35-4cda-9977-dbd98a2a3462 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:51.363955 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-97c6e2c1-6528-430e-a44c-f42f1a726b3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38ba2afe65534e3385285489ff36560d'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:15:51.365579 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-97c6e2c1-6528-430e-a44c-f42f1a726b3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38ba2afe65534e3385285489ff36560d'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:15:51.376882 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5e9bf0-9f35-4cda-9977-dbd98a2a3462 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:15:51.378645 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5e9bf0-9f35-4cda-9977-dbd98a2a3462 service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:15:51.380243 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:15:51.384764 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 835/1676] 10.222.0.43 () {58 vars in 1223 bytes} [Wed Jun 22 10:15:50 2022] DELETE /identity/v3/users/38ba2afe65534e3385285489ff36560d => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:15:51.393611 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7f49a3-ac2a-4cfb-9b9e-c64ae846723b None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:51.394065 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7f49a3-ac2a-4cfb-9b9e-c64ae846723b None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:51.394356 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7f49a3-ac2a-4cfb-9b9e-c64ae846723b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:51.416002 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 842/1677] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:15:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 10:15:51.429849 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-8b7f49a3-ac2a-4cfb-9b9e-c64ae846723b None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:15:51.431143 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-8b7f49a3-ac2a-4cfb-9b9e-c64ae846723b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:15:51.579392 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 836/1678] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:15:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:15:51.604840 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5e9bf0-9f35-4cda-9977-dbd98a2a3462 service neutron] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:15:51.606323 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-4f5e9bf0-9f35-4cda-9977-dbd98a2a3462 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:15:51.628289 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5e9bf0-9f35-4cda-9977-dbd98a2a3462 service neutron] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:15:51.758076 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f75ab90-d53a-4a16-bd34-94922adfeb14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe93d4c0737249fd8623bb5ce188e34e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:15:51.758895 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f75ab90-d53a-4a16-bd34-94922adfeb14 service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:51.759787 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f75ab90-d53a-4a16-bd34-94922adfeb14 service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:51.760202 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f75ab90-d53a-4a16-bd34-94922adfeb14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:51.785071 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f75ab90-d53a-4a16-bd34-94922adfeb14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:15:51.787873 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f75ab90-d53a-4a16-bd34-94922adfeb14 service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:15:51.801956 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 843/1679] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:15:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:15:52.439207 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02740c26-144b-4294-87ef-7d5cb72645eb None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:52.439677 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02740c26-144b-4294-87ef-7d5cb72645eb None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:52.439771 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02740c26-144b-4294-87ef-7d5cb72645eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:52.538408 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-02740c26-144b-4294-87ef-7d5cb72645eb None None] MFA Rules not processed for user `75753b29a78640df9622d4e2655baf9b`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:15:52.539694 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-02740c26-144b-4294-87ef-7d5cb72645eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:15:52.779910 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 837/1680] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:15:52 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:15:52.794610 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f75ab90-d53a-4a16-bd34-94922adfeb14 service neutron] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:15:52.797035 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-6f75ab90-d53a-4a16-bd34-94922adfeb14 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:15:53.044886 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f75ab90-d53a-4a16-bd34-94922adfeb14 service neutron] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:15:53.064759 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02740c26-144b-4294-87ef-7d5cb72645eb None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:15:53.066943 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-02740c26-144b-4294-87ef-7d5cb72645eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:15:53.074045 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c4c64c-1437-41c6-a948-d195bf6404d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '158a49aa3750478a84bf71b9aad24397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:15:53.074864 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c4c64c-1437-41c6-a948-d195bf6404d8 service nova] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:53.075194 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c4c64c-1437-41c6-a948-d195bf6404d8 service nova] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:53.075533 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c4c64c-1437-41c6-a948-d195bf6404d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:53.089079 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:15:53.094386 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c4c64c-1437-41c6-a948-d195bf6404d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:15:53.095858 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c4c64c-1437-41c6-a948-d195bf6404d8 service nova] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:15:53.108344 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02740c26-144b-4294-87ef-7d5cb72645eb None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:15:53.115948 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611354e7-b359-4852-936a-811a03927ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:15:53.116785 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611354e7-b359-4852-936a-811a03927ab6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:53.117330 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611354e7-b359-4852-936a-811a03927ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:53.117330 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611354e7-b359-4852-936a-811a03927ab6 admin admin] PATH_INFO: `/v3/projects/20d31137f3464ebbb8e42d3c173a9e6f` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:53.119142 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611354e7-b359-4852-936a-811a03927ab6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=20d31137f3464ebbb8e42d3c173a9e6f)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:15:53.119601 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 844/1681] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:15:52 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:15:53.128279 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611354e7-b359-4852-936a-811a03927ab6 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:15:53.279383 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-611354e7-b359-4852-936a-811a03927ab6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20d31137f3464ebbb8e42d3c173a9e6f', 'request_id': 'req-611354e7-b359-4852-936a-811a03927ab6'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:15:53.288599 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c4c64c-1437-41c6-a948-d195bf6404d8 service nova] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:15:53.290135 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-54c4c64c-1437-41c6-a948-d195bf6404d8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:15:53.301259 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-611354e7-b359-4852-936a-811a03927ab6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20d31137f3464ebbb8e42d3c173a9e6f', 'request_id': 'req-611354e7-b359-4852-936a-811a03927ab6'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:15:53.320642 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c4c64c-1437-41c6-a948-d195bf6404d8 service nova] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:15:53.323503 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-611354e7-b359-4852-936a-811a03927ab6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20d31137f3464ebbb8e42d3c173a9e6f', 'request_id': 'req-611354e7-b359-4852-936a-811a03927ab6'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:15:53.357572 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-611354e7-b359-4852-936a-811a03927ab6 admin admin] The token cache is being invalidate because project 20d31137f3464ebbb8e42d3c173a9e6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:15:53.357907 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-611354e7-b359-4852-936a-811a03927ab6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:15:53.359086 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-611354e7-b359-4852-936a-811a03927ab6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:15:53.364281 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 838/1682] 10.222.0.43 () {58 vars in 1232 bytes} [Wed Jun 22 10:15:53 2022] DELETE /identity/v3/projects/20d31137f3464ebbb8e42d3c173a9e6f => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:15:53.368412 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611354e7-b359-4852-936a-811a03927ab6 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:15:53.370185 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-611354e7-b359-4852-936a-811a03927ab6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:15:53.414184 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:15:53.478105 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc499e1-f360-45b2-9a45-9344093be0d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:15:53.478602 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc499e1-f360-45b2-9a45-9344093be0d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:53.478891 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc499e1-f360-45b2-9a45-9344093be0d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:53.479173 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc499e1-f360-45b2-9a45-9344093be0d5 admin admin] PATH_INFO: `/v3/users/d278ba2cd031466d93a83a133c61ff57` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:53.484435 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc499e1-f360-45b2-9a45-9344093be0d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d278ba2cd031466d93a83a133c61ff57)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:15:53.486598 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc499e1-f360-45b2-9a45-9344093be0d5 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:15:53.495186 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611354e7-b359-4852-936a-811a03927ab6 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:15:53.501566 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dc0f7e-09ae-4e08-a00a-5505c4924145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:15:53.501566 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dc0f7e-09ae-4e08-a00a-5505c4924145 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:53.501741 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dc0f7e-09ae-4e08-a00a-5505c4924145 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:53.502016 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dc0f7e-09ae-4e08-a00a-5505c4924145 admin admin] PATH_INFO: `/v3/users/5bbffc713eba402b83760b26f02f10a6` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:53.503475 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dc0f7e-09ae-4e08-a00a-5505c4924145 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5bbffc713eba402b83760b26f02f10a6)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:15:53.505849 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dc0f7e-09ae-4e08-a00a-5505c4924145 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:15:53.611629 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-40dc0f7e-09ae-4e08-a00a-5505c4924145 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5bbffc713eba402b83760b26f02f10a6'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:15:53.613757 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-fcc499e1-f360-45b2-9a45-9344093be0d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd278ba2cd031466d93a83a133c61ff57'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:15:53.638305 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-fcc499e1-f360-45b2-9a45-9344093be0d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd278ba2cd031466d93a83a133c61ff57'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:15:53.640027 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-40dc0f7e-09ae-4e08-a00a-5505c4924145 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5bbffc713eba402b83760b26f02f10a6'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:15:53.655277 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-40dc0f7e-09ae-4e08-a00a-5505c4924145 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5bbffc713eba402b83760b26f02f10a6'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:15:53.663933 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-fcc499e1-f360-45b2-9a45-9344093be0d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd278ba2cd031466d93a83a133c61ff57'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:15:53.664808 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-fcc499e1-f360-45b2-9a45-9344093be0d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd278ba2cd031466d93a83a133c61ff57'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:15:53.679495 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-fcc499e1-f360-45b2-9a45-9344093be0d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd278ba2cd031466d93a83a133c61ff57'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:15:53.680649 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-40dc0f7e-09ae-4e08-a00a-5505c4924145 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5bbffc713eba402b83760b26f02f10a6'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:15:53.682712 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-40dc0f7e-09ae-4e08-a00a-5505c4924145 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5bbffc713eba402b83760b26f02f10a6'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:15:53.702611 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 845/1683] 10.222.0.43 () {58 vars in 1223 bytes} [Wed Jun 22 10:15:53 2022] DELETE /identity/v3/users/d278ba2cd031466d93a83a133c61ff57 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:15:53.702918 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 839/1684] 10.222.0.43 () {58 vars in 1223 bytes} [Wed Jun 22 10:15:53 2022] DELETE /identity/v3/users/5bbffc713eba402b83760b26f02f10a6 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:15:53.707217 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c509669-4749-4362-aae7-9ec7dff346f1 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:53.707448 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c509669-4749-4362-aae7-9ec7dff346f1 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:53.707716 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c509669-4749-4362-aae7-9ec7dff346f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:53.738741 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-0c509669-4749-4362-aae7-9ec7dff346f1 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:15:53.740014 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-0c509669-4749-4362-aae7-9ec7dff346f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:15:53.751896 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1941bef4-d0db-456a-bffa-ed2ffc89d389 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:53.753624 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1941bef4-d0db-456a-bffa-ed2ffc89d389 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:53.754448 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1941bef4-d0db-456a-bffa-ed2ffc89d389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:53.807081 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-1941bef4-d0db-456a-bffa-ed2ffc89d389 None None] MFA Rules not processed for user `2b3af9bfaaaa4dcca0747f776115c826`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:15:53.810263 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-1941bef4-d0db-456a-bffa-ed2ffc89d389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:15:53.865953 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 846/1685] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:15:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:15:53.915586 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c509669-4749-4362-aae7-9ec7dff346f1 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:15:53.917843 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-0c509669-4749-4362-aae7-9ec7dff346f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:15:53.949859 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 840/1686] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:15:53 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:15:53.962561 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9de4c42-79da-471c-b88a-ebb2ffba2338 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:53.962826 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9de4c42-79da-471c-b88a-ebb2ffba2338 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:53.963112 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9de4c42-79da-471c-b88a-ebb2ffba2338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:53.969562 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:15:54.001146 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-c9de4c42-79da-471c-b88a-ebb2ffba2338 None None] MFA Rules not processed for user `2b3af9bfaaaa4dcca0747f776115c826`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:15:54.003185 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-c9de4c42-79da-471c-b88a-ebb2ffba2338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:15:54.022786 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 841/1687] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:15:53 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:15:54.032334 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9de4c42-79da-471c-b88a-ebb2ffba2338 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:15:54.034336 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-c9de4c42-79da-471c-b88a-ebb2ffba2338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:15:54.052518 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c509669-4749-4362-aae7-9ec7dff346f1 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:15:54.058216 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4e8394-a60d-41b1-95c6-976f2ed5c03c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe93d4c0737249fd8623bb5ce188e34e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:15:54.059436 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4e8394-a60d-41b1-95c6-976f2ed5c03c service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:54.059935 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4e8394-a60d-41b1-95c6-976f2ed5c03c service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:54.060418 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4e8394-a60d-41b1-95c6-976f2ed5c03c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:54.067366 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:15:54.082248 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4e8394-a60d-41b1-95c6-976f2ed5c03c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:15:54.084689 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4e8394-a60d-41b1-95c6-976f2ed5c03c service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:15:54.136788 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 847/1688] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:15:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 10:15:54.201673 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9de4c42-79da-471c-b88a-ebb2ffba2338 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:15:54.211351 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0639c0d4-b3f5-4dda-88ac-4907eb920746 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '158a49aa3750478a84bf71b9aad24397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:15:54.212041 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0639c0d4-b3f5-4dda-88ac-4907eb920746 service nova] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:54.212336 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0639c0d4-b3f5-4dda-88ac-4907eb920746 service nova] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:54.212623 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0639c0d4-b3f5-4dda-88ac-4907eb920746 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:54.223784 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0639c0d4-b3f5-4dda-88ac-4907eb920746 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:15:54.225769 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0639c0d4-b3f5-4dda-88ac-4907eb920746 service nova] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:15:54.241122 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 842/1689] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:15:54 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 10:15:54.724177 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4e8394-a60d-41b1-95c6-976f2ed5c03c service neutron] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:15:54.726004 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-cc4e8394-a60d-41b1-95c6-976f2ed5c03c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:15:54.752508 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4e8394-a60d-41b1-95c6-976f2ed5c03c service neutron] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:15:54.771774 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55184e4c-3f54-446f-a392-03126a506770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:15:54.772704 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55184e4c-3f54-446f-a392-03126a506770 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:54.772993 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55184e4c-3f54-446f-a392-03126a506770 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:54.773257 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55184e4c-3f54-446f-a392-03126a506770 admin admin] PATH_INFO: `/v3/projects/18756f7eccc64437bf9b22f0fe967a1c` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:54.774903 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55184e4c-3f54-446f-a392-03126a506770 admin admin] RBAC: Authorizing `identity:delete_project(project_id=18756f7eccc64437bf9b22f0fe967a1c)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:15:54.779169 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55184e4c-3f54-446f-a392-03126a506770 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:15:54.939022 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-55184e4c-3f54-446f-a392-03126a506770 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18756f7eccc64437bf9b22f0fe967a1c', 'request_id': 'req-55184e4c-3f54-446f-a392-03126a506770'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:15:54.957790 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-55184e4c-3f54-446f-a392-03126a506770 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18756f7eccc64437bf9b22f0fe967a1c', 'request_id': 'req-55184e4c-3f54-446f-a392-03126a506770'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:15:54.973679 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-55184e4c-3f54-446f-a392-03126a506770 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18756f7eccc64437bf9b22f0fe967a1c', 'request_id': 'req-55184e4c-3f54-446f-a392-03126a506770'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:15:55.004699 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-55184e4c-3f54-446f-a392-03126a506770 admin admin] The token cache is being invalidate because project 18756f7eccc64437bf9b22f0fe967a1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:15:55.004931 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-55184e4c-3f54-446f-a392-03126a506770 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:15:55.015365 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-55184e4c-3f54-446f-a392-03126a506770 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:15:55.024911 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 848/1690] 10.222.0.43 () {58 vars in 1232 bytes} [Wed Jun 22 10:15:54 2022] DELETE /identity/v3/projects/18756f7eccc64437bf9b22f0fe967a1c => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:15:55.030627 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b700a8-a984-4dab-b5b6-b5666669481a None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:55.031121 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b700a8-a984-4dab-b5b6-b5666669481a None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:55.031193 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b700a8-a984-4dab-b5b6-b5666669481a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:55.072795 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-23b700a8-a984-4dab-b5b6-b5666669481a None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:15:55.075705 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-23b700a8-a984-4dab-b5b6-b5666669481a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:15:55.211824 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223c18eb-3968-4938-9bcf-0aab0b4fc576 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:55.212317 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223c18eb-3968-4938-9bcf-0aab0b4fc576 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:55.212608 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223c18eb-3968-4938-9bcf-0aab0b4fc576 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:55.214452 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 849/1691] 10.222.0.43 () {54 vars in 912 bytes} [Wed Jun 22 10:15:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 10:15:55.228066 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7475f814-5688-4495-a9b8-be54a0a66537 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:55.228392 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7475f814-5688-4495-a9b8-be54a0a66537 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:55.228646 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7475f814-5688-4495-a9b8-be54a0a66537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:55.248360 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 843/1692] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:15:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:15:55.260277 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86fc5cd-0855-485e-bb17-1e7ef5db612e None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:55.260606 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86fc5cd-0855-485e-bb17-1e7ef5db612e None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:55.260891 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86fc5cd-0855-485e-bb17-1e7ef5db612e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:55.315965 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-c86fc5cd-0855-485e-bb17-1e7ef5db612e None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:15:55.318907 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-7475f814-5688-4495-a9b8-be54a0a66537 None None] MFA Rules not processed for user `fe93d4c0737249fd8623bb5ce188e34e`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:15:55.319961 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-7475f814-5688-4495-a9b8-be54a0a66537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:15:55.321444 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-c86fc5cd-0855-485e-bb17-1e7ef5db612e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:15:55.355313 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 844/1693] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:15:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:15:55.358933 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86fc5cd-0855-485e-bb17-1e7ef5db612e None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:15:55.391934 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86fc5cd-0855-485e-bb17-1e7ef5db612e None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:15:55.415139 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38d7a27-9f66-4fa4-afdd-84bfc9347cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:15:55.415856 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38d7a27-9f66-4fa4-afdd-84bfc9347cb1 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:55.416147 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38d7a27-9f66-4fa4-afdd-84bfc9347cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:55.416431 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38d7a27-9f66-4fa4-afdd-84bfc9347cb1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:55.417192 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38d7a27-9f66-4fa4-afdd-84bfc9347cb1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:15:55.417502 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38d7a27-9f66-4fa4-afdd-84bfc9347cb1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:15:55.419177 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38d7a27-9f66-4fa4-afdd-84bfc9347cb1 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:15:55.451287 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 850/1694] 10.222.0.43 () {58 vars in 1009 bytes} [Wed Jun 22 10:15:55 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:15:55.454557 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 845/1695] 10.222.0.43 () {58 vars in 1152 bytes} [Wed Jun 22 10:15:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:15:55.460937 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7475f814-5688-4495-a9b8-be54a0a66537 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:15:55.471912 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38d7a27-9f66-4fa4-afdd-84bfc9347cb1 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:15:55.474672 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-e38d7a27-9f66-4fa4-afdd-84bfc9347cb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:15:55.496019 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7475f814-5688-4495-a9b8-be54a0a66537 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:15:55.505466 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38d7a27-9f66-4fa4-afdd-84bfc9347cb1 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:15:55.508027 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeac677e-a3b6-4cba-8c0d-3ece41ab1cf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:15:55.508946 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeac677e-a3b6-4cba-8c0d-3ece41ab1cf7 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:55.509831 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeac677e-a3b6-4cba-8c0d-3ece41ab1cf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:55.510747 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeac677e-a3b6-4cba-8c0d-3ece41ab1cf7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:55.511994 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeac677e-a3b6-4cba-8c0d-3ece41ab1cf7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:15:55.515966 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce1e520-d8d0-4174-a99b-3e660d7dfe95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe93d4c0737249fd8623bb5ce188e34e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:15:55.517277 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeac677e-a3b6-4cba-8c0d-3ece41ab1cf7 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:15:55.518774 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce1e520-d8d0-4174-a99b-3e660d7dfe95 service neutron] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:55.519702 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce1e520-d8d0-4174-a99b-3e660d7dfe95 service neutron] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:55.520181 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce1e520-d8d0-4174-a99b-3e660d7dfe95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:55.538817 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce1e520-d8d0-4174-a99b-3e660d7dfe95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:15:55.540289 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce1e520-d8d0-4174-a99b-3e660d7dfe95 service neutron] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:15:55.560609 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 846/1696] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:15:55 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 10:15:55.577907 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 851/1697] 10.222.0.43 () {60 vars in 1152 bytes} [Wed Jun 22 10:15:55 2022] POST /identity/v3/projects => generated 365 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 10:15:55.583783 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce1e520-d8d0-4174-a99b-3e660d7dfe95 service neutron] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:15:55.608335 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce1e520-d8d0-4174-a99b-3e660d7dfe95 service neutron] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:15:55.666551 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeac677e-a3b6-4cba-8c0d-3ece41ab1cf7 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:15:55.673034 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-aeac677e-a3b6-4cba-8c0d-3ece41ab1cf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:15:55.704078 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:15:55.739766 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02827cee-4abb-423e-a755-d74209731568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:15:55.740650 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02827cee-4abb-423e-a755-d74209731568 admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:55.740943 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02827cee-4abb-423e-a755-d74209731568 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:55.742749 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02827cee-4abb-423e-a755-d74209731568 admin admin] PATH_INFO: `/v3/users` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:55.746517 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02827cee-4abb-423e-a755-d74209731568 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:15:55.747030 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02827cee-4abb-423e-a755-d74209731568 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:15:55.770674 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:15:55.782347 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 847/1698] 10.222.0.43 () {60 vars in 1143 bytes} [Wed Jun 22 10:15:55 2022] POST /identity/v3/users => generated 283 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:15:55.786982 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02827cee-4abb-423e-a755-d74209731568 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:15:55.795126 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeac677e-a3b6-4cba-8c0d-3ece41ab1cf7 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:15:55.801149 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72acb71-04c2-497d-8449-511466c0091a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:15:55.802369 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72acb71-04c2-497d-8449-511466c0091a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:55.802792 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72acb71-04c2-497d-8449-511466c0091a admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:55.804466 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72acb71-04c2-497d-8449-511466c0091a admin admin] PATH_INFO: `/v3/projects/413e418950a44456839d99470ed27a69` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:55.806159 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72acb71-04c2-497d-8449-511466c0091a admin admin] RBAC: Authorizing `identity:delete_project(project_id=413e418950a44456839d99470ed27a69)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:15:55.808408 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72acb71-04c2-497d-8449-511466c0091a admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:15:55.809593 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02827cee-4abb-423e-a755-d74209731568 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:15:55.828911 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740a49fc-2a84-4ff0-8893-eecfa345831a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:15:55.829928 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740a49fc-2a84-4ff0-8893-eecfa345831a admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:55.830316 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740a49fc-2a84-4ff0-8893-eecfa345831a admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:55.831281 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740a49fc-2a84-4ff0-8893-eecfa345831a admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:55.832122 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740a49fc-2a84-4ff0-8893-eecfa345831a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:15:55.836926 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740a49fc-2a84-4ff0-8893-eecfa345831a admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:15:55.862187 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 848/1699] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:15:55 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 10:15:55.866738 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740a49fc-2a84-4ff0-8893-eecfa345831a admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:15:55.888948 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740a49fc-2a84-4ff0-8893-eecfa345831a admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:15:55.898029 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-e72acb71-04c2-497d-8449-511466c0091a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '413e418950a44456839d99470ed27a69', 'request_id': 'req-e72acb71-04c2-497d-8449-511466c0091a'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:15:55.911291 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-e72acb71-04c2-497d-8449-511466c0091a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '413e418950a44456839d99470ed27a69', 'request_id': 'req-e72acb71-04c2-497d-8449-511466c0091a'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:15:55.931593 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-e72acb71-04c2-497d-8449-511466c0091a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '413e418950a44456839d99470ed27a69', 'request_id': 'req-e72acb71-04c2-497d-8449-511466c0091a'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:15:55.952624 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-e72acb71-04c2-497d-8449-511466c0091a admin admin] The token cache is being invalidate because project 413e418950a44456839d99470ed27a69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:15:55.953260 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-e72acb71-04c2-497d-8449-511466c0091a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:15:55.954306 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-e72acb71-04c2-497d-8449-511466c0091a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:15:55.961178 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 852/1700] 10.222.0.43 () {58 vars in 1232 bytes} [Wed Jun 22 10:15:55 2022] DELETE /identity/v3/projects/413e418950a44456839d99470ed27a69 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:15:55.961178 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72acb71-04c2-497d-8449-511466c0091a admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:15:55.962334 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-e72acb71-04c2-497d-8449-511466c0091a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:15:56.041049 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b20d69-2116-4dd7-8cac-c63f2a7766a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:15:56.041763 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b20d69-2116-4dd7-8cac-c63f2a7766a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:56.043948 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b20d69-2116-4dd7-8cac-c63f2a7766a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:56.044243 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b20d69-2116-4dd7-8cac-c63f2a7766a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:56.044991 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b20d69-2116-4dd7-8cac-c63f2a7766a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:15:56.050786 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b20d69-2116-4dd7-8cac-c63f2a7766a5 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:15:56.074442 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 849/1701] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:15:55 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:15:56.075497 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b20d69-2116-4dd7-8cac-c63f2a7766a5 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:15:56.082762 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-72b20d69-2116-4dd7-8cac-c63f2a7766a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:15:56.116323 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b20d69-2116-4dd7-8cac-c63f2a7766a5 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:15:56.125764 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e75361-225a-43be-9d94-81e7a1959938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:15:56.126668 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e75361-225a-43be-9d94-81e7a1959938 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:56.126956 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e75361-225a-43be-9d94-81e7a1959938 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:56.128412 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72acb71-04c2-497d-8449-511466c0091a admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:15:56.129864 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e75361-225a-43be-9d94-81e7a1959938 admin admin] PATH_INFO: `/v3/users/1c1b8a040ee142f880bc2fcc4b204dd2` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:56.133058 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e75361-225a-43be-9d94-81e7a1959938 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c1b8a040ee142f880bc2fcc4b204dd2)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:15:56.136587 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e75361-225a-43be-9d94-81e7a1959938 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:15:56.138917 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6cb1ec-455a-4f08-a1ea-fefd4839640c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:15:56.139838 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6cb1ec-455a-4f08-a1ea-fefd4839640c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:56.140104 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6cb1ec-455a-4f08-a1ea-fefd4839640c admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:56.142175 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6cb1ec-455a-4f08-a1ea-fefd4839640c admin admin] PATH_INFO: `/v3/projects/a127baff57784ab297a28507c1c8208c` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:56.143912 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6cb1ec-455a-4f08-a1ea-fefd4839640c admin admin] RBAC: Authorizing `identity:delete_project(project_id=a127baff57784ab297a28507c1c8208c)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:15:56.145917 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6cb1ec-455a-4f08-a1ea-fefd4839640c admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:15:56.235190 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:15:56.237523 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-8e6cb1ec-455a-4f08-a1ea-fefd4839640c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a127baff57784ab297a28507c1c8208c', 'request_id': 'req-8e6cb1ec-455a-4f08-a1ea-fefd4839640c'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:15:56.250858 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-8e6cb1ec-455a-4f08-a1ea-fefd4839640c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a127baff57784ab297a28507c1c8208c', 'request_id': 'req-8e6cb1ec-455a-4f08-a1ea-fefd4839640c'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:15:56.275573 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-28e75361-225a-43be-9d94-81e7a1959938 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c1b8a040ee142f880bc2fcc4b204dd2'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:15:56.280044 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-8e6cb1ec-455a-4f08-a1ea-fefd4839640c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a127baff57784ab297a28507c1c8208c', 'request_id': 'req-8e6cb1ec-455a-4f08-a1ea-fefd4839640c'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:15:56.302763 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-8e6cb1ec-455a-4f08-a1ea-fefd4839640c admin admin] The token cache is being invalidate because project a127baff57784ab297a28507c1c8208c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:15:56.303103 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-8e6cb1ec-455a-4f08-a1ea-fefd4839640c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:15:56.303798 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-8e6cb1ec-455a-4f08-a1ea-fefd4839640c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:15:56.305683 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 853/1702] 10.222.0.43 () {58 vars in 1232 bytes} [Wed Jun 22 10:15:55 2022] DELETE /identity/v3/projects/a127baff57784ab297a28507c1c8208c => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:15:56.306572 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6cb1ec-455a-4f08-a1ea-fefd4839640c admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:15:56.307768 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-8e6cb1ec-455a-4f08-a1ea-fefd4839640c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:15:56.310243 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-28e75361-225a-43be-9d94-81e7a1959938 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c1b8a040ee142f880bc2fcc4b204dd2'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:15:56.333943 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-28e75361-225a-43be-9d94-81e7a1959938 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c1b8a040ee142f880bc2fcc4b204dd2'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:15:56.347809 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-28e75361-225a-43be-9d94-81e7a1959938 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c1b8a040ee142f880bc2fcc4b204dd2'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:15:56.349086 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-28e75361-225a-43be-9d94-81e7a1959938 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c1b8a040ee142f880bc2fcc4b204dd2'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:15:56.365190 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 850/1703] 10.222.0.43 () {58 vars in 1223 bytes} [Wed Jun 22 10:15:56 2022] DELETE /identity/v3/users/1c1b8a040ee142f880bc2fcc4b204dd2 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:15:56.368946 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba49580-5b63-4d2b-954c-0eed79a6ad0c None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:56.369757 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba49580-5b63-4d2b-954c-0eed79a6ad0c None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:56.369757 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba49580-5b63-4d2b-954c-0eed79a6ad0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:56.420489 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-6ba49580-5b63-4d2b-954c-0eed79a6ad0c None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:15:56.426628 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-6ba49580-5b63-4d2b-954c-0eed79a6ad0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:15:56.501290 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6cb1ec-455a-4f08-a1ea-fefd4839640c admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:15:56.543653 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:15:56.571972 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 851/1704] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:15:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:15:56.573359 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f252b6f-a847-4b07-98e9-c42ce576cd82 None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:56.573645 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f252b6f-a847-4b07-98e9-c42ce576cd82 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:56.576641 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f252b6f-a847-4b07-98e9-c42ce576cd82 None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:56.578311 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 852/1705] 10.222.0.43 () {54 vars in 960 bytes} [Wed Jun 22 10:15:56 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:15:56.580225 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b6f54a-0133-45ed-b7db-e741875a7066 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:56.581061 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b6f54a-0133-45ed-b7db-e741875a7066 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:56.581971 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b6f54a-0133-45ed-b7db-e741875a7066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:56.635217 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-18b6f54a-0133-45ed-b7db-e741875a7066 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:15:56.636457 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-18b6f54a-0133-45ed-b7db-e741875a7066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:15:56.643044 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f93b26-1f07-4930-ae85-772d81421142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:15:56.644558 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f93b26-1f07-4930-ae85-772d81421142 admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:56.644847 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f93b26-1f07-4930-ae85-772d81421142 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:56.645638 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f93b26-1f07-4930-ae85-772d81421142 admin admin] PATH_INFO: `/v3/projects/e0c524ec9a0c48089634582be48a5937/users/37620775aa6a412cb67dcfcc9a472761/roles/9f88c83743f745a9a785a2f454753f06` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:56.663204 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 853/1706] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:15:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:15:56.664641 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69290f44-8729-4699-9bfa-71463325a6f2 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:56.664907 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69290f44-8729-4699-9bfa-71463325a6f2 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:56.665193 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69290f44-8729-4699-9bfa-71463325a6f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:56.682616 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f93b26-1f07-4930-ae85-772d81421142 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0c524ec9a0c48089634582be48a5937, user_id=37620775aa6a412cb67dcfcc9a472761, role_id=9f88c83743f745a9a785a2f454753f06)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:15:56.687884 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f93b26-1f07-4930-ae85-772d81421142 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:15:56.707816 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-69290f44-8729-4699-9bfa-71463325a6f2 None None] MFA Rules not processed for user `341ec95408c94dae8539ccff7225e3ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:15:56.718589 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-69290f44-8729-4699-9bfa-71463325a6f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:15:56.723154 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 854/1707] 10.222.0.43 () {60 vars in 1482 bytes} [Wed Jun 22 10:15:56 2022] PUT /identity/v3/projects/e0c524ec9a0c48089634582be48a5937/users/37620775aa6a412cb67dcfcc9a472761/roles/9f88c83743f745a9a785a2f454753f06 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:15:56.724977 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f93b26-1f07-4930-ae85-772d81421142 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:15:56.931816 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f93b26-1f07-4930-ae85-772d81421142 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:15:56.932106 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 854/1708] 10.222.0.43 () {58 vars in 1057 bytes} [Wed Jun 22 10:15:56 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:15:56.933585 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083474bc-a03b-4c9a-8db3-3889ef09c613 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:56.933819 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083474bc-a03b-4c9a-8db3-3889ef09c613 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:56.934419 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083474bc-a03b-4c9a-8db3-3889ef09c613 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:56.947624 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de2904d-8a63-4489-b4be-847c6dec54fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:15:56.948329 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de2904d-8a63-4489-b4be-847c6dec54fd admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:56.948617 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de2904d-8a63-4489-b4be-847c6dec54fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:56.948911 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de2904d-8a63-4489-b4be-847c6dec54fd admin admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:56.949662 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de2904d-8a63-4489-b4be-847c6dec54fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:15:56.949999 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de2904d-8a63-4489-b4be-847c6dec54fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:15:56.957653 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de2904d-8a63-4489-b4be-847c6dec54fd admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:15:56.977092 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:15:56.988460 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 855/1709] 10.222.0.43 () {58 vars in 1152 bytes} [Wed Jun 22 10:15:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:15:56.989406 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de2904d-8a63-4489-b4be-847c6dec54fd admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:15:57.003458 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-083474bc-a03b-4c9a-8db3-3889ef09c613 None None] MFA Rules not processed for user `37620775aa6a412cb67dcfcc9a472761`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:15:57.007950 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-083474bc-a03b-4c9a-8db3-3889ef09c613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:15:57.022251 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de2904d-8a63-4489-b4be-847c6dec54fd admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:15:57.040017 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe24938e-e168-464e-b81a-f0848714beb8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '341ec95408c94dae8539ccff7225e3ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:15:57.040879 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe24938e-e168-464e-b81a-f0848714beb8 service placement] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:57.041175 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe24938e-e168-464e-b81a-f0848714beb8 service placement] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:57.041512 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe24938e-e168-464e-b81a-f0848714beb8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:57.047202 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-fe24938e-e168-464e-b81a-f0848714beb8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:15:57.064256 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe24938e-e168-464e-b81a-f0848714beb8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:15:57.069086 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe24938e-e168-464e-b81a-f0848714beb8 service placement] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:15:57.123383 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 856/1710] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:15:56 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:15:57.124695 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe24938e-e168-464e-b81a-f0848714beb8 service placement] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:15:57.166897 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe24938e-e168-464e-b81a-f0848714beb8 service placement] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:15:57.183349 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf19723-bfe3-4600-bafc-b4c23ea4bf1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:15:57.184163 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf19723-bfe3-4600-bafc-b4c23ea4bf1b admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:57.184469 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf19723-bfe3-4600-bafc-b4c23ea4bf1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:57.184743 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf19723-bfe3-4600-bafc-b4c23ea4bf1b admin admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:57.185467 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf19723-bfe3-4600-bafc-b4c23ea4bf1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:15:57.187355 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 855/1711] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:15:56 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:15:57.188214 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083474bc-a03b-4c9a-8db3-3889ef09c613 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:15:57.189515 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-083474bc-a03b-4c9a-8db3-3889ef09c613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:15:57.192254 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf19723-bfe3-4600-bafc-b4c23ea4bf1b admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:15:57.214919 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083474bc-a03b-4c9a-8db3-3889ef09c613 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:15:57.224222 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa99f6f-054c-4510-bf6c-279c2116f19a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:15:57.225116 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa99f6f-054c-4510-bf6c-279c2116f19a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:57.225401 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa99f6f-054c-4510-bf6c-279c2116f19a admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:57.225680 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa99f6f-054c-4510-bf6c-279c2116f19a admin admin] PATH_INFO: `/v3/projects/7859dca5fd7a4dd28b7c9b303bfa5817` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:57.226963 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa99f6f-054c-4510-bf6c-279c2116f19a admin admin] RBAC: Authorizing `identity:delete_project(project_id=7859dca5fd7a4dd28b7c9b303bfa5817)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:15:57.234641 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa99f6f-054c-4510-bf6c-279c2116f19a admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:15:57.265882 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 857/1712] 10.222.0.43 () {60 vars in 1152 bytes} [Wed Jun 22 10:15:57 2022] POST /identity/v3/projects => generated 387 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:15:57.266992 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf19723-bfe3-4600-bafc-b4c23ea4bf1b admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:15:57.274803 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-fdf19723-bfe3-4600-bafc-b4c23ea4bf1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:15:57.332042 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-5aa99f6f-054c-4510-bf6c-279c2116f19a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7859dca5fd7a4dd28b7c9b303bfa5817', 'request_id': 'req-5aa99f6f-054c-4510-bf6c-279c2116f19a'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:15:57.388304 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-5aa99f6f-054c-4510-bf6c-279c2116f19a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7859dca5fd7a4dd28b7c9b303bfa5817', 'request_id': 'req-5aa99f6f-054c-4510-bf6c-279c2116f19a'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:15:57.411276 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-5aa99f6f-054c-4510-bf6c-279c2116f19a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7859dca5fd7a4dd28b7c9b303bfa5817', 'request_id': 'req-5aa99f6f-054c-4510-bf6c-279c2116f19a'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:15:57.461452 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:15:57.483228 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-5aa99f6f-054c-4510-bf6c-279c2116f19a admin admin] The token cache is being invalidate because project 7859dca5fd7a4dd28b7c9b303bfa5817 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:15:57.483639 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-5aa99f6f-054c-4510-bf6c-279c2116f19a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:15:57.489587 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-5aa99f6f-054c-4510-bf6c-279c2116f19a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:15:57.495968 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf19723-bfe3-4600-bafc-b4c23ea4bf1b admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:15:57.496434 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 856/1713] 10.222.0.43 () {58 vars in 1232 bytes} [Wed Jun 22 10:15:57 2022] DELETE /identity/v3/projects/7859dca5fd7a4dd28b7c9b303bfa5817 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:15:57.497445 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa99f6f-054c-4510-bf6c-279c2116f19a admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:15:57.501495 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-5aa99f6f-054c-4510-bf6c-279c2116f19a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:15:57.690995 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa99f6f-054c-4510-bf6c-279c2116f19a admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:15:57.696797 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac6b1c9-7b8b-4c47-8192-65055d1cabfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:15:57.697417 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac6b1c9-7b8b-4c47-8192-65055d1cabfd admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:57.697790 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac6b1c9-7b8b-4c47-8192-65055d1cabfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:57.698078 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac6b1c9-7b8b-4c47-8192-65055d1cabfd admin admin] PATH_INFO: `/v3/users` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:57.698899 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac6b1c9-7b8b-4c47-8192-65055d1cabfd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:15:57.701092 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac6b1c9-7b8b-4c47-8192-65055d1cabfd admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:15:57.740701 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468af245-e4b5-4ef4-8acd-94508bf9fdea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bbcb3d4dc704dfdb0097abc594ca855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:15:57.742429 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468af245-e4b5-4ef4-8acd-94508bf9fdea service cinder] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:57.749047 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468af245-e4b5-4ef4-8acd-94508bf9fdea service cinder] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:57.749462 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468af245-e4b5-4ef4-8acd-94508bf9fdea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:57.749938 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 857/1714] 10.222.0.43 () {60 vars in 1143 bytes} [Wed Jun 22 10:15:57 2022] POST /identity/v3/users => generated 294 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:15:57.751475 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad7dc83-a030-4da4-bd01-36028887a2bd None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:57.753968 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad7dc83-a030-4da4-bd01-36028887a2bd None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:57.753968 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad7dc83-a030-4da4-bd01-36028887a2bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:57.758624 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-468af245-e4b5-4ef4-8acd-94508bf9fdea service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:15:57.788671 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-6ad7dc83-a030-4da4-bd01-36028887a2bd None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:15:57.790090 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-6ad7dc83-a030-4da4-bd01-36028887a2bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:15:57.809571 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 858/1715] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:15:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:15:57.810716 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad7dc83-a030-4da4-bd01-36028887a2bd None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:15:57.832952 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad7dc83-a030-4da4-bd01-36028887a2bd None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:15:57.856916 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b840e3-16dd-4b4b-ad57-6b1fde05d7a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:15:57.857681 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b840e3-16dd-4b4b-ad57-6b1fde05d7a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:57.858343 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b840e3-16dd-4b4b-ad57-6b1fde05d7a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:57.858735 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b840e3-16dd-4b4b-ad57-6b1fde05d7a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:57.859597 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b840e3-16dd-4b4b-ad57-6b1fde05d7a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:15:57.861466 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b840e3-16dd-4b4b-ad57-6b1fde05d7a1 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:15:57.916453 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 859/1716] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:15:57 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:15:57.921178 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176250a0-3901-482f-8a59-95dc5628e3ce None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:57.922736 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176250a0-3901-482f-8a59-95dc5628e3ce None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:57.925408 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176250a0-3901-482f-8a59-95dc5628e3ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:57.987625 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468af245-e4b5-4ef4-8acd-94508bf9fdea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:15:57.989226 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468af245-e4b5-4ef4-8acd-94508bf9fdea service cinder] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:15:58.001670 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 858/1717] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:15:57 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 735 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:15:58.002756 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468af245-e4b5-4ef4-8acd-94508bf9fdea service cinder] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:15:58.003309 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-176250a0-3901-482f-8a59-95dc5628e3ce None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:15:58.005244 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-176250a0-3901-482f-8a59-95dc5628e3ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:15:58.014388 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468af245-e4b5-4ef4-8acd-94508bf9fdea service cinder] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:15:58.020793 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5360ae-6911-4133-9a10-7c66d5db66e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:15:58.021588 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5360ae-6911-4133-9a10-7c66d5db66e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:58.021996 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5360ae-6911-4133-9a10-7c66d5db66e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:58.022355 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5360ae-6911-4133-9a10-7c66d5db66e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:58.023239 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5360ae-6911-4133-9a10-7c66d5db66e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:15:58.024942 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5360ae-6911-4133-9a10-7c66d5db66e9 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:15:58.038997 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 859/1718] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:15:58 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:15:58.043610 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5360ae-6911-4133-9a10-7c66d5db66e9 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:15:58.043834 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 860/1719] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:15:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:15:58.048304 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176250a0-3901-482f-8a59-95dc5628e3ce None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:15:58.060373 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5360ae-6911-4133-9a10-7c66d5db66e9 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:15:58.068083 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4eed56-fa81-4fd8-92b5-56f062ea00b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:15:58.069189 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4eed56-fa81-4fd8-92b5-56f062ea00b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:58.069882 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4eed56-fa81-4fd8-92b5-56f062ea00b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:58.070440 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4eed56-fa81-4fd8-92b5-56f062ea00b2 admin admin] PATH_INFO: `/v3/projects/ed320c83e9ef43908271b69bd8d5ce27/users/c3eacbb5eda14053b4a309c657a2339d/roles/9f88c83743f745a9a785a2f454753f06` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:58.081101 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176250a0-3901-482f-8a59-95dc5628e3ce None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:15:58.090486 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4eed56-fa81-4fd8-92b5-56f062ea00b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed320c83e9ef43908271b69bd8d5ce27, user_id=c3eacbb5eda14053b4a309c657a2339d, role_id=9f88c83743f745a9a785a2f454753f06)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:15:58.093518 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4eed56-fa81-4fd8-92b5-56f062ea00b2 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:15:58.100191 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5856a134-104e-4692-aba7-1ba080eb1da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:15:58.100927 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5856a134-104e-4692-aba7-1ba080eb1da1 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:58.101209 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5856a134-104e-4692-aba7-1ba080eb1da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:58.101490 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5856a134-104e-4692-aba7-1ba080eb1da1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:58.102274 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5856a134-104e-4692-aba7-1ba080eb1da1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:15:58.102602 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5856a134-104e-4692-aba7-1ba080eb1da1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:15:58.110239 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5856a134-104e-4692-aba7-1ba080eb1da1 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:15:58.114770 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:15:58.138476 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 860/1720] 10.222.0.43 () {60 vars in 1482 bytes} [Wed Jun 22 10:15:58 2022] PUT /identity/v3/projects/ed320c83e9ef43908271b69bd8d5ce27/users/c3eacbb5eda14053b4a309c657a2339d/roles/9f88c83743f745a9a785a2f454753f06 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:15:58.147084 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed8927c-a5dd-4254-a20e-44381643255b None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:58.147084 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed8927c-a5dd-4254-a20e-44381643255b None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:58.147084 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed8927c-a5dd-4254-a20e-44381643255b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:58.176364 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 861/1721] 10.222.0.43 () {58 vars in 1152 bytes} [Wed Jun 22 10:15:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:15:58.183699 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5856a134-104e-4692-aba7-1ba080eb1da1 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:15:58.229545 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5856a134-104e-4692-aba7-1ba080eb1da1 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:15:58.243372 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-9ed8927c-a5dd-4254-a20e-44381643255b None None] MFA Rules not processed for user `c3eacbb5eda14053b4a309c657a2339d`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:15:58.249183 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-9ed8927c-a5dd-4254-a20e-44381643255b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:15:58.395507 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47221aa-f560-4a29-a9af-088f85b76d29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:15:58.396202 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47221aa-f560-4a29-a9af-088f85b76d29 admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:58.396319 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47221aa-f560-4a29-a9af-088f85b76d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:58.396601 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47221aa-f560-4a29-a9af-088f85b76d29 admin admin] PATH_INFO: `/v3/projects` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:58.397314 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47221aa-f560-4a29-a9af-088f85b76d29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:15:58.400370 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47221aa-f560-4a29-a9af-088f85b76d29 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:15:58.469845 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 861/1722] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:15:58 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:15:58.474609 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed8927c-a5dd-4254-a20e-44381643255b None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:15:58.494663 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 862/1723] 10.222.0.43 () {60 vars in 1152 bytes} [Wed Jun 22 10:15:58 2022] POST /identity/v3/projects => generated 363 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:15:58.498633 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47221aa-f560-4a29-a9af-088f85b76d29 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:15:58.519034 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed8927c-a5dd-4254-a20e-44381643255b None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:15:58.611354 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:15:58.720180 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47221aa-f560-4a29-a9af-088f85b76d29 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:15:58.734125 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af194b48-6b66-4e5d-ac98-17063eb0d0f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:15:58.735729 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af194b48-6b66-4e5d-ac98-17063eb0d0f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:58.740900 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bcdd7b-4973-40c2-bd64-a116ef72d10a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:15:58.741399 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af194b48-6b66-4e5d-ac98-17063eb0d0f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:58.742053 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af194b48-6b66-4e5d-ac98-17063eb0d0f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:58.742817 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bcdd7b-4973-40c2-bd64-a116ef72d10a admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:58.746264 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af194b48-6b66-4e5d-ac98-17063eb0d0f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:15:58.746713 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bcdd7b-4973-40c2-bd64-a116ef72d10a admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:58.748377 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bcdd7b-4973-40c2-bd64-a116ef72d10a admin admin] PATH_INFO: `/v3/users` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:58.749223 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bcdd7b-4973-40c2-bd64-a116ef72d10a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:15:58.751650 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bcdd7b-4973-40c2-bd64-a116ef72d10a admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:15:58.753060 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af194b48-6b66-4e5d-ac98-17063eb0d0f9 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:15:58.808272 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 862/1724] 10.222.0.43 () {60 vars in 1152 bytes} [Wed Jun 22 10:15:58 2022] POST /identity/v3/projects => generated 387 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:15:58.810352 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 863/1725] 10.222.0.43 () {60 vars in 1143 bytes} [Wed Jun 22 10:15:58 2022] POST /identity/v3/users => generated 282 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 10:15:58.825407 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bcdd7b-4973-40c2-bd64-a116ef72d10a admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:15:58.839130 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af194b48-6b66-4e5d-ac98-17063eb0d0f9 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:15:58.879685 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bcdd7b-4973-40c2-bd64-a116ef72d10a admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:15:59.161942 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af194b48-6b66-4e5d-ac98-17063eb0d0f9 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:15:59.170041 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23dbaec-72cb-4bf1-a20a-fc5b9c5dcca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:15:59.176533 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23dbaec-72cb-4bf1-a20a-fc5b9c5dcca3 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:59.177414 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23dbaec-72cb-4bf1-a20a-fc5b9c5dcca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:59.178511 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23dbaec-72cb-4bf1-a20a-fc5b9c5dcca3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:59.179285 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858b714c-f309-4957-9a63-6ecc9aaee6f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:15:59.180184 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23dbaec-72cb-4bf1-a20a-fc5b9c5dcca3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:15:59.180984 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858b714c-f309-4957-9a63-6ecc9aaee6f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:59.183491 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23dbaec-72cb-4bf1-a20a-fc5b9c5dcca3 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:15:59.183962 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858b714c-f309-4957-9a63-6ecc9aaee6f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:59.184347 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858b714c-f309-4957-9a63-6ecc9aaee6f4 admin admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:59.186767 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858b714c-f309-4957-9a63-6ecc9aaee6f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:15:59.188990 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858b714c-f309-4957-9a63-6ecc9aaee6f4 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:15:59.217841 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 864/1726] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:15:58 2022] GET /identity/v3/roles => generated 1420 bytes in 404 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:15:59.220983 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26da850-d7c9-4958-8509-723d00cdb8f7 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:59.223089 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26da850-d7c9-4958-8509-723d00cdb8f7 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:59.224515 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26da850-d7c9-4958-8509-723d00cdb8f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:59.245245 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 863/1727] 10.222.0.43 () {60 vars in 1143 bytes} [Wed Jun 22 10:15:58 2022] POST /identity/v3/users => generated 300 bytes in 432 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:15:59.248980 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858b714c-f309-4957-9a63-6ecc9aaee6f4 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:15:59.265279 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:15:59.274361 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858b714c-f309-4957-9a63-6ecc9aaee6f4 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:15:59.276547 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-e26da850-d7c9-4958-8509-723d00cdb8f7 None None] MFA Rules not processed for user `7be3d844dcee4d19966fc7944463a0bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:15:59.281826 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-e26da850-d7c9-4958-8509-723d00cdb8f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:15:59.287756 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e78bad-3e61-434c-98b9-22207ebe2fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:15:59.288605 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e78bad-3e61-434c-98b9-22207ebe2fe4 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:59.289424 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e78bad-3e61-434c-98b9-22207ebe2fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:59.290091 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e78bad-3e61-434c-98b9-22207ebe2fe4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:59.291918 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e78bad-3e61-434c-98b9-22207ebe2fe4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:15:59.296345 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e78bad-3e61-434c-98b9-22207ebe2fe4 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:15:59.342904 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 864/1728] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:15:59 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:15:59.343979 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e78bad-3e61-434c-98b9-22207ebe2fe4 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:15:59.386137 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e78bad-3e61-434c-98b9-22207ebe2fe4 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:15:59.408632 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32eac364-53f6-4f69-94b0-5f24d9ce0d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:15:59.410618 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eac364-53f6-4f69-94b0-5f24d9ce0d1a admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:59.413137 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eac364-53f6-4f69-94b0-5f24d9ce0d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:59.415208 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eac364-53f6-4f69-94b0-5f24d9ce0d1a admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:59.419263 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32eac364-53f6-4f69-94b0-5f24d9ce0d1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:15:59.432948 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32eac364-53f6-4f69-94b0-5f24d9ce0d1a admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:15:59.481522 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 865/1729] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:15:59 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:15:59.485311 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32eac364-53f6-4f69-94b0-5f24d9ce0d1a admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:15:59.492500 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 865/1730] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:15:59 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:15:59.516324 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26da850-d7c9-4958-8509-723d00cdb8f7 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:15:59.540959 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32eac364-53f6-4f69-94b0-5f24d9ce0d1a admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:15:59.560958 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146565b0-36a5-4c34-be3a-b61d0c190c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:15:59.561935 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146565b0-36a5-4c34-be3a-b61d0c190c04 admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:59.562223 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146565b0-36a5-4c34-be3a-b61d0c190c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:59.563444 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26da850-d7c9-4958-8509-723d00cdb8f7 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:15:59.567197 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146565b0-36a5-4c34-be3a-b61d0c190c04 admin admin] PATH_INFO: `/v3/projects/e075bdd900e84b7ea24568b4b033905d/users/ec6346df7d6846098761e3310b5deab6/roles/9f88c83743f745a9a785a2f454753f06` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:59.576045 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155af321-5115-44e0-aeac-a2d3b97d3281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:15:59.577264 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155af321-5115-44e0-aeac-a2d3b97d3281 admin admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:59.578633 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155af321-5115-44e0-aeac-a2d3b97d3281 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:59.579049 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155af321-5115-44e0-aeac-a2d3b97d3281 admin admin] PATH_INFO: `/v3/projects/d77300cfda894a4cae6399c2284c2496/users/c1bcd47d99b645b38a5be4f85ec1ddc3/roles/26d9c2ab5dfc4e6d9ca80c6014123906` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:59.598604 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155af321-5115-44e0-aeac-a2d3b97d3281 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d77300cfda894a4cae6399c2284c2496, user_id=c1bcd47d99b645b38a5be4f85ec1ddc3, role_id=26d9c2ab5dfc4e6d9ca80c6014123906)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:15:59.601761 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155af321-5115-44e0-aeac-a2d3b97d3281 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:15:59.617725 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146565b0-36a5-4c34-be3a-b61d0c190c04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e075bdd900e84b7ea24568b4b033905d, user_id=ec6346df7d6846098761e3310b5deab6, role_id=9f88c83743f745a9a785a2f454753f06)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:15:59.620717 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146565b0-36a5-4c34-be3a-b61d0c190c04 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:15:59.655122 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 866/1731] 10.222.0.43 () {60 vars in 1482 bytes} [Wed Jun 22 10:15:59 2022] PUT /identity/v3/projects/e075bdd900e84b7ea24568b4b033905d/users/ec6346df7d6846098761e3310b5deab6/roles/9f88c83743f745a9a785a2f454753f06 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:15:59.666936 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1727902-c8a9-4d1a-8d36-a1975d0ae385 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:15:59.667285 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1727902-c8a9-4d1a-8d36-a1975d0ae385 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:15:59.667571 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 866/1732] 10.222.0.43 () {60 vars in 1482 bytes} [Wed Jun 22 10:15:59 2022] PUT /identity/v3/projects/d77300cfda894a4cae6399c2284c2496/users/c1bcd47d99b645b38a5be4f85ec1ddc3/roles/26d9c2ab5dfc4e6d9ca80c6014123906 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:15:59.670573 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1727902-c8a9-4d1a-8d36-a1975d0ae385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:15:59.671691 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155af321-5115-44e0-aeac-a2d3b97d3281 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:15:59.729147 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-a1727902-c8a9-4d1a-8d36-a1975d0ae385 None None] MFA Rules not processed for user `ec6346df7d6846098761e3310b5deab6`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:15:59.734602 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-a1727902-c8a9-4d1a-8d36-a1975d0ae385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:15:59.858296 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:15:59.916276 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155af321-5115-44e0-aeac-a2d3b97d3281 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:15:59.959216 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 867/1733] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:15:59 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:15:59.960186 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1727902-c8a9-4d1a-8d36-a1975d0ae385 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:00.132348 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c885b3-4500-4350-8bc6-5434acef8de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:00.132348 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c885b3-4500-4350-8bc6-5434acef8de1 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:00.132348 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c885b3-4500-4350-8bc6-5434acef8de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:00.132348 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c885b3-4500-4350-8bc6-5434acef8de1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:00.132775 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c885b3-4500-4350-8bc6-5434acef8de1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:00.134256 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c885b3-4500-4350-8bc6-5434acef8de1 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:00.184167 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1727902-c8a9-4d1a-8d36-a1975d0ae385 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:00.184753 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 867/1734] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:15:59 2022] GET /identity/v3/roles => generated 1420 bytes in 513 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:16:00.188569 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c885b3-4500-4350-8bc6-5434acef8de1 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:00.199240 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5293d04e-906c-4bdd-98a6-b8e608825b19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:00.202283 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5293d04e-906c-4bdd-98a6-b8e608825b19 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:00.202772 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5293d04e-906c-4bdd-98a6-b8e608825b19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:00.203269 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5293d04e-906c-4bdd-98a6-b8e608825b19 admin admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:00.207574 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5293d04e-906c-4bdd-98a6-b8e608825b19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:00.211311 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c885b3-4500-4350-8bc6-5434acef8de1 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:00.213248 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5293d04e-906c-4bdd-98a6-b8e608825b19 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:00.219905 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d71ace8-8b1a-4353-aa70-da381a0ddf1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:00.221784 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d71ace8-8b1a-4353-aa70-da381a0ddf1d admin admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:00.229026 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d71ace8-8b1a-4353-aa70-da381a0ddf1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:00.229680 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d71ace8-8b1a-4353-aa70-da381a0ddf1d admin admin] PATH_INFO: `/v3/projects/d77300cfda894a4cae6399c2284c2496/users/c1bcd47d99b645b38a5be4f85ec1ddc3/roles/26d9c2ab5dfc4e6d9ca80c6014123906` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:00.234817 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d71ace8-8b1a-4353-aa70-da381a0ddf1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d77300cfda894a4cae6399c2284c2496, user_id=c1bcd47d99b645b38a5be4f85ec1ddc3, role_id=26d9c2ab5dfc4e6d9ca80c6014123906)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:00.238143 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d71ace8-8b1a-4353-aa70-da381a0ddf1d admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:00.292986 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 868/1735] 10.222.0.43 () {60 vars in 1152 bytes} [Wed Jun 22 10:15:59 2022] POST /identity/v3/projects => generated 365 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:16:00.294136 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5293d04e-906c-4bdd-98a6-b8e608825b19 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:00.295112 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 868/1736] 10.222.0.43 () {60 vars in 1482 bytes} [Wed Jun 22 10:16:00 2022] PUT /identity/v3/projects/d77300cfda894a4cae6399c2284c2496/users/c1bcd47d99b645b38a5be4f85ec1ddc3/roles/26d9c2ab5dfc4e6d9ca80c6014123906 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:16:00.312863 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4893eb3-8884-46ef-a4f5-737d63ff4788 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:00.314548 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4893eb3-8884-46ef-a4f5-737d63ff4788 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:00.315376 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4893eb3-8884-46ef-a4f5-737d63ff4788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:00.340081 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:16:00.441989 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-b4893eb3-8884-46ef-a4f5-737d63ff4788 None None] MFA Rules not processed for user `c1bcd47d99b645b38a5be4f85ec1ddc3`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:16:00.442312 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5293d04e-906c-4bdd-98a6-b8e608825b19 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:00.443260 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-b4893eb3-8884-46ef-a4f5-737d63ff4788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:16:00.474408 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e77f29-6af8-40f6-9119-8f2adc155dd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:00.475235 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e77f29-6af8-40f6-9119-8f2adc155dd7 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:00.475556 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e77f29-6af8-40f6-9119-8f2adc155dd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:00.477611 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e77f29-6af8-40f6-9119-8f2adc155dd7 admin admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:00.488852 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e77f29-6af8-40f6-9119-8f2adc155dd7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:00.503143 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e77f29-6af8-40f6-9119-8f2adc155dd7 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:00.581352 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 869/1737] 10.222.0.43 () {60 vars in 1143 bytes} [Wed Jun 22 10:16:00 2022] POST /identity/v3/users => generated 289 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:16:00.587126 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e77f29-6af8-40f6-9119-8f2adc155dd7 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:00.619463 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e77f29-6af8-40f6-9119-8f2adc155dd7 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:00.650446 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d632b7b5-3211-4cff-ae1c-df395bc70c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:00.660237 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d632b7b5-3211-4cff-ae1c-df395bc70c08 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:00.670381 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d632b7b5-3211-4cff-ae1c-df395bc70c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:00.670776 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d632b7b5-3211-4cff-ae1c-df395bc70c08 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:00.682750 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d632b7b5-3211-4cff-ae1c-df395bc70c08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:00.684820 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d632b7b5-3211-4cff-ae1c-df395bc70c08 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:00.687463 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 869/1738] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:16:00 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 375 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:16:00.698604 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4893eb3-8884-46ef-a4f5-737d63ff4788 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:00.700033 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-b4893eb3-8884-46ef-a4f5-737d63ff4788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:16:00.717550 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 870/1739] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:16:00 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:16:00.728924 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d632b7b5-3211-4cff-ae1c-df395bc70c08 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:00.761524 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d632b7b5-3211-4cff-ae1c-df395bc70c08 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:00.768963 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d080b5-9a1c-4c42-94de-418ed0d41375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:00.770464 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d080b5-9a1c-4c42-94de-418ed0d41375 admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:00.770716 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d080b5-9a1c-4c42-94de-418ed0d41375 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:00.770868 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d080b5-9a1c-4c42-94de-418ed0d41375 admin admin] PATH_INFO: `/v3/projects/9af7a7b51ff14a038ba1c8c86aba2dba/users/5e0e2e00b24344578d4a251d10ef6b91/roles/26d9c2ab5dfc4e6d9ca80c6014123906` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:00.818510 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d080b5-9a1c-4c42-94de-418ed0d41375 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9af7a7b51ff14a038ba1c8c86aba2dba, user_id=5e0e2e00b24344578d4a251d10ef6b91, role_id=26d9c2ab5dfc4e6d9ca80c6014123906)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:00.832366 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d080b5-9a1c-4c42-94de-418ed0d41375 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:00.843878 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4893eb3-8884-46ef-a4f5-737d63ff4788 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:00.857042 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a05b5a3-f56e-4c47-871d-65474b9946a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bbcb3d4dc704dfdb0097abc594ca855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:00.857747 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a05b5a3-f56e-4c47-871d-65474b9946a8 service cinder] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:00.858039 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a05b5a3-f56e-4c47-871d-65474b9946a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:00.858448 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a05b5a3-f56e-4c47-871d-65474b9946a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:00.870220 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 871/1740] 10.222.0.43 () {60 vars in 1482 bytes} [Wed Jun 22 10:16:00 2022] PUT /identity/v3/projects/9af7a7b51ff14a038ba1c8c86aba2dba/users/5e0e2e00b24344578d4a251d10ef6b91/roles/26d9c2ab5dfc4e6d9ca80c6014123906 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:16:00.874210 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d080b5-9a1c-4c42-94de-418ed0d41375 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:00.887767 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a05b5a3-f56e-4c47-871d-65474b9946a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:00.889312 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a05b5a3-f56e-4c47-871d-65474b9946a8 service cinder] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:00.916177 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:16:00.940370 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 870/1741] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:16:00 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 10:16:01.070658 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d080b5-9a1c-4c42-94de-418ed0d41375 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:01.081845 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579c8df8-de00-4680-8d3e-d1c2c4f33e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:01.082749 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579c8df8-de00-4680-8d3e-d1c2c4f33e47 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:01.083078 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579c8df8-de00-4680-8d3e-d1c2c4f33e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:01.090646 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579c8df8-de00-4680-8d3e-d1c2c4f33e47 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:01.090646 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579c8df8-de00-4680-8d3e-d1c2c4f33e47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:01.091693 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579c8df8-de00-4680-8d3e-d1c2c4f33e47 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:01.128273 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 872/1742] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:16:00 2022] GET /identity/v3/roles => generated 1420 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:16:01.129627 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a05b5a3-f56e-4c47-871d-65474b9946a8 service cinder] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:01.145994 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a05b5a3-f56e-4c47-871d-65474b9946a8 service cinder] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:01.161440 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fad2eb-58b5-4673-bdfa-b1bd02c24f39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:01.163226 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fad2eb-58b5-4673-bdfa-b1bd02c24f39 admin admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:01.163635 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fad2eb-58b5-4673-bdfa-b1bd02c24f39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:01.164063 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fad2eb-58b5-4673-bdfa-b1bd02c24f39 admin admin] PATH_INFO: `/v3/projects/9af7a7b51ff14a038ba1c8c86aba2dba/users/5e0e2e00b24344578d4a251d10ef6b91/roles/26d9c2ab5dfc4e6d9ca80c6014123906` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:01.169525 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fad2eb-58b5-4673-bdfa-b1bd02c24f39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9af7a7b51ff14a038ba1c8c86aba2dba, user_id=5e0e2e00b24344578d4a251d10ef6b91, role_id=26d9c2ab5dfc4e6d9ca80c6014123906)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:01.176954 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fad2eb-58b5-4673-bdfa-b1bd02c24f39 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:01.212390 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c6677a-43f7-4fb7-87b7-a6f981d85d3e None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:01.212805 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c6677a-43f7-4fb7-87b7-a6f981d85d3e None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:01.213284 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c6677a-43f7-4fb7-87b7-a6f981d85d3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:01.240718 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 871/1743] 10.222.0.43 () {60 vars in 1482 bytes} [Wed Jun 22 10:16:01 2022] PUT /identity/v3/projects/9af7a7b51ff14a038ba1c8c86aba2dba/users/5e0e2e00b24344578d4a251d10ef6b91/roles/26d9c2ab5dfc4e6d9ca80c6014123906 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:16:01.252979 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af778d1-b9b1-4955-89d7-6345cf934725 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:01.253734 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af778d1-b9b1-4955-89d7-6345cf934725 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:01.254300 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af778d1-b9b1-4955-89d7-6345cf934725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:01.271779 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-70c6677a-43f7-4fb7-87b7-a6f981d85d3e None None] MFA Rules not processed for user `317e7e7dd5c741d49d34a1fd949a7c07`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:16:01.277655 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-70c6677a-43f7-4fb7-87b7-a6f981d85d3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:16:01.381722 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-4af778d1-b9b1-4955-89d7-6345cf934725 None None] MFA Rules not processed for user `5e0e2e00b24344578d4a251d10ef6b91`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:16:01.387678 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-4af778d1-b9b1-4955-89d7-6345cf934725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:16:01.492987 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 873/1744] 10.222.0.43 () {58 vars in 1009 bytes} [Wed Jun 22 10:16:01 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:16:01.664224 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 872/1745] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:16:01 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 413 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:16:01.672033 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c6677a-43f7-4fb7-87b7-a6f981d85d3e None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:01.673916 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-70c6677a-43f7-4fb7-87b7-a6f981d85d3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:16:01.753515 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:16:01.835300 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c6677a-43f7-4fb7-87b7-a6f981d85d3e None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:01.843620 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af778d1-b9b1-4955-89d7-6345cf934725 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:01.845284 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-4af778d1-b9b1-4955-89d7-6345cf934725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:16:01.854854 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e887456-8be2-4282-8f2c-881587dd0727 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bbcb3d4dc704dfdb0097abc594ca855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:01.857995 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e887456-8be2-4282-8f2c-881587dd0727 service cinder] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:01.858305 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e887456-8be2-4282-8f2c-881587dd0727 service cinder] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:01.858598 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e887456-8be2-4282-8f2c-881587dd0727 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:01.924638 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e887456-8be2-4282-8f2c-881587dd0727 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:01.928236 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e887456-8be2-4282-8f2c-881587dd0727 service cinder] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:01.982179 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 874/1746] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:16:01 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:16:02.127001 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af778d1-b9b1-4955-89d7-6345cf934725 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:02.144983 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5c3f26-58c3-4ec7-a3d9-366304a87a68 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9566f8cca2574f4cb5edcbf384f368a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:02.145665 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5c3f26-58c3-4ec7-a3d9-366304a87a68 service swift] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:02.145986 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5c3f26-58c3-4ec7-a3d9-366304a87a68 service swift] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:02.146269 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5c3f26-58c3-4ec7-a3d9-366304a87a68 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:02.156421 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e887456-8be2-4282-8f2c-881587dd0727 service cinder] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:02.166008 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5c3f26-58c3-4ec7-a3d9-366304a87a68 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:02.166579 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e887456-8be2-4282-8f2c-881587dd0727 service cinder] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:02.167647 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5c3f26-58c3-4ec7-a3d9-366304a87a68 service swift] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:02.179328 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9597e555-a1a3-4067-a701-2b017921214b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bbcb3d4dc704dfdb0097abc594ca855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:02.180231 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9597e555-a1a3-4067-a701-2b017921214b service cinder] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:02.180525 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9597e555-a1a3-4067-a701-2b017921214b service cinder] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:02.180802 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9597e555-a1a3-4067-a701-2b017921214b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:02.185927 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 873/1747] 10.222.0.43 () {60 vars in 1384 bytes} [Wed Jun 22 10:16:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 22 10:16:02.455810 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9597e555-a1a3-4067-a701-2b017921214b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:02.462089 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9597e555-a1a3-4067-a701-2b017921214b service cinder] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:02.509834 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 875/1748] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:16:02 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 10:16:02.948935 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5c3f26-58c3-4ec7-a3d9-366304a87a68 service swift] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:02.993967 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a74d347-2507-4bcc-9b6a-ec327f957f89 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:02.994230 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a74d347-2507-4bcc-9b6a-ec327f957f89 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:02.994515 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a74d347-2507-4bcc-9b6a-ec327f957f89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:03.140238 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-7a74d347-2507-4bcc-9b6a-ec327f957f89 None None] MFA Rules not processed for user `0d7292401816437fba46d073c4746e45`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:16:03.141522 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-7a74d347-2507-4bcc-9b6a-ec327f957f89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:16:03.202001 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5c3f26-58c3-4ec7-a3d9-366304a87a68 service swift] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:03.222607 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d973f7c6-4aba-4d88-a56b-5403ecd060d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:03.224047 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d973f7c6-4aba-4d88-a56b-5403ecd060d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:03.224496 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d973f7c6-4aba-4d88-a56b-5403ecd060d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:03.224990 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d973f7c6-4aba-4d88-a56b-5403ecd060d0 admin admin] PATH_INFO: `/v3/users/c3eacbb5eda14053b4a309c657a2339d` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:03.226962 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d973f7c6-4aba-4d88-a56b-5403ecd060d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3eacbb5eda14053b4a309c657a2339d)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:03.230033 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d973f7c6-4aba-4d88-a56b-5403ecd060d0 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:03.252314 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:16:03.375633 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-d973f7c6-4aba-4d88-a56b-5403ecd060d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3eacbb5eda14053b4a309c657a2339d'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:03.404135 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 876/1749] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:16:02 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 411 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:16:03.415974 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca7fc1f-ae7a-4669-bcc7-3a9516d164bc None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:03.416528 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca7fc1f-ae7a-4669-bcc7-3a9516d164bc None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:03.416960 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca7fc1f-ae7a-4669-bcc7-3a9516d164bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:03.432629 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-d973f7c6-4aba-4d88-a56b-5403ecd060d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3eacbb5eda14053b4a309c657a2339d'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:03.448332 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-d973f7c6-4aba-4d88-a56b-5403ecd060d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3eacbb5eda14053b4a309c657a2339d'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:03.477272 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-d973f7c6-4aba-4d88-a56b-5403ecd060d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3eacbb5eda14053b4a309c657a2339d'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:03.479926 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-d973f7c6-4aba-4d88-a56b-5403ecd060d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3eacbb5eda14053b4a309c657a2339d'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:03.492600 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-dca7fc1f-ae7a-4669-bcc7-3a9516d164bc None None] MFA Rules not processed for user `0d7292401816437fba46d073c4746e45`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:16:03.498465 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-dca7fc1f-ae7a-4669-bcc7-3a9516d164bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:16:03.502886 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 874/1750] 10.222.0.43 () {58 vars in 1223 bytes} [Wed Jun 22 10:16:02 2022] DELETE /identity/v3/users/c3eacbb5eda14053b4a309c657a2339d => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:16:03.519155 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f91fbd-0259-49f1-a478-184cda3ac2dc None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:03.519694 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f91fbd-0259-49f1-a478-184cda3ac2dc None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:03.520207 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f91fbd-0259-49f1-a478-184cda3ac2dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:03.558906 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-a7f91fbd-0259-49f1-a478-184cda3ac2dc None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:16:03.560540 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-a7f91fbd-0259-49f1-a478-184cda3ac2dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:16:03.722469 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 877/1751] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:16:03 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:16:03.725011 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca7fc1f-ae7a-4669-bcc7-3a9516d164bc None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:03.727338 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-dca7fc1f-ae7a-4669-bcc7-3a9516d164bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:16:03.745421 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:16:03.756158 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 875/1752] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:16:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:16:03.976103 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca7fc1f-ae7a-4669-bcc7-3a9516d164bc None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:03.999199 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b393ebb-a6b0-422f-be5f-e53d2fd54fe8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '158a49aa3750478a84bf71b9aad24397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:04.000471 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b393ebb-a6b0-422f-be5f-e53d2fd54fe8 service nova] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:04.000915 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b393ebb-a6b0-422f-be5f-e53d2fd54fe8 service nova] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:04.001535 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b393ebb-a6b0-422f-be5f-e53d2fd54fe8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:04.006549 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-7b393ebb-a6b0-422f-be5f-e53d2fd54fe8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:16:04.029817 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b393ebb-a6b0-422f-be5f-e53d2fd54fe8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:04.037004 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b393ebb-a6b0-422f-be5f-e53d2fd54fe8 service nova] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:04.086992 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 878/1753] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:16:03 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:16:04.139634 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f91fbd-0259-49f1-a478-184cda3ac2dc None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:04.144086 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cee5c5-3d11-44b1-b525-46328164816b None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:04.146188 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cee5c5-3d11-44b1-b525-46328164816b None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:04.146402 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-a7f91fbd-0259-49f1-a478-184cda3ac2dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:16:04.146999 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cee5c5-3d11-44b1-b525-46328164816b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:04.224119 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-85cee5c5-3d11-44b1-b525-46328164816b None None] MFA Rules not processed for user `75753b29a78640df9622d4e2655baf9b`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:16:04.227366 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-85cee5c5-3d11-44b1-b525-46328164816b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:16:04.344084 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f91fbd-0259-49f1-a478-184cda3ac2dc None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:04.353555 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c27ba5a-96d1-4d39-81f7-427bfe6a480b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe93d4c0737249fd8623bb5ce188e34e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:04.354554 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c27ba5a-96d1-4d39-81f7-427bfe6a480b service neutron] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:04.354912 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c27ba5a-96d1-4d39-81f7-427bfe6a480b service neutron] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:04.355197 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c27ba5a-96d1-4d39-81f7-427bfe6a480b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:04.369074 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c27ba5a-96d1-4d39-81f7-427bfe6a480b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:04.377137 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c27ba5a-96d1-4d39-81f7-427bfe6a480b service neutron] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:04.411287 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 876/1754] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:16:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:16:04.490480 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 879/1755] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:16:04 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:16:06.091709 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dc68d0-603d-4287-a922-88cc3032d56d None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:06.092284 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dc68d0-603d-4287-a922-88cc3032d56d None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:06.092284 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dc68d0-603d-4287-a922-88cc3032d56d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:06.153895 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-b3dc68d0-603d-4287-a922-88cc3032d56d None None] MFA Rules not processed for user `78fe3fc4334c43d7a5ef6d70f9f57523`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:16:06.160342 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-b3dc68d0-603d-4287-a922-88cc3032d56d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:16:06.214187 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:16:06.414860 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cee5c5-3d11-44b1-b525-46328164816b None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:06.416445 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-85cee5c5-3d11-44b1-b525-46328164816b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:16:06.447190 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 877/1756] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:16:06 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:16:06.465525 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cee5c5-3d11-44b1-b525-46328164816b None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:06.495174 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb690ceb-6cc8-4a8a-8892-5da0030391be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:06.496746 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb690ceb-6cc8-4a8a-8892-5da0030391be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:06.502561 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb690ceb-6cc8-4a8a-8892-5da0030391be admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:06.503212 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb690ceb-6cc8-4a8a-8892-5da0030391be admin admin] PATH_INFO: `/v3/projects/ed320c83e9ef43908271b69bd8d5ce27` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:06.508042 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb690ceb-6cc8-4a8a-8892-5da0030391be admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed320c83e9ef43908271b69bd8d5ce27)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:06.510850 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb690ceb-6cc8-4a8a-8892-5da0030391be admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:06.516236 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0b6543-e0f4-46b0-8128-42dfe43021ff None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:06.516733 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0b6543-e0f4-46b0-8128-42dfe43021ff None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:06.517188 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0b6543-e0f4-46b0-8128-42dfe43021ff None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:06.520893 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 878/1757] 10.222.0.43 () {54 vars in 912 bytes} [Wed Jun 22 10:16:06 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:16:06.533548 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4171f4fa-17fd-4845-9be6-f2c62fdccc31 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:06.533923 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4171f4fa-17fd-4845-9be6-f2c62fdccc31 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:06.534275 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4171f4fa-17fd-4845-9be6-f2c62fdccc31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:06.613615 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-4171f4fa-17fd-4845-9be6-f2c62fdccc31 None None] MFA Rules not processed for user `fe93d4c0737249fd8623bb5ce188e34e`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:16:06.614745 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-4171f4fa-17fd-4845-9be6-f2c62fdccc31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:16:06.648102 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 879/1758] 10.222.0.43 () {58 vars in 1009 bytes} [Wed Jun 22 10:16:06 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:16:06.649073 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4171f4fa-17fd-4845-9be6-f2c62fdccc31 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:06.657261 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-4171f4fa-17fd-4845-9be6-f2c62fdccc31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:16:06.730600 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4171f4fa-17fd-4845-9be6-f2c62fdccc31 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:06.749984 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-fb690ceb-6cc8-4a8a-8892-5da0030391be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed320c83e9ef43908271b69bd8d5ce27', 'request_id': 'req-fb690ceb-6cc8-4a8a-8892-5da0030391be'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:06.803234 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-fb690ceb-6cc8-4a8a-8892-5da0030391be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed320c83e9ef43908271b69bd8d5ce27', 'request_id': 'req-fb690ceb-6cc8-4a8a-8892-5da0030391be'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:06.849452 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-fb690ceb-6cc8-4a8a-8892-5da0030391be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed320c83e9ef43908271b69bd8d5ce27', 'request_id': 'req-fb690ceb-6cc8-4a8a-8892-5da0030391be'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:06.885847 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-fb690ceb-6cc8-4a8a-8892-5da0030391be admin admin] The token cache is being invalidate because project ed320c83e9ef43908271b69bd8d5ce27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:16:06.886144 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-fb690ceb-6cc8-4a8a-8892-5da0030391be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:06.887021 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-fb690ceb-6cc8-4a8a-8892-5da0030391be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:06.898744 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 880/1759] 10.222.0.43 () {58 vars in 1232 bytes} [Wed Jun 22 10:16:06 2022] DELETE /identity/v3/projects/ed320c83e9ef43908271b69bd8d5ce27 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:16:06.898744 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb690ceb-6cc8-4a8a-8892-5da0030391be admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:06.902532 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-fb690ceb-6cc8-4a8a-8892-5da0030391be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:16:06.947453 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:16:07.015752 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c884694-18b4-4626-b08b-f65fc2d5cefa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:07.022604 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c884694-18b4-4626-b08b-f65fc2d5cefa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:07.044533 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c884694-18b4-4626-b08b-f65fc2d5cefa admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:07.044923 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c884694-18b4-4626-b08b-f65fc2d5cefa admin admin] PATH_INFO: `/v3/users/ec6346df7d6846098761e3310b5deab6` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:07.046476 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb690ceb-6cc8-4a8a-8892-5da0030391be admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:07.050397 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c884694-18b4-4626-b08b-f65fc2d5cefa admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec6346df7d6846098761e3310b5deab6)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:07.052632 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c884694-18b4-4626-b08b-f65fc2d5cefa admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:07.066369 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33103a9b-8156-4ea6-884d-b4ff380664c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe93d4c0737249fd8623bb5ce188e34e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:07.067034 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33103a9b-8156-4ea6-884d-b4ff380664c5 service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:07.067325 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33103a9b-8156-4ea6-884d-b4ff380664c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:07.067609 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33103a9b-8156-4ea6-884d-b4ff380664c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:07.072269 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-33103a9b-8156-4ea6-884d-b4ff380664c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:16:07.104169 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33103a9b-8156-4ea6-884d-b4ff380664c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:07.104611 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33103a9b-8156-4ea6-884d-b4ff380664c5 service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:07.130164 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 881/1760] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:16:06 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:16:07.131253 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33103a9b-8156-4ea6-884d-b4ff380664c5 service neutron] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:07.132615 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-33103a9b-8156-4ea6-884d-b4ff380664c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:16:07.162744 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33103a9b-8156-4ea6-884d-b4ff380664c5 service neutron] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:07.175204 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c5d609-6983-42d0-80c5-2a9b289e73f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:07.176200 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c5d609-6983-42d0-80c5-2a9b289e73f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:07.176839 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c5d609-6983-42d0-80c5-2a9b289e73f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:07.177245 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c5d609-6983-42d0-80c5-2a9b289e73f7 admin admin] PATH_INFO: `/v3/users/c1bcd47d99b645b38a5be4f85ec1ddc3` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:07.178644 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c5d609-6983-42d0-80c5-2a9b289e73f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1bcd47d99b645b38a5be4f85ec1ddc3)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:07.181313 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c5d609-6983-42d0-80c5-2a9b289e73f7 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:07.268421 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-9c884694-18b4-4626-b08b-f65fc2d5cefa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec6346df7d6846098761e3310b5deab6'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:07.321597 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-9c884694-18b4-4626-b08b-f65fc2d5cefa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec6346df7d6846098761e3310b5deab6'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:07.334503 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-9c884694-18b4-4626-b08b-f65fc2d5cefa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec6346df7d6846098761e3310b5deab6'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:07.359514 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-9c884694-18b4-4626-b08b-f65fc2d5cefa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec6346df7d6846098761e3310b5deab6'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:07.360871 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-9c884694-18b4-4626-b08b-f65fc2d5cefa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec6346df7d6846098761e3310b5deab6'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:07.363667 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-94c5d609-6983-42d0-80c5-2a9b289e73f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1bcd47d99b645b38a5be4f85ec1ddc3'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:07.401252 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 880/1761] 10.222.0.43 () {58 vars in 1223 bytes} [Wed Jun 22 10:16:06 2022] DELETE /identity/v3/users/ec6346df7d6846098761e3310b5deab6 => generated 0 bytes in 752 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:16:07.404709 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb38206-7627-4e42-aea7-f469deda9062 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:07.405270 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb38206-7627-4e42-aea7-f469deda9062 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:07.407108 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb38206-7627-4e42-aea7-f469deda9062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:07.411158 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-94c5d609-6983-42d0-80c5-2a9b289e73f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1bcd47d99b645b38a5be4f85ec1ddc3'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:07.439427 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-94c5d609-6983-42d0-80c5-2a9b289e73f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1bcd47d99b645b38a5be4f85ec1ddc3'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:07.442580 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-94c5d609-6983-42d0-80c5-2a9b289e73f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1bcd47d99b645b38a5be4f85ec1ddc3'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:07.478642 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-94c5d609-6983-42d0-80c5-2a9b289e73f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1bcd47d99b645b38a5be4f85ec1ddc3'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:07.480507 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-adb38206-7627-4e42-aea7-f469deda9062 None None] MFA Rules not processed for user `fe93d4c0737249fd8623bb5ce188e34e`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:16:07.490693 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-adb38206-7627-4e42-aea7-f469deda9062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:16:07.500596 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 882/1762] 10.222.0.43 () {58 vars in 1223 bytes} [Wed Jun 22 10:16:07 2022] DELETE /identity/v3/users/c1bcd47d99b645b38a5be4f85ec1ddc3 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:16:07.520388 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7db434b-173e-43bc-9a07-0e00dfd7992e None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:07.520765 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7db434b-173e-43bc-9a07-0e00dfd7992e None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:07.521089 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7db434b-173e-43bc-9a07-0e00dfd7992e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:07.583066 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:16:07.629510 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-d7db434b-173e-43bc-9a07-0e00dfd7992e None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:16:07.644911 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-d7db434b-173e-43bc-9a07-0e00dfd7992e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:16:07.746229 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 881/1763] 10.222.0.59 () {58 vars in 1015 bytes} [Wed Jun 22 10:16:07 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:16:07.828023 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb38206-7627-4e42-aea7-f469deda9062 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:07.830783 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-adb38206-7627-4e42-aea7-f469deda9062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:16:07.857655 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb38206-7627-4e42-aea7-f469deda9062 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:07.964869 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 883/1764] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:16:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 449 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:16:08.040698 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7db434b-173e-43bc-9a07-0e00dfd7992e None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:08.042311 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-d7db434b-173e-43bc-9a07-0e00dfd7992e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:16:08.132889 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a35a87-4e1b-4be4-892c-7019f3cce21b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe93d4c0737249fd8623bb5ce188e34e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:08.133923 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a35a87-4e1b-4be4-892c-7019f3cce21b service neutron] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:08.134319 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a35a87-4e1b-4be4-892c-7019f3cce21b service neutron] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:08.134703 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a35a87-4e1b-4be4-892c-7019f3cce21b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:08.153750 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a35a87-4e1b-4be4-892c-7019f3cce21b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:08.155435 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a35a87-4e1b-4be4-892c-7019f3cce21b service neutron] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:08.160529 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:16:08.181511 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 882/1765] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:16:07 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 10:16:08.285321 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7db434b-173e-43bc-9a07-0e00dfd7992e None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:08.303330 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628b7f37-dac5-4330-b56a-de7f3488e0be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe93d4c0737249fd8623bb5ce188e34e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:08.304028 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628b7f37-dac5-4330-b56a-de7f3488e0be service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:08.304322 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628b7f37-dac5-4330-b56a-de7f3488e0be service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:08.327431 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628b7f37-dac5-4330-b56a-de7f3488e0be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:08.386566 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628b7f37-dac5-4330-b56a-de7f3488e0be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:08.388241 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628b7f37-dac5-4330-b56a-de7f3488e0be service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:08.443819 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 884/1766] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:16:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:16:08.759699 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a35a87-4e1b-4be4-892c-7019f3cce21b service neutron] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:08.762685 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-f9a35a87-4e1b-4be4-892c-7019f3cce21b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:16:09.043795 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a35a87-4e1b-4be4-892c-7019f3cce21b service neutron] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:09.096408 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35215fc-eff2-4937-99fa-24d04d55db42 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '158a49aa3750478a84bf71b9aad24397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:09.101725 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35215fc-eff2-4937-99fa-24d04d55db42 service nova] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:09.102023 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35215fc-eff2-4937-99fa-24d04d55db42 service nova] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:09.102385 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35215fc-eff2-4937-99fa-24d04d55db42 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:09.114561 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-b35215fc-eff2-4937-99fa-24d04d55db42 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:16:09.352811 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35215fc-eff2-4937-99fa-24d04d55db42 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:09.357843 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35215fc-eff2-4937-99fa-24d04d55db42 service nova] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:09.375156 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 883/1767] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:16:08 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 616 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 10:16:10.006202 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646f3b0e-6d1c-460f-9c34-d6b7d84d87ef None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:10.007713 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646f3b0e-6d1c-460f-9c34-d6b7d84d87ef None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:10.009079 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646f3b0e-6d1c-460f-9c34-d6b7d84d87ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:10.077909 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-646f3b0e-6d1c-460f-9c34-d6b7d84d87ef None None] MFA Rules not processed for user `0d7292401816437fba46d073c4746e45`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:16:10.079349 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-646f3b0e-6d1c-460f-9c34-d6b7d84d87ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:16:10.324261 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35215fc-eff2-4937-99fa-24d04d55db42 service nova] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:10.326102 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-b35215fc-eff2-4937-99fa-24d04d55db42 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:16:10.363066 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35215fc-eff2-4937-99fa-24d04d55db42 service nova] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:10.376666 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83a4dd2-0e90-4d8f-8a35-c5bed192b410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:10.379234 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83a4dd2-0e90-4d8f-8a35-c5bed192b410 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:10.379762 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83a4dd2-0e90-4d8f-8a35-c5bed192b410 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:10.380257 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83a4dd2-0e90-4d8f-8a35-c5bed192b410 admin admin] PATH_INFO: `/v3/projects/d77300cfda894a4cae6399c2284c2496` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:10.381891 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83a4dd2-0e90-4d8f-8a35-c5bed192b410 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d77300cfda894a4cae6399c2284c2496)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:10.384842 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83a4dd2-0e90-4d8f-8a35-c5bed192b410 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:10.402551 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 885/1768] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:16:10 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 398 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:16:10.407634 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:16:10.491195 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-e83a4dd2-0e90-4d8f-8a35-c5bed192b410 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd77300cfda894a4cae6399c2284c2496', 'request_id': 'req-e83a4dd2-0e90-4d8f-8a35-c5bed192b410'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:10.514574 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-e83a4dd2-0e90-4d8f-8a35-c5bed192b410 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd77300cfda894a4cae6399c2284c2496', 'request_id': 'req-e83a4dd2-0e90-4d8f-8a35-c5bed192b410'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:10.535008 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-e83a4dd2-0e90-4d8f-8a35-c5bed192b410 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd77300cfda894a4cae6399c2284c2496', 'request_id': 'req-e83a4dd2-0e90-4d8f-8a35-c5bed192b410'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:10.567699 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-e83a4dd2-0e90-4d8f-8a35-c5bed192b410 admin admin] The token cache is being invalidate because project d77300cfda894a4cae6399c2284c2496 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:16:10.569168 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-e83a4dd2-0e90-4d8f-8a35-c5bed192b410 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:10.571367 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-e83a4dd2-0e90-4d8f-8a35-c5bed192b410 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:10.577796 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 884/1769] 10.222.0.43 () {58 vars in 1232 bytes} [Wed Jun 22 10:16:10 2022] DELETE /identity/v3/projects/d77300cfda894a4cae6399c2284c2496 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:16:10.590762 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9394ad6-ef5f-4823-a092-0d652dc61e52 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:10.591236 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9394ad6-ef5f-4823-a092-0d652dc61e52 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:10.591482 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9394ad6-ef5f-4823-a092-0d652dc61e52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:10.701704 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-b9394ad6-ef5f-4823-a092-0d652dc61e52 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:16:10.707705 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-b9394ad6-ef5f-4823-a092-0d652dc61e52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:16:11.047598 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 886/1770] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:16:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 465 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:16:11.062007 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9296c173-a606-460d-898a-48a9f9bebf06 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:11.063304 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9296c173-a606-460d-898a-48a9f9bebf06 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:11.063769 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9296c173-a606-460d-898a-48a9f9bebf06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:11.108937 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9394ad6-ef5f-4823-a092-0d652dc61e52 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:11.110722 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-b9394ad6-ef5f-4823-a092-0d652dc61e52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:16:11.175040 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9394ad6-ef5f-4823-a092-0d652dc61e52 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:11.180510 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-9296c173-a606-460d-898a-48a9f9bebf06 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:16:11.181786 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-9296c173-a606-460d-898a-48a9f9bebf06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:16:11.199437 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c73ced-d971-4de0-97ff-0b35ace9831d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:11.203440 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c73ced-d971-4de0-97ff-0b35ace9831d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:11.204182 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c73ced-d971-4de0-97ff-0b35ace9831d admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:11.206963 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c73ced-d971-4de0-97ff-0b35ace9831d admin admin] PATH_INFO: `/v3/projects/e075bdd900e84b7ea24568b4b033905d` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:11.211004 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 885/1771] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:16:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:16:11.213095 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9296c173-a606-460d-898a-48a9f9bebf06 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:11.225203 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c73ced-d971-4de0-97ff-0b35ace9831d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e075bdd900e84b7ea24568b4b033905d)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:11.232187 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9296c173-a606-460d-898a-48a9f9bebf06 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:11.233167 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c73ced-d971-4de0-97ff-0b35ace9831d admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:11.245894 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2261c78-ca28-4ab0-8bee-1a9c02fe91b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:11.246631 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2261c78-ca28-4ab0-8bee-1a9c02fe91b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:11.246915 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2261c78-ca28-4ab0-8bee-1a9c02fe91b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:11.247190 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2261c78-ca28-4ab0-8bee-1a9c02fe91b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:11.251097 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2261c78-ca28-4ab0-8bee-1a9c02fe91b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:16:11.251420 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2261c78-ca28-4ab0-8bee-1a9c02fe91b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:11.257358 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2261c78-ca28-4ab0-8bee-1a9c02fe91b8 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:11.286642 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 886/1772] 10.222.0.43 () {58 vars in 1152 bytes} [Wed Jun 22 10:16:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:16:11.291179 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2261c78-ca28-4ab0-8bee-1a9c02fe91b8 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:11.310947 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2261c78-ca28-4ab0-8bee-1a9c02fe91b8 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:11.325966 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10527503-77ee-453b-bf3e-a61cdd0a676f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:11.326809 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10527503-77ee-453b-bf3e-a61cdd0a676f admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:11.326925 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10527503-77ee-453b-bf3e-a61cdd0a676f admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:11.327326 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10527503-77ee-453b-bf3e-a61cdd0a676f admin admin] PATH_INFO: `/v3/projects` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:11.327908 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10527503-77ee-453b-bf3e-a61cdd0a676f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:11.330929 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10527503-77ee-453b-bf3e-a61cdd0a676f admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:11.391149 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 887/1773] 10.222.0.43 () {60 vars in 1152 bytes} [Wed Jun 22 10:16:11 2022] POST /identity/v3/projects => generated 385 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:16:11.395793 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10527503-77ee-453b-bf3e-a61cdd0a676f admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:11.417457 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-59c73ced-d971-4de0-97ff-0b35ace9831d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e075bdd900e84b7ea24568b4b033905d', 'request_id': 'req-59c73ced-d971-4de0-97ff-0b35ace9831d'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:11.425906 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-59c73ced-d971-4de0-97ff-0b35ace9831d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e075bdd900e84b7ea24568b4b033905d', 'request_id': 'req-59c73ced-d971-4de0-97ff-0b35ace9831d'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:11.437233 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-59c73ced-d971-4de0-97ff-0b35ace9831d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e075bdd900e84b7ea24568b4b033905d', 'request_id': 'req-59c73ced-d971-4de0-97ff-0b35ace9831d'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:11.482602 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-59c73ced-d971-4de0-97ff-0b35ace9831d admin admin] The token cache is being invalidate because project e075bdd900e84b7ea24568b4b033905d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:16:11.482914 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-59c73ced-d971-4de0-97ff-0b35ace9831d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:11.483804 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-59c73ced-d971-4de0-97ff-0b35ace9831d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:11.486032 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 887/1774] 10.222.0.43 () {58 vars in 1232 bytes} [Wed Jun 22 10:16:11 2022] DELETE /identity/v3/projects/e075bdd900e84b7ea24568b4b033905d => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:16:11.490213 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c73ced-d971-4de0-97ff-0b35ace9831d admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:11.493238 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-59c73ced-d971-4de0-97ff-0b35ace9831d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:16:11.502835 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:16:11.544338 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10527503-77ee-453b-bf3e-a61cdd0a676f admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:11.564924 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ef4c40-2d6f-4d3e-9ba9-dcc02c808d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:11.565934 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ef4c40-2d6f-4d3e-9ba9-dcc02c808d5a admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:11.566296 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ef4c40-2d6f-4d3e-9ba9-dcc02c808d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:11.566551 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ef4c40-2d6f-4d3e-9ba9-dcc02c808d5a admin admin] PATH_INFO: `/v3/users` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:11.567356 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ef4c40-2d6f-4d3e-9ba9-dcc02c808d5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:11.572092 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ef4c40-2d6f-4d3e-9ba9-dcc02c808d5a admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:11.623347 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 888/1775] 10.222.0.43 () {60 vars in 1143 bytes} [Wed Jun 22 10:16:11 2022] POST /identity/v3/users => generated 293 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:16:11.629300 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ef4c40-2d6f-4d3e-9ba9-dcc02c808d5a admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:11.639335 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-76ef4c40-2d6f-4d3e-9ba9-dcc02c808d5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:16:11.687100 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ef4c40-2d6f-4d3e-9ba9-dcc02c808d5a admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:11.732259 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550451d9-de94-45b7-b862-682c71ce3674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:11.733025 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550451d9-de94-45b7-b862-682c71ce3674 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:11.733244 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550451d9-de94-45b7-b862-682c71ce3674 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:11.733605 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550451d9-de94-45b7-b862-682c71ce3674 admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:11.734443 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550451d9-de94-45b7-b862-682c71ce3674 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:11.751135 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550451d9-de94-45b7-b862-682c71ce3674 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:11.832356 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 889/1776] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:16:11 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 10:16:11.832356 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550451d9-de94-45b7-b862-682c71ce3674 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:11.888249 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c73ced-d971-4de0-97ff-0b35ace9831d admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:11.899924 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f60b07-bbe8-4815-8dd7-fa03764c2299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:11.901745 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f60b07-bbe8-4815-8dd7-fa03764c2299 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:11.904618 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f60b07-bbe8-4815-8dd7-fa03764c2299 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:11.905292 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f60b07-bbe8-4815-8dd7-fa03764c2299 admin admin] PATH_INFO: `/v3/users/5e0e2e00b24344578d4a251d10ef6b91` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:11.910477 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f60b07-bbe8-4815-8dd7-fa03764c2299 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e0e2e00b24344578d4a251d10ef6b91)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:11.914908 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550451d9-de94-45b7-b862-682c71ce3674 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:11.918503 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f60b07-bbe8-4815-8dd7-fa03764c2299 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:11.935628 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ddad77-bbea-4cef-8423-d8654cd702e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:11.936331 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ddad77-bbea-4cef-8423-d8654cd702e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:11.936618 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ddad77-bbea-4cef-8423-d8654cd702e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:11.936900 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ddad77-bbea-4cef-8423-d8654cd702e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:11.942568 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ddad77-bbea-4cef-8423-d8654cd702e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:11.946461 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ddad77-bbea-4cef-8423-d8654cd702e5 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:11.971594 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 890/1777] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:16:11 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:16:11.981181 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ddad77-bbea-4cef-8423-d8654cd702e5 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:12.042546 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-61f60b07-bbe8-4815-8dd7-fa03764c2299 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e0e2e00b24344578d4a251d10ef6b91'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:12.046582 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ddad77-bbea-4cef-8423-d8654cd702e5 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:12.063625 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-61f60b07-bbe8-4815-8dd7-fa03764c2299 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e0e2e00b24344578d4a251d10ef6b91'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:12.069903 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d3e641-7506-464e-a4f8-00749986d3ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:12.070914 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d3e641-7506-464e-a4f8-00749986d3ef admin admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:12.071207 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d3e641-7506-464e-a4f8-00749986d3ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:12.071562 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d3e641-7506-464e-a4f8-00749986d3ef admin admin] PATH_INFO: `/v3/projects/e26c960937f6491689b5c14ba06c7d7a/users/2d212594fe424758a04c19248e7b1282/roles/9f88c83743f745a9a785a2f454753f06` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:12.082299 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-61f60b07-bbe8-4815-8dd7-fa03764c2299 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e0e2e00b24344578d4a251d10ef6b91'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:12.083967 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-61f60b07-bbe8-4815-8dd7-fa03764c2299 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e0e2e00b24344578d4a251d10ef6b91'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:12.097044 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-61f60b07-bbe8-4815-8dd7-fa03764c2299 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e0e2e00b24344578d4a251d10ef6b91'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:12.120241 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 888/1778] 10.222.0.43 () {58 vars in 1223 bytes} [Wed Jun 22 10:16:11 2022] DELETE /identity/v3/users/5e0e2e00b24344578d4a251d10ef6b91 => generated 0 bytes in 630 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:16:12.132761 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d3e641-7506-464e-a4f8-00749986d3ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=e26c960937f6491689b5c14ba06c7d7a, user_id=2d212594fe424758a04c19248e7b1282, role_id=9f88c83743f745a9a785a2f454753f06)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:12.147053 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d3e641-7506-464e-a4f8-00749986d3ef admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:12.206919 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4647e55-61de-4267-b8d8-7d447bf4c650 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:12.207272 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4647e55-61de-4267-b8d8-7d447bf4c650 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:12.210073 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4647e55-61de-4267-b8d8-7d447bf4c650 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:12.213281 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 889/1779] 10.222.0.43 () {54 vars in 921 bytes} [Wed Jun 22 10:16:12 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:16:12.224446 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=87,keystone:DELETE=7,keystone:INSERT=6 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:16:12.236608 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 891/1780] 10.222.0.43 () {60 vars in 1482 bytes} [Wed Jun 22 10:16:11 2022] PUT /identity/v3/projects/e26c960937f6491689b5c14ba06c7d7a/users/2d212594fe424758a04c19248e7b1282/roles/9f88c83743f745a9a785a2f454753f06 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:16:12.251582 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f8a8ce-00d9-4890-b2ee-5d50ad906399 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:12.252441 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f8a8ce-00d9-4890-b2ee-5d50ad906399 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:12.252738 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f8a8ce-00d9-4890-b2ee-5d50ad906399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:12.309102 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-d8f8a8ce-00d9-4890-b2ee-5d50ad906399 None None] MFA Rules not processed for user `2d212594fe424758a04c19248e7b1282`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:16:12.310827 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-d8f8a8ce-00d9-4890-b2ee-5d50ad906399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:16:12.416706 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5273f4-b629-4a24-8b83-33e313d14502 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:12.417646 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5273f4-b629-4a24-8b83-33e313d14502 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:12.418426 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5273f4-b629-4a24-8b83-33e313d14502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:12.461900 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-3b5273f4-b629-4a24-8b83-33e313d14502 None None] MFA Rules not processed for user `158a49aa3750478a84bf71b9aad24397`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:16:12.463982 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-3b5273f4-b629-4a24-8b83-33e313d14502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:16:12.524785 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 890/1781] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:16:12 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:16:12.532272 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f8a8ce-00d9-4890-b2ee-5d50ad906399 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:12.535109 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-d8f8a8ce-00d9-4890-b2ee-5d50ad906399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:16:12.566663 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:16:12.679612 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 892/1782] 10.222.0.43 () {58 vars in 1018 bytes} [Wed Jun 22 10:16:12 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:16:12.713889 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f8a8ce-00d9-4890-b2ee-5d50ad906399 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:12.718006 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d63b5de-a374-439a-9c47-03828d0b0c6f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bbcb3d4dc704dfdb0097abc594ca855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:12.718857 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d63b5de-a374-439a-9c47-03828d0b0c6f service cinder] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:12.719150 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d63b5de-a374-439a-9c47-03828d0b0c6f service cinder] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:12.719481 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d63b5de-a374-439a-9c47-03828d0b0c6f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:12.755312 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d63b5de-a374-439a-9c47-03828d0b0c6f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:12.756810 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d63b5de-a374-439a-9c47-03828d0b0c6f service cinder] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:12.774372 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 891/1783] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:16:12 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 10:16:14.144367 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5273f4-b629-4a24-8b83-33e313d14502 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:14.146876 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-3b5273f4-b629-4a24-8b83-33e313d14502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:16:14.166220 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5273f4-b629-4a24-8b83-33e313d14502 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:14.182700 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff2cf26-8f22-4a74-bcd5-c0549c975717 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '158a49aa3750478a84bf71b9aad24397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:14.193238 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff2cf26-8f22-4a74-bcd5-c0549c975717 service nova] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:14.194248 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff2cf26-8f22-4a74-bcd5-c0549c975717 service nova] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:14.194794 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff2cf26-8f22-4a74-bcd5-c0549c975717 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:14.213884 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff2cf26-8f22-4a74-bcd5-c0549c975717 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:14.219054 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff2cf26-8f22-4a74-bcd5-c0549c975717 service nova] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:14.266957 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 893/1784] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:16:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:16:15.942040 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1268e358-ccc6-4d10-bbd2-2eb795755176 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:15.942662 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1268e358-ccc6-4d10-bbd2-2eb795755176 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:15.943328 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1268e358-ccc6-4d10-bbd2-2eb795755176 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:15.945954 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 892/1785] 10.222.0.43 () {54 vars in 921 bytes} [Wed Jun 22 10:16:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:16:16.159757 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e5c702-bda8-45a3-a413-ff41dfc8d0ee None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:16.160332 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e5c702-bda8-45a3-a413-ff41dfc8d0ee None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:16.160332 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e5c702-bda8-45a3-a413-ff41dfc8d0ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:16.203373 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-38e5c702-bda8-45a3-a413-ff41dfc8d0ee None None] MFA Rules not processed for user `158a49aa3750478a84bf71b9aad24397`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:16:16.206844 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-38e5c702-bda8-45a3-a413-ff41dfc8d0ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:16:16.234489 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 894/1786] 10.222.0.43 () {58 vars in 1018 bytes} [Wed Jun 22 10:16:16 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:16:16.417737 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1268e358-ccc6-4d10-bbd2-2eb795755176 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:16.424186 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-1268e358-ccc6-4d10-bbd2-2eb795755176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:16:16.611939 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1268e358-ccc6-4d10-bbd2-2eb795755176 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:16.620503 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6e9a00-79be-444a-9ef3-ff9c79f9f0d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:16.621815 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6e9a00-79be-444a-9ef3-ff9c79f9f0d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:16.622114 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6e9a00-79be-444a-9ef3-ff9c79f9f0d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:16.622494 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6e9a00-79be-444a-9ef3-ff9c79f9f0d8 admin admin] PATH_INFO: `/v3/users/2d212594fe424758a04c19248e7b1282` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:16.624266 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6e9a00-79be-444a-9ef3-ff9c79f9f0d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d212594fe424758a04c19248e7b1282)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:16.628220 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6e9a00-79be-444a-9ef3-ff9c79f9f0d8 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:16.836302 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-ac6e9a00-79be-444a-9ef3-ff9c79f9f0d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d212594fe424758a04c19248e7b1282'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:16.912365 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-ac6e9a00-79be-444a-9ef3-ff9c79f9f0d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d212594fe424758a04c19248e7b1282'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:16.921517 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e5c702-bda8-45a3-a413-ff41dfc8d0ee None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:16.923732 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-38e5c702-bda8-45a3-a413-ff41dfc8d0ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:16:16.945620 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-ac6e9a00-79be-444a-9ef3-ff9c79f9f0d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d212594fe424758a04c19248e7b1282'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:16.946385 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-ac6e9a00-79be-444a-9ef3-ff9c79f9f0d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d212594fe424758a04c19248e7b1282'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:16.963699 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e5c702-bda8-45a3-a413-ff41dfc8d0ee None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:16.969427 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-ac6e9a00-79be-444a-9ef3-ff9c79f9f0d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d212594fe424758a04c19248e7b1282'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:16.982704 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff3928b-f74c-4dd2-98ae-0b9881c9f3a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:16.987333 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff3928b-f74c-4dd2-98ae-0b9881c9f3a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:16.988851 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff3928b-f74c-4dd2-98ae-0b9881c9f3a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:16.989360 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff3928b-f74c-4dd2-98ae-0b9881c9f3a6 admin admin] PATH_INFO: `/v3/projects/9af7a7b51ff14a038ba1c8c86aba2dba` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:16.991304 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff3928b-f74c-4dd2-98ae-0b9881c9f3a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9af7a7b51ff14a038ba1c8c86aba2dba)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:16.992023 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 893/1787] 10.222.0.43 () {58 vars in 1223 bytes} [Wed Jun 22 10:16:16 2022] DELETE /identity/v3/users/2d212594fe424758a04c19248e7b1282 => generated 0 bytes in 572 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:16:16.993568 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc6b2df-3d07-4327-95f3-e7612b301939 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:16.993979 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc6b2df-3d07-4327-95f3-e7612b301939 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:16.994278 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc6b2df-3d07-4327-95f3-e7612b301939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:16.994913 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff3928b-f74c-4dd2-98ae-0b9881c9f3a6 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:17.038057 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-3fc6b2df-3d07-4327-95f3-e7612b301939 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:16:17.039691 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-3fc6b2df-3d07-4327-95f3-e7612b301939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:16:17.158864 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:16:17.174474 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-5ff3928b-f74c-4dd2-98ae-0b9881c9f3a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9af7a7b51ff14a038ba1c8c86aba2dba', 'request_id': 'req-5ff3928b-f74c-4dd2-98ae-0b9881c9f3a6'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:17.198725 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-5ff3928b-f74c-4dd2-98ae-0b9881c9f3a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9af7a7b51ff14a038ba1c8c86aba2dba', 'request_id': 'req-5ff3928b-f74c-4dd2-98ae-0b9881c9f3a6'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:17.217275 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-5ff3928b-f74c-4dd2-98ae-0b9881c9f3a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9af7a7b51ff14a038ba1c8c86aba2dba', 'request_id': 'req-5ff3928b-f74c-4dd2-98ae-0b9881c9f3a6'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:17.244263 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-5ff3928b-f74c-4dd2-98ae-0b9881c9f3a6 admin admin] The token cache is being invalidate because project 9af7a7b51ff14a038ba1c8c86aba2dba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:16:17.248585 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-5ff3928b-f74c-4dd2-98ae-0b9881c9f3a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:17.250241 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-5ff3928b-f74c-4dd2-98ae-0b9881c9f3a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:17.270023 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 895/1788] 10.222.0.43 () {58 vars in 1232 bytes} [Wed Jun 22 10:16:16 2022] DELETE /identity/v3/projects/9af7a7b51ff14a038ba1c8c86aba2dba => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:16:17.270023 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff3928b-f74c-4dd2-98ae-0b9881c9f3a6 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:17.276758 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-5ff3928b-f74c-4dd2-98ae-0b9881c9f3a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:16:17.327495 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 894/1789] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:16:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:16:17.330306 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522686df-b73b-473c-8fb7-eb3b3746f9f7 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:17.338065 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522686df-b73b-473c-8fb7-eb3b3746f9f7 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:17.339949 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522686df-b73b-473c-8fb7-eb3b3746f9f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:17.403604 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-522686df-b73b-473c-8fb7-eb3b3746f9f7 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:16:17.406051 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-522686df-b73b-473c-8fb7-eb3b3746f9f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:16:17.512709 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:16:17.563530 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff3928b-f74c-4dd2-98ae-0b9881c9f3a6 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:17.582645 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0dde0c-feb0-4dde-af56-5787b7ae95ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '158a49aa3750478a84bf71b9aad24397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:17.583734 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0dde0c-feb0-4dde-af56-5787b7ae95ef service nova] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:17.584027 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0dde0c-feb0-4dde-af56-5787b7ae95ef service nova] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:17.584339 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0dde0c-feb0-4dde-af56-5787b7ae95ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:17.587187 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-3d0dde0c-feb0-4dde-af56-5787b7ae95ef service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:16:17.598245 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 895/1790] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:16:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:16:17.599370 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522686df-b73b-473c-8fb7-eb3b3746f9f7 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:17.604846 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-522686df-b73b-473c-8fb7-eb3b3746f9f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:16:17.618210 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0dde0c-feb0-4dde-af56-5787b7ae95ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:17.620175 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0dde0c-feb0-4dde-af56-5787b7ae95ef service nova] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:17.640460 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 896/1791] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:16:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:16:17.641820 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae59016-c1d9-47ca-9017-e76190f7fce7 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:17.644343 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae59016-c1d9-47ca-9017-e76190f7fce7 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:17.649724 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae59016-c1d9-47ca-9017-e76190f7fce7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:17.691763 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-7ae59016-c1d9-47ca-9017-e76190f7fce7 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:16:17.693230 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-7ae59016-c1d9-47ca-9017-e76190f7fce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:16:17.724695 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 897/1792] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:16:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:16:17.730947 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae59016-c1d9-47ca-9017-e76190f7fce7 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:17.765452 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae59016-c1d9-47ca-9017-e76190f7fce7 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:17.769966 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522686df-b73b-473c-8fb7-eb3b3746f9f7 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:17.776508 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7444084b-b68d-418f-bf89-0471386562c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe93d4c0737249fd8623bb5ce188e34e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:17.777194 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7444084b-b68d-418f-bf89-0471386562c6 service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:17.777666 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7444084b-b68d-418f-bf89-0471386562c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:17.777852 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7444084b-b68d-418f-bf89-0471386562c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:17.779168 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d010d8-4779-459b-85c7-24b8ffdd9e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:17.779857 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d010d8-4779-459b-85c7-24b8ffdd9e90 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:17.780144 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d010d8-4779-459b-85c7-24b8ffdd9e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:17.780423 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d010d8-4779-459b-85c7-24b8ffdd9e90 admin admin] PATH_INFO: `/v3/domains` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:17.781171 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d010d8-4779-459b-85c7-24b8ffdd9e90 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:16:17.781481 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d010d8-4779-459b-85c7-24b8ffdd9e90 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:17.783959 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d010d8-4779-459b-85c7-24b8ffdd9e90 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:17.815630 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7444084b-b68d-418f-bf89-0471386562c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:17.815947 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7444084b-b68d-418f-bf89-0471386562c6 service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:17.816136 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 898/1793] 10.222.0.43 () {58 vars in 1152 bytes} [Wed Jun 22 10:16:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:16:17.817208 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d010d8-4779-459b-85c7-24b8ffdd9e90 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:17.836734 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 896/1794] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:16:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:16:17.841378 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d010d8-4779-459b-85c7-24b8ffdd9e90 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:17.856974 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac5aeb6-4d2b-4c24-9157-cf1eeb02f568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:17.857665 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac5aeb6-4d2b-4c24-9157-cf1eeb02f568 admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:17.857984 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac5aeb6-4d2b-4c24-9157-cf1eeb02f568 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:17.858270 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac5aeb6-4d2b-4c24-9157-cf1eeb02f568 admin admin] PATH_INFO: `/v3/projects` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:17.858980 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac5aeb6-4d2b-4c24-9157-cf1eeb02f568 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:17.861878 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac5aeb6-4d2b-4c24-9157-cf1eeb02f568 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:17.907565 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 899/1795] 10.222.0.43 () {60 vars in 1152 bytes} [Wed Jun 22 10:16:17 2022] POST /identity/v3/projects => generated 387 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:16:17.913039 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7444084b-b68d-418f-bf89-0471386562c6 service neutron] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:17.930656 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7444084b-b68d-418f-bf89-0471386562c6 service neutron] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:18.072122 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0f2ef1-8edc-49a6-8bdd-048784231190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:18.072749 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0f2ef1-8edc-49a6-8bdd-048784231190 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:18.073181 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0f2ef1-8edc-49a6-8bdd-048784231190 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:18.075532 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0f2ef1-8edc-49a6-8bdd-048784231190 admin admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:18.076989 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0f2ef1-8edc-49a6-8bdd-048784231190 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:18.082472 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0f2ef1-8edc-49a6-8bdd-048784231190 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:18.150310 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 897/1796] 10.222.0.43 () {60 vars in 1143 bytes} [Wed Jun 22 10:16:17 2022] POST /identity/v3/users => generated 294 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 10:16:18.154460 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac5aeb6-4d2b-4c24-9157-cf1eeb02f568 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:18.172023 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac5aeb6-4d2b-4c24-9157-cf1eeb02f568 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:18.187421 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43da68bd-c6bd-4753-88da-332cb6a42bf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:18.189763 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43da68bd-c6bd-4753-88da-332cb6a42bf7 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:18.190264 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43da68bd-c6bd-4753-88da-332cb6a42bf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:18.191369 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43da68bd-c6bd-4753-88da-332cb6a42bf7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:18.192289 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43da68bd-c6bd-4753-88da-332cb6a42bf7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:18.194132 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43da68bd-c6bd-4753-88da-332cb6a42bf7 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:18.225053 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 900/1797] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:16:18 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:16:18.230799 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0f2ef1-8edc-49a6-8bdd-048784231190 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:18.258968 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0f2ef1-8edc-49a6-8bdd-048784231190 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:18.270271 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12261b81-c8cf-403c-ae3a-4ae8ef6d02db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:18.271298 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12261b81-c8cf-403c-ae3a-4ae8ef6d02db admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:18.273246 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12261b81-c8cf-403c-ae3a-4ae8ef6d02db admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:18.274620 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12261b81-c8cf-403c-ae3a-4ae8ef6d02db admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:18.275534 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12261b81-c8cf-403c-ae3a-4ae8ef6d02db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:18.278397 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12261b81-c8cf-403c-ae3a-4ae8ef6d02db admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:18.281287 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:16:18.312236 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 898/1798] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:16:18 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:16:18.316297 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43da68bd-c6bd-4753-88da-332cb6a42bf7 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:18.328566 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43da68bd-c6bd-4753-88da-332cb6a42bf7 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:18.337587 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b290ebf4-1f80-40db-96ae-1da375e9852d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:18.340878 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b290ebf4-1f80-40db-96ae-1da375e9852d admin admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:18.342361 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b290ebf4-1f80-40db-96ae-1da375e9852d admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:18.342662 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b290ebf4-1f80-40db-96ae-1da375e9852d admin admin] PATH_INFO: `/v3/projects/c38d59fb6b0c4c4c8554d78b0f53f1c1/users/c6f1f3c015844b1cb7015730abba0a97/roles/9f88c83743f745a9a785a2f454753f06` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:18.382827 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b290ebf4-1f80-40db-96ae-1da375e9852d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c38d59fb6b0c4c4c8554d78b0f53f1c1, user_id=c6f1f3c015844b1cb7015730abba0a97, role_id=9f88c83743f745a9a785a2f454753f06)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:18.386801 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b290ebf4-1f80-40db-96ae-1da375e9852d admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:18.432133 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 901/1799] 10.222.0.43 () {60 vars in 1482 bytes} [Wed Jun 22 10:16:18 2022] PUT /identity/v3/projects/c38d59fb6b0c4c4c8554d78b0f53f1c1/users/c6f1f3c015844b1cb7015730abba0a97/roles/9f88c83743f745a9a785a2f454753f06 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:16:18.444862 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6c0fb9-a136-41e9-ad33-63f01a72d8ca None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:18.445671 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6c0fb9-a136-41e9-ad33-63f01a72d8ca None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:18.446265 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6c0fb9-a136-41e9-ad33-63f01a72d8ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:18.513581 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-fe6c0fb9-a136-41e9-ad33-63f01a72d8ca None None] MFA Rules not processed for user `c6f1f3c015844b1cb7015730abba0a97`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:16:18.515173 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-fe6c0fb9-a136-41e9-ad33-63f01a72d8ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:16:18.697777 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 899/1800] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:16:18 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:16:18.702551 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b290ebf4-1f80-40db-96ae-1da375e9852d admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:18.877872 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b290ebf4-1f80-40db-96ae-1da375e9852d admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:18.890270 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56b37ae-1279-434a-9f98-8bc7a6bcee59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:18.893329 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56b37ae-1279-434a-9f98-8bc7a6bcee59 admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:18.893329 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56b37ae-1279-434a-9f98-8bc7a6bcee59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:18.893329 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56b37ae-1279-434a-9f98-8bc7a6bcee59 admin admin] PATH_INFO: `/v3/projects` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:18.893329 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56b37ae-1279-434a-9f98-8bc7a6bcee59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:18.894759 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56b37ae-1279-434a-9f98-8bc7a6bcee59 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:18.927019 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6c0fb9-a136-41e9-ad33-63f01a72d8ca None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:18.929333 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-fe6c0fb9-a136-41e9-ad33-63f01a72d8ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:16:18.948179 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 902/1801] 10.222.0.43 () {60 vars in 1152 bytes} [Wed Jun 22 10:16:18 2022] POST /identity/v3/projects => generated 387 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:16:18.960847 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6c0fb9-a136-41e9-ad33-63f01a72d8ca None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:18.968426 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56b37ae-1279-434a-9f98-8bc7a6bcee59 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:19.079960 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:16:19.089638 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa0d02a-db5e-4369-a61c-5ddfe00df040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:19.092724 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa0d02a-db5e-4369-a61c-5ddfe00df040 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:19.093215 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa0d02a-db5e-4369-a61c-5ddfe00df040 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:19.093681 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa0d02a-db5e-4369-a61c-5ddfe00df040 admin admin] PATH_INFO: `/v3/projects/e26c960937f6491689b5c14ba06c7d7a` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:19.097032 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa0d02a-db5e-4369-a61c-5ddfe00df040 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e26c960937f6491689b5c14ba06c7d7a)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:19.099784 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa0d02a-db5e-4369-a61c-5ddfe00df040 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:19.107595 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56b37ae-1279-434a-9f98-8bc7a6bcee59 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:19.125506 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce3a3d1-9262-468e-8149-d4b7245c7216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:19.126604 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce3a3d1-9262-468e-8149-d4b7245c7216 admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:19.127133 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce3a3d1-9262-468e-8149-d4b7245c7216 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:19.128086 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce3a3d1-9262-468e-8149-d4b7245c7216 admin admin] PATH_INFO: `/v3/users` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:19.129499 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce3a3d1-9262-468e-8149-d4b7245c7216 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:19.133466 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce3a3d1-9262-468e-8149-d4b7245c7216 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:19.187596 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 903/1802] 10.222.0.43 () {60 vars in 1143 bytes} [Wed Jun 22 10:16:18 2022] POST /identity/v3/users => generated 300 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:16:19.191973 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce3a3d1-9262-468e-8149-d4b7245c7216 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:19.205011 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-8fa0d02a-db5e-4369-a61c-5ddfe00df040 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e26c960937f6491689b5c14ba06c7d7a', 'request_id': 'req-8fa0d02a-db5e-4369-a61c-5ddfe00df040'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:19.205633 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce3a3d1-9262-468e-8149-d4b7245c7216 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:19.221873 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-8fa0d02a-db5e-4369-a61c-5ddfe00df040 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e26c960937f6491689b5c14ba06c7d7a', 'request_id': 'req-8fa0d02a-db5e-4369-a61c-5ddfe00df040'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:19.240942 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-8fa0d02a-db5e-4369-a61c-5ddfe00df040 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e26c960937f6491689b5c14ba06c7d7a', 'request_id': 'req-8fa0d02a-db5e-4369-a61c-5ddfe00df040'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:19.261015 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-8fa0d02a-db5e-4369-a61c-5ddfe00df040 admin admin] The token cache is being invalidate because project e26c960937f6491689b5c14ba06c7d7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:16:19.266421 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-8fa0d02a-db5e-4369-a61c-5ddfe00df040 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:19.269440 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-8fa0d02a-db5e-4369-a61c-5ddfe00df040 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:19.275119 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 900/1803] 10.222.0.43 () {58 vars in 1232 bytes} [Wed Jun 22 10:16:18 2022] DELETE /identity/v3/projects/e26c960937f6491689b5c14ba06c7d7a => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:16:19.281460 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df658981-c4e0-44f8-953b-4e6a9a7fdf47 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:19.284010 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df658981-c4e0-44f8-953b-4e6a9a7fdf47 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:19.284425 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df658981-c4e0-44f8-953b-4e6a9a7fdf47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:19.285138 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6550ed34-4d61-4a76-940a-5174433804ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:19.286233 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6550ed34-4d61-4a76-940a-5174433804ba admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:19.286754 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6550ed34-4d61-4a76-940a-5174433804ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:19.287452 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6550ed34-4d61-4a76-940a-5174433804ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:19.288602 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6550ed34-4d61-4a76-940a-5174433804ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:19.290779 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6550ed34-4d61-4a76-940a-5174433804ba admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:19.311740 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 904/1804] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:16:19 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:16:19.312043 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6550ed34-4d61-4a76-940a-5174433804ba admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:19.314291 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-6550ed34-4d61-4a76-940a-5174433804ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:16:19.328719 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6550ed34-4d61-4a76-940a-5174433804ba admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:19.333781 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-df658981-c4e0-44f8-953b-4e6a9a7fdf47 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:16:19.335102 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-df658981-c4e0-44f8-953b-4e6a9a7fdf47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:16:19.335554 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770fab64-6765-4e8b-8901-248cd2748e71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:19.336736 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770fab64-6765-4e8b-8901-248cd2748e71 admin admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:19.337246 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770fab64-6765-4e8b-8901-248cd2748e71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:19.337629 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770fab64-6765-4e8b-8901-248cd2748e71 admin admin] PATH_INFO: `/v3/projects/21817eb68e8e47c0a163099b0680b77b/users/8429f2d2814e4901a3026f7d56950803/roles/26d9c2ab5dfc4e6d9ca80c6014123906` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:19.351232 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 901/1805] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:16:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:16:19.359004 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770fab64-6765-4e8b-8901-248cd2748e71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21817eb68e8e47c0a163099b0680b77b, user_id=8429f2d2814e4901a3026f7d56950803, role_id=26d9c2ab5dfc4e6d9ca80c6014123906)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:19.362454 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770fab64-6765-4e8b-8901-248cd2748e71 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:19.366718 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c24977-4f51-45d8-90cd-656fe236405d None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:19.367279 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c24977-4f51-45d8-90cd-656fe236405d None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:19.367704 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c24977-4f51-45d8-90cd-656fe236405d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:19.419587 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 905/1806] 10.222.0.43 () {60 vars in 1482 bytes} [Wed Jun 22 10:16:19 2022] PUT /identity/v3/projects/21817eb68e8e47c0a163099b0680b77b/users/8429f2d2814e4901a3026f7d56950803/roles/26d9c2ab5dfc4e6d9ca80c6014123906 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:16:19.420506 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-87c24977-4f51-45d8-90cd-656fe236405d None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:16:19.421836 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770fab64-6765-4e8b-8901-248cd2748e71 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:19.424890 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-87c24977-4f51-45d8-90cd-656fe236405d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:16:19.444331 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:16:19.580315 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770fab64-6765-4e8b-8901-248cd2748e71 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:19.586135 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5c979f-ebc1-4f84-9039-38dd85d86af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:19.586927 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5c979f-ebc1-4f84-9039-38dd85d86af8 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:19.587314 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5c979f-ebc1-4f84-9039-38dd85d86af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:19.587826 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5c979f-ebc1-4f84-9039-38dd85d86af8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:19.589014 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5c979f-ebc1-4f84-9039-38dd85d86af8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:19.590837 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5c979f-ebc1-4f84-9039-38dd85d86af8 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:19.604765 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 902/1807] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:16:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:16:19.605939 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c24977-4f51-45d8-90cd-656fe236405d None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:19.617469 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c24977-4f51-45d8-90cd-656fe236405d None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:19.622912 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba37d21-a1c9-4d07-98b2-63a30d069493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:19.623860 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba37d21-a1c9-4d07-98b2-63a30d069493 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:19.624162 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba37d21-a1c9-4d07-98b2-63a30d069493 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:19.624420 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba37d21-a1c9-4d07-98b2-63a30d069493 admin admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:19.625326 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba37d21-a1c9-4d07-98b2-63a30d069493 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:16:19.625636 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba37d21-a1c9-4d07-98b2-63a30d069493 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:19.627108 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 906/1808] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:16:19 2022] GET /identity/v3/roles => generated 1420 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:16:19.628375 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba37d21-a1c9-4d07-98b2-63a30d069493 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:19.630144 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5c979f-ebc1-4f84-9039-38dd85d86af8 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:19.649915 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 903/1809] 10.222.0.43 () {58 vars in 1152 bytes} [Wed Jun 22 10:16:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:16:19.650956 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba37d21-a1c9-4d07-98b2-63a30d069493 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:19.655226 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5c979f-ebc1-4f84-9039-38dd85d86af8 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:19.664630 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba37d21-a1c9-4d07-98b2-63a30d069493 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:19.671576 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d1712f-fed1-48d8-8b4e-08a787d0200c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:19.672498 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d1712f-fed1-48d8-8b4e-08a787d0200c admin admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:19.672790 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d1712f-fed1-48d8-8b4e-08a787d0200c admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:19.673072 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d1712f-fed1-48d8-8b4e-08a787d0200c admin admin] PATH_INFO: `/v3/projects/21817eb68e8e47c0a163099b0680b77b/users/8429f2d2814e4901a3026f7d56950803/roles/26d9c2ab5dfc4e6d9ca80c6014123906` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:19.673480 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add7aebf-b9bc-493c-becc-6181a31412da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:19.674460 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add7aebf-b9bc-493c-becc-6181a31412da admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:19.674826 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add7aebf-b9bc-493c-becc-6181a31412da admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:19.676279 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add7aebf-b9bc-493c-becc-6181a31412da admin admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:19.677011 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add7aebf-b9bc-493c-becc-6181a31412da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:19.680581 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d1712f-fed1-48d8-8b4e-08a787d0200c admin admin] RBAC: Authorizing `identity:create_grant(project_id=21817eb68e8e47c0a163099b0680b77b, user_id=8429f2d2814e4901a3026f7d56950803, role_id=26d9c2ab5dfc4e6d9ca80c6014123906)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:19.681035 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add7aebf-b9bc-493c-becc-6181a31412da admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:19.684189 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d1712f-fed1-48d8-8b4e-08a787d0200c admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:19.717230 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 907/1810] 10.222.0.43 () {60 vars in 1482 bytes} [Wed Jun 22 10:16:19 2022] PUT /identity/v3/projects/21817eb68e8e47c0a163099b0680b77b/users/8429f2d2814e4901a3026f7d56950803/roles/26d9c2ab5dfc4e6d9ca80c6014123906 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:16:19.718974 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e8440c-79ce-4a4f-ab33-32d79d6505a4 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:19.719200 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e8440c-79ce-4a4f-ab33-32d79d6505a4 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:19.719469 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e8440c-79ce-4a4f-ab33-32d79d6505a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:19.739616 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 904/1811] 10.222.0.43 () {60 vars in 1152 bytes} [Wed Jun 22 10:16:19 2022] POST /identity/v3/projects => generated 399 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:16:19.744340 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add7aebf-b9bc-493c-becc-6181a31412da admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:19.785861 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-f5e8440c-79ce-4a4f-ab33-32d79d6505a4 None None] MFA Rules not processed for user `8429f2d2814e4901a3026f7d56950803`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:16:19.787344 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-f5e8440c-79ce-4a4f-ab33-32d79d6505a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:16:19.853483 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:16:19.904865 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add7aebf-b9bc-493c-becc-6181a31412da admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:19.925098 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73feb05b-0e33-488d-af8f-3bb4415cbf34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:19.925832 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73feb05b-0e33-488d-af8f-3bb4415cbf34 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:19.926126 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73feb05b-0e33-488d-af8f-3bb4415cbf34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:19.926413 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73feb05b-0e33-488d-af8f-3bb4415cbf34 admin admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:19.927122 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73feb05b-0e33-488d-af8f-3bb4415cbf34 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:19.930485 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73feb05b-0e33-488d-af8f-3bb4415cbf34 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:19.972910 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 908/1812] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:16:19 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:16:19.974876 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2d82ae-d92e-46a4-abed-4963e287dd85 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:19.975274 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2d82ae-d92e-46a4-abed-4963e287dd85 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:19.975629 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2d82ae-d92e-46a4-abed-4963e287dd85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:20.004115 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-4e2d82ae-d92e-46a4-abed-4963e287dd85 None None] MFA Rules not processed for user `78fe3fc4334c43d7a5ef6d70f9f57523`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:16:20.005983 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-4e2d82ae-d92e-46a4-abed-4963e287dd85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:16:20.011437 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 905/1813] 10.222.0.43 () {60 vars in 1143 bytes} [Wed Jun 22 10:16:19 2022] POST /identity/v3/users => generated 300 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:16:20.012514 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73feb05b-0e33-488d-af8f-3bb4415cbf34 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:20.019539 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-73feb05b-0e33-488d-af8f-3bb4415cbf34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:16:20.100311 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 909/1814] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:16:19 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:16:20.100311 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2d82ae-d92e-46a4-abed-4963e287dd85 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:20.133404 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2d82ae-d92e-46a4-abed-4963e287dd85 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:20.134933 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73feb05b-0e33-488d-af8f-3bb4415cbf34 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:20.144613 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c2d686-5fd9-46d0-8866-66f48eb54fdd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bbcb3d4dc704dfdb0097abc594ca855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:20.145011 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c2d686-5fd9-46d0-8866-66f48eb54fdd service cinder] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:20.145301 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c2d686-5fd9-46d0-8866-66f48eb54fdd service cinder] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:20.145622 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c2d686-5fd9-46d0-8866-66f48eb54fdd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:20.146445 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf526817-ce54-4ec2-b22c-c3a2cf406b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:20.147147 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf526817-ce54-4ec2-b22c-c3a2cf406b42 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:20.147481 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf526817-ce54-4ec2-b22c-c3a2cf406b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:20.147761 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf526817-ce54-4ec2-b22c-c3a2cf406b42 admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:20.148503 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf526817-ce54-4ec2-b22c-c3a2cf406b42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:20.150356 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf526817-ce54-4ec2-b22c-c3a2cf406b42 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:20.161028 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c2d686-5fd9-46d0-8866-66f48eb54fdd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:20.163380 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c2d686-5fd9-46d0-8866-66f48eb54fdd service cinder] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:20.165674 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 910/1815] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:16:20 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:16:20.169242 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf526817-ce54-4ec2-b22c-c3a2cf406b42 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:20.178729 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 906/1816] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:16:20 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:16:20.192190 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf526817-ce54-4ec2-b22c-c3a2cf406b42 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:20.197863 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec506d2-c6b9-45c9-9ee2-1425373f3abd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:20.198537 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec506d2-c6b9-45c9-9ee2-1425373f3abd admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:20.198987 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec506d2-c6b9-45c9-9ee2-1425373f3abd admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:20.199428 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec506d2-c6b9-45c9-9ee2-1425373f3abd admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:20.200557 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec506d2-c6b9-45c9-9ee2-1425373f3abd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:20.202503 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec506d2-c6b9-45c9-9ee2-1425373f3abd admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:20.215527 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 911/1817] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:16:20 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:16:20.220457 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c2d686-5fd9-46d0-8866-66f48eb54fdd service cinder] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:20.232625 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c2d686-5fd9-46d0-8866-66f48eb54fdd service cinder] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:20.241366 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254a9a23-39b9-44e6-9ec8-cf0753a39b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:20.242489 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254a9a23-39b9-44e6-9ec8-cf0753a39b56 admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:20.242798 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254a9a23-39b9-44e6-9ec8-cf0753a39b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:20.243085 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254a9a23-39b9-44e6-9ec8-cf0753a39b56 admin admin] PATH_INFO: `/v3/projects/26dd426d226f4473b3b8d2fa78535ae4/users/23387cbe868b44fba54e82427897eb4f/roles/9f88c83743f745a9a785a2f454753f06` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:20.253908 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:16:20.290678 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254a9a23-39b9-44e6-9ec8-cf0753a39b56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26dd426d226f4473b3b8d2fa78535ae4, user_id=23387cbe868b44fba54e82427897eb4f, role_id=9f88c83743f745a9a785a2f454753f06)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:20.293648 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254a9a23-39b9-44e6-9ec8-cf0753a39b56 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:20.340152 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 907/1818] 10.222.0.43 () {60 vars in 1482 bytes} [Wed Jun 22 10:16:20 2022] PUT /identity/v3/projects/26dd426d226f4473b3b8d2fa78535ae4/users/23387cbe868b44fba54e82427897eb4f/roles/9f88c83743f745a9a785a2f454753f06 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:16:20.351407 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5c9243-3b16-46e3-92af-ca8c49e52000 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:20.351704 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5c9243-3b16-46e3-92af-ca8c49e52000 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:20.351996 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5c9243-3b16-46e3-92af-ca8c49e52000 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:20.371789 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254a9a23-39b9-44e6-9ec8-cf0753a39b56 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:20.384424 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-3b5c9243-3b16-46e3-92af-ca8c49e52000 None None] MFA Rules not processed for user `23387cbe868b44fba54e82427897eb4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:16:20.385776 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-3b5c9243-3b16-46e3-92af-ca8c49e52000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:16:20.480421 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254a9a23-39b9-44e6-9ec8-cf0753a39b56 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:20.490680 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5844c1a-2bbb-41b7-8c41-2e36017c2b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:20.492056 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5844c1a-2bbb-41b7-8c41-2e36017c2b3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:20.492422 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5844c1a-2bbb-41b7-8c41-2e36017c2b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:20.493624 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5844c1a-2bbb-41b7-8c41-2e36017c2b3b admin admin] PATH_INFO: `/v3/users/c6f1f3c015844b1cb7015730abba0a97` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:20.496576 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 912/1819] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:16:20 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:16:20.505395 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5844c1a-2bbb-41b7-8c41-2e36017c2b3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6f1f3c015844b1cb7015730abba0a97)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:20.508460 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5844c1a-2bbb-41b7-8c41-2e36017c2b3b admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:20.521324 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5c9243-3b16-46e3-92af-ca8c49e52000 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:20.593785 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:16:20.625917 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5c9243-3b16-46e3-92af-ca8c49e52000 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:20.630678 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999b3e61-1a85-41a9-bf4c-98475a670c12 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bbcb3d4dc704dfdb0097abc594ca855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:20.635321 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999b3e61-1a85-41a9-bf4c-98475a670c12 service cinder] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:20.635321 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999b3e61-1a85-41a9-bf4c-98475a670c12 service cinder] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:20.635321 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999b3e61-1a85-41a9-bf4c-98475a670c12 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:20.647019 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999b3e61-1a85-41a9-bf4c-98475a670c12 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:20.648454 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999b3e61-1a85-41a9-bf4c-98475a670c12 service cinder] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:20.661572 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 913/1820] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:16:20 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 10:16:20.675553 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-f5844c1a-2bbb-41b7-8c41-2e36017c2b3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6f1f3c015844b1cb7015730abba0a97'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:20.682031 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999b3e61-1a85-41a9-bf4c-98475a670c12 service cinder] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:20.683654 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-999b3e61-1a85-41a9-bf4c-98475a670c12 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:16:20.713362 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-f5844c1a-2bbb-41b7-8c41-2e36017c2b3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6f1f3c015844b1cb7015730abba0a97'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:20.728052 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-f5844c1a-2bbb-41b7-8c41-2e36017c2b3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6f1f3c015844b1cb7015730abba0a97'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:20.728805 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999b3e61-1a85-41a9-bf4c-98475a670c12 service cinder] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:20.729574 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-f5844c1a-2bbb-41b7-8c41-2e36017c2b3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6f1f3c015844b1cb7015730abba0a97'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:20.739831 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-f5844c1a-2bbb-41b7-8c41-2e36017c2b3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6f1f3c015844b1cb7015730abba0a97'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:20.740465 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e216976-d0e5-4778-b89a-92c27478a4e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:20.741814 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e216976-d0e5-4778-b89a-92c27478a4e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:20.742597 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e216976-d0e5-4778-b89a-92c27478a4e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:20.743677 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e216976-d0e5-4778-b89a-92c27478a4e4 admin admin] PATH_INFO: `/v3/users/37620775aa6a412cb67dcfcc9a472761` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:20.746522 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e216976-d0e5-4778-b89a-92c27478a4e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37620775aa6a412cb67dcfcc9a472761)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:20.751121 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e216976-d0e5-4778-b89a-92c27478a4e4 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:20.751453 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 908/1821] 10.222.0.43 () {58 vars in 1223 bytes} [Wed Jun 22 10:16:20 2022] DELETE /identity/v3/users/c6f1f3c015844b1cb7015730abba0a97 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:16:20.756831 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac3951d-d89e-4f34-8de3-dacace97bfec None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:20.757361 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac3951d-d89e-4f34-8de3-dacace97bfec None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:20.757927 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac3951d-d89e-4f34-8de3-dacace97bfec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:20.785109 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-9ac3951d-d89e-4f34-8de3-dacace97bfec None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:16:20.787306 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-9ac3951d-d89e-4f34-8de3-dacace97bfec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:16:20.889809 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-2e216976-d0e5-4778-b89a-92c27478a4e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37620775aa6a412cb67dcfcc9a472761'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:20.913778 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 909/1822] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:16:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:16:20.913910 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-2e216976-d0e5-4778-b89a-92c27478a4e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37620775aa6a412cb67dcfcc9a472761'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:20.945103 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac3951d-d89e-4f34-8de3-dacace97bfec None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:20.946345 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-2e216976-d0e5-4778-b89a-92c27478a4e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37620775aa6a412cb67dcfcc9a472761'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:20.949410 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-9ac3951d-d89e-4f34-8de3-dacace97bfec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:16:20.967082 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:16:20.972782 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-2e216976-d0e5-4778-b89a-92c27478a4e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37620775aa6a412cb67dcfcc9a472761'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:20.974349 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-2e216976-d0e5-4778-b89a-92c27478a4e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37620775aa6a412cb67dcfcc9a472761'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:21.000257 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 914/1823] 10.222.0.43 () {58 vars in 1223 bytes} [Wed Jun 22 10:16:20 2022] DELETE /identity/v3/users/37620775aa6a412cb67dcfcc9a472761 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:16:21.006798 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f7dd2b-ec09-4ee5-bde2-7e9d8cfdf55a None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:21.007102 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f7dd2b-ec09-4ee5-bde2-7e9d8cfdf55a None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:21.007392 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f7dd2b-ec09-4ee5-bde2-7e9d8cfdf55a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:21.036989 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-01f7dd2b-ec09-4ee5-bde2-7e9d8cfdf55a None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:16:21.038817 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-01f7dd2b-ec09-4ee5-bde2-7e9d8cfdf55a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:16:21.096807 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac3951d-d89e-4f34-8de3-dacace97bfec None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:21.193394 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 915/1824] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:16:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:16:21.218176 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f7dd2b-ec09-4ee5-bde2-7e9d8cfdf55a None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:21.219651 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-01f7dd2b-ec09-4ee5-bde2-7e9d8cfdf55a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:16:21.237504 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cef5bbd-42b6-4848-b170-8b008c251b0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe93d4c0737249fd8623bb5ce188e34e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:21.238930 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cef5bbd-42b6-4848-b170-8b008c251b0c service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:21.239445 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cef5bbd-42b6-4848-b170-8b008c251b0c service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:21.239928 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cef5bbd-42b6-4848-b170-8b008c251b0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:21.246856 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-1cef5bbd-42b6-4848-b170-8b008c251b0c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:16:21.296051 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cef5bbd-42b6-4848-b170-8b008c251b0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:21.297524 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cef5bbd-42b6-4848-b170-8b008c251b0c service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:21.308317 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:16:21.316576 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f7dd2b-ec09-4ee5-bde2-7e9d8cfdf55a None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:21.322313 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e6567f-073b-4887-9dac-bd6d133a2620 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe93d4c0737249fd8623bb5ce188e34e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:21.323350 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e6567f-073b-4887-9dac-bd6d133a2620 service neutron] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:21.323855 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e6567f-073b-4887-9dac-bd6d133a2620 service neutron] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:21.324647 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e6567f-073b-4887-9dac-bd6d133a2620 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:21.332485 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 910/1825] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:16:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:16:21.353861 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e6567f-073b-4887-9dac-bd6d133a2620 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:21.359756 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e6567f-073b-4887-9dac-bd6d133a2620 service neutron] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:21.388636 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 916/1826] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:16:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 10:16:22.899119 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cef5bbd-42b6-4848-b170-8b008c251b0c service neutron] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:22.901572 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-1cef5bbd-42b6-4848-b170-8b008c251b0c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:16:22.955524 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cef5bbd-42b6-4848-b170-8b008c251b0c service neutron] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:22.962937 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e6567f-073b-4887-9dac-bd6d133a2620 service neutron] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:22.965009 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-d1e6567f-073b-4887-9dac-bd6d133a2620 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:16:22.981681 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b214bd8-5c3d-4333-bdda-9dac067bf286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:23.000015 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b214bd8-5c3d-4333-bdda-9dac067bf286 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:23.000672 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b214bd8-5c3d-4333-bdda-9dac067bf286 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:23.001126 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b214bd8-5c3d-4333-bdda-9dac067bf286 admin admin] PATH_INFO: `/v3/projects/e0c524ec9a0c48089634582be48a5937` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:23.006865 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b214bd8-5c3d-4333-bdda-9dac067bf286 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0c524ec9a0c48089634582be48a5937)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:23.021192 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e6567f-073b-4887-9dac-bd6d133a2620 service neutron] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:23.022827 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b214bd8-5c3d-4333-bdda-9dac067bf286 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:23.047050 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c0212a-788e-4874-ba31-5c8c3e9a9cf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:23.052960 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c0212a-788e-4874-ba31-5c8c3e9a9cf6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:23.054210 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c0212a-788e-4874-ba31-5c8c3e9a9cf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:23.056282 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c0212a-788e-4874-ba31-5c8c3e9a9cf6 admin admin] PATH_INFO: `/v3/projects/c38d59fb6b0c4c4c8554d78b0f53f1c1` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:23.061998 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c0212a-788e-4874-ba31-5c8c3e9a9cf6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c38d59fb6b0c4c4c8554d78b0f53f1c1)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:23.071409 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c0212a-788e-4874-ba31-5c8c3e9a9cf6 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:23.186996 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-80c0212a-788e-4874-ba31-5c8c3e9a9cf6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c38d59fb6b0c4c4c8554d78b0f53f1c1', 'request_id': 'req-80c0212a-788e-4874-ba31-5c8c3e9a9cf6'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:23.197066 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-80c0212a-788e-4874-ba31-5c8c3e9a9cf6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c38d59fb6b0c4c4c8554d78b0f53f1c1', 'request_id': 'req-80c0212a-788e-4874-ba31-5c8c3e9a9cf6'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:23.206217 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-7b214bd8-5c3d-4333-bdda-9dac067bf286 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0c524ec9a0c48089634582be48a5937', 'request_id': 'req-7b214bd8-5c3d-4333-bdda-9dac067bf286'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:23.207358 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-80c0212a-788e-4874-ba31-5c8c3e9a9cf6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c38d59fb6b0c4c4c8554d78b0f53f1c1', 'request_id': 'req-80c0212a-788e-4874-ba31-5c8c3e9a9cf6'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:23.222102 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-7b214bd8-5c3d-4333-bdda-9dac067bf286 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0c524ec9a0c48089634582be48a5937', 'request_id': 'req-7b214bd8-5c3d-4333-bdda-9dac067bf286'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:23.233986 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-80c0212a-788e-4874-ba31-5c8c3e9a9cf6 admin admin] The token cache is being invalidate because project c38d59fb6b0c4c4c8554d78b0f53f1c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:16:23.234830 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-80c0212a-788e-4874-ba31-5c8c3e9a9cf6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:23.236760 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-80c0212a-788e-4874-ba31-5c8c3e9a9cf6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:23.240066 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 917/1827] 10.222.0.43 () {58 vars in 1232 bytes} [Wed Jun 22 10:16:22 2022] DELETE /identity/v3/projects/c38d59fb6b0c4c4c8554d78b0f53f1c1 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:16:23.244426 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c0212a-788e-4874-ba31-5c8c3e9a9cf6 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:23.247812 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-80c0212a-788e-4874-ba31-5c8c3e9a9cf6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:16:23.268267 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-7b214bd8-5c3d-4333-bdda-9dac067bf286 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0c524ec9a0c48089634582be48a5937', 'request_id': 'req-7b214bd8-5c3d-4333-bdda-9dac067bf286'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:23.334630 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-7b214bd8-5c3d-4333-bdda-9dac067bf286 admin admin] The token cache is being invalidate because project e0c524ec9a0c48089634582be48a5937 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:16:23.340985 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-7b214bd8-5c3d-4333-bdda-9dac067bf286 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:23.344269 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-7b214bd8-5c3d-4333-bdda-9dac067bf286 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:23.367283 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 911/1828] 10.222.0.43 () {58 vars in 1232 bytes} [Wed Jun 22 10:16:22 2022] DELETE /identity/v3/projects/e0c524ec9a0c48089634582be48a5937 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:16:23.369935 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c0212a-788e-4874-ba31-5c8c3e9a9cf6 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:23.371924 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4906e866-a54a-43b8-9006-7ef788c777e1 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:23.372226 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4906e866-a54a-43b8-9006-7ef788c777e1 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:23.372493 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4906e866-a54a-43b8-9006-7ef788c777e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:23.380603 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8f6c5a-39ef-40bc-8e0f-d4fa2d326ed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:23.382112 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8f6c5a-39ef-40bc-8e0f-d4fa2d326ed4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:23.383226 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8f6c5a-39ef-40bc-8e0f-d4fa2d326ed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:23.383676 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8f6c5a-39ef-40bc-8e0f-d4fa2d326ed4 admin admin] PATH_INFO: `/v3/users/8429f2d2814e4901a3026f7d56950803` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:23.385087 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8f6c5a-39ef-40bc-8e0f-d4fa2d326ed4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8429f2d2814e4901a3026f7d56950803)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:23.387747 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8f6c5a-39ef-40bc-8e0f-d4fa2d326ed4 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:23.433922 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-4906e866-a54a-43b8-9006-7ef788c777e1 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:16:23.443356 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-4906e866-a54a-43b8-9006-7ef788c777e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:16:23.476514 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 912/1829] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:16:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:16:23.489957 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6a4898-8317-4e4b-8cea-a4fc5c1b9cf4 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:23.490407 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6a4898-8317-4e4b-8cea-a4fc5c1b9cf4 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:23.490691 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6a4898-8317-4e4b-8cea-a4fc5c1b9cf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:23.502775 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-2b8f6c5a-39ef-40bc-8e0f-d4fa2d326ed4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8429f2d2814e4901a3026f7d56950803'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:23.521965 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-2b8f6c5a-39ef-40bc-8e0f-d4fa2d326ed4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8429f2d2814e4901a3026f7d56950803'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:23.528838 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-cc6a4898-8317-4e4b-8cea-a4fc5c1b9cf4 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:16:23.530337 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-cc6a4898-8317-4e4b-8cea-a4fc5c1b9cf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:16:23.536253 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-2b8f6c5a-39ef-40bc-8e0f-d4fa2d326ed4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8429f2d2814e4901a3026f7d56950803'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:23.539446 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:16:23.544497 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 913/1830] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:16:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:16:23.547958 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-2b8f6c5a-39ef-40bc-8e0f-d4fa2d326ed4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8429f2d2814e4901a3026f7d56950803'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:23.549133 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-2b8f6c5a-39ef-40bc-8e0f-d4fa2d326ed4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8429f2d2814e4901a3026f7d56950803'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:23.549726 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6a4898-8317-4e4b-8cea-a4fc5c1b9cf4 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:23.558098 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 918/1831] 10.222.0.43 () {58 vars in 1223 bytes} [Wed Jun 22 10:16:23 2022] DELETE /identity/v3/users/8429f2d2814e4901a3026f7d56950803 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:16:23.562862 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6a4898-8317-4e4b-8cea-a4fc5c1b9cf4 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:23.616265 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:16:23.655606 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d65a34-6115-49aa-9a08-7ad234517819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:23.656584 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d65a34-6115-49aa-9a08-7ad234517819 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:23.656873 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d65a34-6115-49aa-9a08-7ad234517819 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:23.657155 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d65a34-6115-49aa-9a08-7ad234517819 admin admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:23.659230 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d65a34-6115-49aa-9a08-7ad234517819 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:16:23.659230 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d65a34-6115-49aa-9a08-7ad234517819 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:23.660584 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d65a34-6115-49aa-9a08-7ad234517819 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:23.677746 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 914/1832] 10.222.0.43 () {58 vars in 1152 bytes} [Wed Jun 22 10:16:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:16:23.679302 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8f6c5a-39ef-40bc-8e0f-d4fa2d326ed4 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:23.680944 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-2b8f6c5a-39ef-40bc-8e0f-d4fa2d326ed4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:16:23.696219 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8f6c5a-39ef-40bc-8e0f-d4fa2d326ed4 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:23.702220 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03154937-dad1-4ba8-a5de-fe24cb69034c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:23.703167 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03154937-dad1-4ba8-a5de-fe24cb69034c admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:23.703655 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03154937-dad1-4ba8-a5de-fe24cb69034c admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:23.704152 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03154937-dad1-4ba8-a5de-fe24cb69034c admin admin] PATH_INFO: `/v3/projects` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:23.706415 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03154937-dad1-4ba8-a5de-fe24cb69034c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:23.709344 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03154937-dad1-4ba8-a5de-fe24cb69034c admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:23.752553 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d65a34-6115-49aa-9a08-7ad234517819 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:23.760141 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 919/1833] 10.222.0.43 () {60 vars in 1152 bytes} [Wed Jun 22 10:16:23 2022] POST /identity/v3/projects => generated 373 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:16:23.764472 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d65a34-6115-49aa-9a08-7ad234517819 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:23.847402 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116a1843-c977-4c99-a2b2-793ac03cc6ec None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:23.847965 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116a1843-c977-4c99-a2b2-793ac03cc6ec None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:23.848456 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116a1843-c977-4c99-a2b2-793ac03cc6ec None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:23.850780 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 920/1834] 10.222.0.43 () {54 vars in 921 bytes} [Wed Jun 22 10:16:23 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:16:23.861263 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c967d89e-edf8-4e03-891e-9fdb2713f865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:23.862007 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c967d89e-edf8-4e03-891e-9fdb2713f865 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:23.862297 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c967d89e-edf8-4e03-891e-9fdb2713f865 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:23.862577 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c967d89e-edf8-4e03-891e-9fdb2713f865 admin admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:23.863618 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c967d89e-edf8-4e03-891e-9fdb2713f865 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:23.865283 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c967d89e-edf8-4e03-891e-9fdb2713f865 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:23.872189 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe2e25e-6c41-4fd1-a0f7-f47c53f20715 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:23.876948 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe2e25e-6c41-4fd1-a0f7-f47c53f20715 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:23.886578 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe2e25e-6c41-4fd1-a0f7-f47c53f20715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:23.908222 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 915/1835] 10.222.0.43 () {60 vars in 1143 bytes} [Wed Jun 22 10:16:23 2022] POST /identity/v3/users => generated 287 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:16:23.911660 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c967d89e-edf8-4e03-891e-9fdb2713f865 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:23.926274 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-bfe2e25e-6c41-4fd1-a0f7-f47c53f20715 None None] MFA Rules not processed for user `158a49aa3750478a84bf71b9aad24397`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:16:23.928485 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-bfe2e25e-6c41-4fd1-a0f7-f47c53f20715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:16:23.936489 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c967d89e-edf8-4e03-891e-9fdb2713f865 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:23.951201 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb842961-4fb0-4a09-9c33-cb34aa9f4e4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:23.952000 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb842961-4fb0-4a09-9c33-cb34aa9f4e4f admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:23.952290 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb842961-4fb0-4a09-9c33-cb34aa9f4e4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:23.952694 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb842961-4fb0-4a09-9c33-cb34aa9f4e4f admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:23.953443 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb842961-4fb0-4a09-9c33-cb34aa9f4e4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:23.961096 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb842961-4fb0-4a09-9c33-cb34aa9f4e4f admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:23.997408 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 916/1836] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:16:23 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:16:24.001021 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb842961-4fb0-4a09-9c33-cb34aa9f4e4f admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:24.023186 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb842961-4fb0-4a09-9c33-cb34aa9f4e4f admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:24.042460 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dc55f9-f5a5-4b1e-a29d-a32d850b2bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:24.043158 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dc55f9-f5a5-4b1e-a29d-a32d850b2bd8 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:24.044018 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dc55f9-f5a5-4b1e-a29d-a32d850b2bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:24.044473 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dc55f9-f5a5-4b1e-a29d-a32d850b2bd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:24.045375 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dc55f9-f5a5-4b1e-a29d-a32d850b2bd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:24.047049 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dc55f9-f5a5-4b1e-a29d-a32d850b2bd8 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:24.061632 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 917/1837] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:16:24 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:16:24.066559 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dc55f9-f5a5-4b1e-a29d-a32d850b2bd8 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:24.079943 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dc55f9-f5a5-4b1e-a29d-a32d850b2bd8 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:24.088175 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d7cc19-634b-4733-a520-d4c5a5c2cc38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:24.089360 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d7cc19-634b-4733-a520-d4c5a5c2cc38 admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:24.089819 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d7cc19-634b-4733-a520-d4c5a5c2cc38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:24.090297 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d7cc19-634b-4733-a520-d4c5a5c2cc38 admin admin] PATH_INFO: `/v3/projects/1f86edb1750441af89ecefc44ac2dba2/users/ea52f49e642b4ad3aef61a93eea7fb04/roles/9f88c83743f745a9a785a2f454753f06` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:24.117087 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 921/1838] 10.222.0.43 () {58 vars in 1018 bytes} [Wed Jun 22 10:16:23 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:16:24.128511 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d7cc19-634b-4733-a520-d4c5a5c2cc38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f86edb1750441af89ecefc44ac2dba2, user_id=ea52f49e642b4ad3aef61a93eea7fb04, role_id=9f88c83743f745a9a785a2f454753f06)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:24.131632 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d7cc19-634b-4733-a520-d4c5a5c2cc38 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:24.155636 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 918/1839] 10.222.0.43 () {60 vars in 1482 bytes} [Wed Jun 22 10:16:24 2022] PUT /identity/v3/projects/1f86edb1750441af89ecefc44ac2dba2/users/ea52f49e642b4ad3aef61a93eea7fb04/roles/9f88c83743f745a9a785a2f454753f06 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:16:24.167319 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed46c567-89eb-4dc4-bd9c-49b24c74fb1e None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:24.168613 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed46c567-89eb-4dc4-bd9c-49b24c74fb1e None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:24.169082 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed46c567-89eb-4dc4-bd9c-49b24c74fb1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:24.218758 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-ed46c567-89eb-4dc4-bd9c-49b24c74fb1e None None] MFA Rules not processed for user `ea52f49e642b4ad3aef61a93eea7fb04`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:16:24.220494 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-ed46c567-89eb-4dc4-bd9c-49b24c74fb1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:16:24.309899 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 922/1840] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:16:24 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:16:24.433464 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d7cc19-634b-4733-a520-d4c5a5c2cc38 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:24.437166 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-c3d7cc19-634b-4733-a520-d4c5a5c2cc38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:16:24.574229 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d7cc19-634b-4733-a520-d4c5a5c2cc38 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:24.584491 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07ba8a7-6062-4f72-825f-47bc69927e70 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '158a49aa3750478a84bf71b9aad24397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:24.585816 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07ba8a7-6062-4f72-825f-47bc69927e70 service nova] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:24.586313 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07ba8a7-6062-4f72-825f-47bc69927e70 service nova] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:24.587126 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07ba8a7-6062-4f72-825f-47bc69927e70 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:24.599616 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:16:24.614708 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed46c567-89eb-4dc4-bd9c-49b24c74fb1e None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:24.614844 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07ba8a7-6062-4f72-825f-47bc69927e70 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:24.616112 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-ed46c567-89eb-4dc4-bd9c-49b24c74fb1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:16:24.617301 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07ba8a7-6062-4f72-825f-47bc69927e70 service nova] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:24.633482 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 919/1841] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:16:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:16:24.640926 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed46c567-89eb-4dc4-bd9c-49b24c74fb1e None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:24.650949 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4b3430-f912-4178-a664-7f07a7a51988 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '158a49aa3750478a84bf71b9aad24397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:24.652103 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4b3430-f912-4178-a664-7f07a7a51988 service nova] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:24.652439 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4b3430-f912-4178-a664-7f07a7a51988 service nova] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:24.652669 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4b3430-f912-4178-a664-7f07a7a51988 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:24.657619 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07ba8a7-6062-4f72-825f-47bc69927e70 service nova] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:24.659358 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-d07ba8a7-6062-4f72-825f-47bc69927e70 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:16:24.665237 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4b3430-f912-4178-a664-7f07a7a51988 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:24.667076 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4b3430-f912-4178-a664-7f07a7a51988 service nova] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:24.717975 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 923/1842] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:16:24 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 10:16:24.770145 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07ba8a7-6062-4f72-825f-47bc69927e70 service nova] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:24.774921 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2a18ea-4aae-4878-8f30-8dcb434e9014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:24.775806 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2a18ea-4aae-4878-8f30-8dcb434e9014 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:24.776095 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2a18ea-4aae-4878-8f30-8dcb434e9014 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:24.776375 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2a18ea-4aae-4878-8f30-8dcb434e9014 admin admin] PATH_INFO: `/v3/projects/21817eb68e8e47c0a163099b0680b77b` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:24.777587 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2a18ea-4aae-4878-8f30-8dcb434e9014 admin admin] RBAC: Authorizing `identity:delete_project(project_id=21817eb68e8e47c0a163099b0680b77b)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:24.779559 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2a18ea-4aae-4878-8f30-8dcb434e9014 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:24.836269 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-9d2a18ea-4aae-4878-8f30-8dcb434e9014 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21817eb68e8e47c0a163099b0680b77b', 'request_id': 'req-9d2a18ea-4aae-4878-8f30-8dcb434e9014'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:24.855985 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-9d2a18ea-4aae-4878-8f30-8dcb434e9014 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21817eb68e8e47c0a163099b0680b77b', 'request_id': 'req-9d2a18ea-4aae-4878-8f30-8dcb434e9014'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:24.868628 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-9d2a18ea-4aae-4878-8f30-8dcb434e9014 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21817eb68e8e47c0a163099b0680b77b', 'request_id': 'req-9d2a18ea-4aae-4878-8f30-8dcb434e9014'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:24.891467 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-9d2a18ea-4aae-4878-8f30-8dcb434e9014 admin admin] The token cache is being invalidate because project 21817eb68e8e47c0a163099b0680b77b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:16:24.892548 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-9d2a18ea-4aae-4878-8f30-8dcb434e9014 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:24.893651 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-9d2a18ea-4aae-4878-8f30-8dcb434e9014 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:24.899028 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 920/1843] 10.222.0.43 () {58 vars in 1232 bytes} [Wed Jun 22 10:16:24 2022] DELETE /identity/v3/projects/21817eb68e8e47c0a163099b0680b77b => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:16:24.901071 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1bc11e-8399-465a-8e81-ea2fb9113daa None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:24.901372 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1bc11e-8399-465a-8e81-ea2fb9113daa None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:24.901661 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1bc11e-8399-465a-8e81-ea2fb9113daa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:24.936517 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-ee1bc11e-8399-465a-8e81-ea2fb9113daa None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:16:24.937483 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-ee1bc11e-8399-465a-8e81-ea2fb9113daa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:16:24.989238 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:16:25.039946 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 924/1844] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:16:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:16:25.047680 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cf1b64-fa61-4aef-a63d-0866c4bccf6f None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:25.049138 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cf1b64-fa61-4aef-a63d-0866c4bccf6f None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:25.049634 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cf1b64-fa61-4aef-a63d-0866c4bccf6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:25.068708 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1bc11e-8399-465a-8e81-ea2fb9113daa None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:25.070487 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-ee1bc11e-8399-465a-8e81-ea2fb9113daa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:16:25.072191 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-59cf1b64-fa61-4aef-a63d-0866c4bccf6f None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:16:25.073377 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-59cf1b64-fa61-4aef-a63d-0866c4bccf6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:16:25.083180 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 921/1845] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:16:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:16:25.090261 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1bc11e-8399-465a-8e81-ea2fb9113daa None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:25.093773 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cf1b64-fa61-4aef-a63d-0866c4bccf6f None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:25.098233 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f18798-88e1-466c-a102-f8896d29e9c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:25.104906 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cf1b64-fa61-4aef-a63d-0866c4bccf6f None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:25.105581 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f18798-88e1-466c-a102-f8896d29e9c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:25.106038 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f18798-88e1-466c-a102-f8896d29e9c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:25.106462 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f18798-88e1-466c-a102-f8896d29e9c2 admin admin] PATH_INFO: `/v3/users/ea52f49e642b4ad3aef61a93eea7fb04` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:25.108251 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f18798-88e1-466c-a102-f8896d29e9c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea52f49e642b4ad3aef61a93eea7fb04)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:25.110448 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9267de-ea72-43b5-ae32-b8babb577004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:25.111156 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f18798-88e1-466c-a102-f8896d29e9c2 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:25.112020 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9267de-ea72-43b5-ae32-b8babb577004 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:25.112371 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9267de-ea72-43b5-ae32-b8babb577004 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:25.112715 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9267de-ea72-43b5-ae32-b8babb577004 admin admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:25.113637 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9267de-ea72-43b5-ae32-b8babb577004 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:16:25.114046 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9267de-ea72-43b5-ae32-b8babb577004 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:25.115779 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9267de-ea72-43b5-ae32-b8babb577004 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:25.128709 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 922/1846] 10.222.0.43 () {58 vars in 1152 bytes} [Wed Jun 22 10:16:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:16:25.133131 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9267de-ea72-43b5-ae32-b8babb577004 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:25.144822 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9267de-ea72-43b5-ae32-b8babb577004 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:25.151404 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b4a030-dbce-4240-978f-26fffd5fcc49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:25.152200 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b4a030-dbce-4240-978f-26fffd5fcc49 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:25.152491 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b4a030-dbce-4240-978f-26fffd5fcc49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:25.152838 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b4a030-dbce-4240-978f-26fffd5fcc49 admin admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:25.153741 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b4a030-dbce-4240-978f-26fffd5fcc49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:25.155781 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b4a030-dbce-4240-978f-26fffd5fcc49 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:25.170767 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-f7f18798-88e1-466c-a102-f8896d29e9c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea52f49e642b4ad3aef61a93eea7fb04'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:25.185510 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-f7f18798-88e1-466c-a102-f8896d29e9c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea52f49e642b4ad3aef61a93eea7fb04'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:25.189864 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 923/1847] 10.222.0.43 () {60 vars in 1152 bytes} [Wed Jun 22 10:16:25 2022] POST /identity/v3/projects => generated 383 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 10:16:25.193637 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b4a030-dbce-4240-978f-26fffd5fcc49 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:25.200911 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-f7f18798-88e1-466c-a102-f8896d29e9c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea52f49e642b4ad3aef61a93eea7fb04'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:25.212222 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-f7f18798-88e1-466c-a102-f8896d29e9c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea52f49e642b4ad3aef61a93eea7fb04'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:25.212997 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-f7f18798-88e1-466c-a102-f8896d29e9c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea52f49e642b4ad3aef61a93eea7fb04'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:25.219308 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 925/1848] 10.222.0.43 () {58 vars in 1223 bytes} [Wed Jun 22 10:16:25 2022] DELETE /identity/v3/users/ea52f49e642b4ad3aef61a93eea7fb04 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:16:25.227636 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2acbcf-f6fb-443c-98d8-f3799ff03fa3 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:25.228066 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2acbcf-f6fb-443c-98d8-f3799ff03fa3 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:25.228432 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2acbcf-f6fb-443c-98d8-f3799ff03fa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:25.248968 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-dd2acbcf-f6fb-443c-98d8-f3799ff03fa3 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:16:25.250332 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-dd2acbcf-f6fb-443c-98d8-f3799ff03fa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:16:25.254277 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:16:25.285047 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b4a030-dbce-4240-978f-26fffd5fcc49 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:25.362410 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff8d608-4832-4068-b6e3-331ea6b52d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:25.363288 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff8d608-4832-4068-b6e3-331ea6b52d77 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:25.363682 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff8d608-4832-4068-b6e3-331ea6b52d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:25.364122 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff8d608-4832-4068-b6e3-331ea6b52d77 admin admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:25.364909 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff8d608-4832-4068-b6e3-331ea6b52d77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:25.367082 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff8d608-4832-4068-b6e3-331ea6b52d77 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:25.393738 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 924/1849] 10.222.0.43 () {60 vars in 1143 bytes} [Wed Jun 22 10:16:25 2022] POST /identity/v3/users => generated 292 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 10:16:25.396523 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff8d608-4832-4068-b6e3-331ea6b52d77 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:25.398511 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-5ff8d608-4832-4068-b6e3-331ea6b52d77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:16:25.411146 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff8d608-4832-4068-b6e3-331ea6b52d77 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:25.415974 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e02591c-c3f1-4890-86bf-434b9a564fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:25.416657 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e02591c-c3f1-4890-86bf-434b9a564fd6 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:25.416944 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e02591c-c3f1-4890-86bf-434b9a564fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:25.417224 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e02591c-c3f1-4890-86bf-434b9a564fd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:25.417997 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e02591c-c3f1-4890-86bf-434b9a564fd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:25.419622 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e02591c-c3f1-4890-86bf-434b9a564fd6 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:25.431277 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 925/1850] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:16:25 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 10:16:25.435022 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e02591c-c3f1-4890-86bf-434b9a564fd6 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:25.445866 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e02591c-c3f1-4890-86bf-434b9a564fd6 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:25.450944 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9ec963-74fb-44bf-ad1e-47d968ff9d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:25.451637 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9ec963-74fb-44bf-ad1e-47d968ff9d18 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:25.451876 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9ec963-74fb-44bf-ad1e-47d968ff9d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:25.452160 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9ec963-74fb-44bf-ad1e-47d968ff9d18 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:25.452889 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9ec963-74fb-44bf-ad1e-47d968ff9d18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:25.454754 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9ec963-74fb-44bf-ad1e-47d968ff9d18 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:25.469087 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 926/1851] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:16:25 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 10:16:25.473708 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9ec963-74fb-44bf-ad1e-47d968ff9d18 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:25.484121 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9ec963-74fb-44bf-ad1e-47d968ff9d18 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:25.488641 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 926/1852] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:16:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:16:25.490084 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9700a99-771b-42ee-b1a1-2b64dadd3f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:25.491118 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9700a99-771b-42ee-b1a1-2b64dadd3f45 admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:25.491414 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9700a99-771b-42ee-b1a1-2b64dadd3f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:25.491699 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9700a99-771b-42ee-b1a1-2b64dadd3f45 admin admin] PATH_INFO: `/v3/projects/f718893cad6d4a9c925fdc026f1ad2a6/users/7cc8509ceff5408293ba7d58bad0d1b1/roles/9f88c83743f745a9a785a2f454753f06` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:25.495830 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2acbcf-f6fb-443c-98d8-f3799ff03fa3 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:25.497297 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-dd2acbcf-f6fb-443c-98d8-f3799ff03fa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:16:25.511603 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9700a99-771b-42ee-b1a1-2b64dadd3f45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f718893cad6d4a9c925fdc026f1ad2a6, user_id=7cc8509ceff5408293ba7d58bad0d1b1, role_id=9f88c83743f745a9a785a2f454753f06)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:25.514326 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9700a99-771b-42ee-b1a1-2b64dadd3f45 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:25.529812 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 927/1853] 10.222.0.43 () {60 vars in 1482 bytes} [Wed Jun 22 10:16:25 2022] PUT /identity/v3/projects/f718893cad6d4a9c925fdc026f1ad2a6/users/7cc8509ceff5408293ba7d58bad0d1b1/roles/9f88c83743f745a9a785a2f454753f06 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:16:25.542185 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c974158-979d-4d49-a56f-c5a803ebfb69 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:25.542482 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c974158-979d-4d49-a56f-c5a803ebfb69 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:25.542943 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c974158-979d-4d49-a56f-c5a803ebfb69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:25.575683 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-1c974158-979d-4d49-a56f-c5a803ebfb69 None None] MFA Rules not processed for user `7cc8509ceff5408293ba7d58bad0d1b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:16:25.577069 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-1c974158-979d-4d49-a56f-c5a803ebfb69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:16:25.578773 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2acbcf-f6fb-443c-98d8-f3799ff03fa3 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:25.584288 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:16:25.652709 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569bcf5b-716d-4158-9c0d-477af318d5b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe93d4c0737249fd8623bb5ce188e34e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:25.653470 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569bcf5b-716d-4158-9c0d-477af318d5b9 service neutron] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:25.653862 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569bcf5b-716d-4158-9c0d-477af318d5b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:25.654565 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569bcf5b-716d-4158-9c0d-477af318d5b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:25.666379 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 928/1854] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:16:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:16:25.670740 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c974158-979d-4d49-a56f-c5a803ebfb69 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:25.701247 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:16:25.726069 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569bcf5b-716d-4158-9c0d-477af318d5b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:25.727431 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569bcf5b-716d-4158-9c0d-477af318d5b9 service neutron] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:25.738343 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 927/1855] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:16:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 10:16:25.747333 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c974158-979d-4d49-a56f-c5a803ebfb69 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:25.753336 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7431f5b1-a5e7-4420-afdf-347dfd1c2350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:25.754538 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7431f5b1-a5e7-4420-afdf-347dfd1c2350 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:25.754896 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7431f5b1-a5e7-4420-afdf-347dfd1c2350 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:25.755491 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7431f5b1-a5e7-4420-afdf-347dfd1c2350 admin admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:25.756271 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7431f5b1-a5e7-4420-afdf-347dfd1c2350 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:25.758291 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7431f5b1-a5e7-4420-afdf-347dfd1c2350 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:25.796579 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 929/1856] 10.222.0.43 () {60 vars in 1152 bytes} [Wed Jun 22 10:16:25 2022] POST /identity/v3/projects => generated 383 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 10:16:25.801112 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569bcf5b-716d-4158-9c0d-477af318d5b9 service neutron] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:25.812846 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569bcf5b-716d-4158-9c0d-477af318d5b9 service neutron] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:25.893787 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aca16dc-30a3-4a35-81ef-6f46503fd190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:25.894722 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aca16dc-30a3-4a35-81ef-6f46503fd190 admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:25.895195 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aca16dc-30a3-4a35-81ef-6f46503fd190 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:25.895480 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aca16dc-30a3-4a35-81ef-6f46503fd190 admin admin] PATH_INFO: `/v3/users` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:25.896181 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aca16dc-30a3-4a35-81ef-6f46503fd190 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:25.898149 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aca16dc-30a3-4a35-81ef-6f46503fd190 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:25.927535 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 928/1857] 10.222.0.43 () {60 vars in 1143 bytes} [Wed Jun 22 10:16:25 2022] POST /identity/v3/users => generated 298 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:16:25.931416 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7431f5b1-a5e7-4420-afdf-347dfd1c2350 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:25.958372 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7431f5b1-a5e7-4420-afdf-347dfd1c2350 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:25.967808 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3438ccb8-8138-44f1-98e7-be3eff60e98e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:25.968584 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3438ccb8-8138-44f1-98e7-be3eff60e98e admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:25.968942 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3438ccb8-8138-44f1-98e7-be3eff60e98e admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:25.969413 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3438ccb8-8138-44f1-98e7-be3eff60e98e admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:25.971303 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3438ccb8-8138-44f1-98e7-be3eff60e98e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:25.973511 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3438ccb8-8138-44f1-98e7-be3eff60e98e admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:25.991020 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 930/1858] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:16:25 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:16:26.003124 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aca16dc-30a3-4a35-81ef-6f46503fd190 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:26.014319 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aca16dc-30a3-4a35-81ef-6f46503fd190 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:26.019900 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b5de6a-c05a-4cb8-84a9-04d52c17ecc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:26.020834 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b5de6a-c05a-4cb8-84a9-04d52c17ecc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:26.021118 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b5de6a-c05a-4cb8-84a9-04d52c17ecc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:26.021395 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b5de6a-c05a-4cb8-84a9-04d52c17ecc0 admin admin] PATH_INFO: `/v3/projects/229c47823cdf45ad90ff20199035b847/users/3a86b35237154ecd80aca2485870814f/roles/26d9c2ab5dfc4e6d9ca80c6014123906` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:26.040936 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b5de6a-c05a-4cb8-84a9-04d52c17ecc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=229c47823cdf45ad90ff20199035b847, user_id=3a86b35237154ecd80aca2485870814f, role_id=26d9c2ab5dfc4e6d9ca80c6014123906)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:26.043865 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b5de6a-c05a-4cb8-84a9-04d52c17ecc0 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:26.046677 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3438ccb8-8138-44f1-98e7-be3eff60e98e admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:26.048419 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-3438ccb8-8138-44f1-98e7-be3eff60e98e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:16:26.068433 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3438ccb8-8138-44f1-98e7-be3eff60e98e admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:26.071041 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 929/1859] 10.222.0.43 () {60 vars in 1482 bytes} [Wed Jun 22 10:16:25 2022] PUT /identity/v3/projects/229c47823cdf45ad90ff20199035b847/users/3a86b35237154ecd80aca2485870814f/roles/26d9c2ab5dfc4e6d9ca80c6014123906 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:16:26.075178 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b5de6a-c05a-4cb8-84a9-04d52c17ecc0 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:26.112886 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:16:26.158326 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5debd40a-0fc8-48a8-99b4-c81007727e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:26.159236 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b5de6a-c05a-4cb8-84a9-04d52c17ecc0 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:26.159390 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5debd40a-0fc8-48a8-99b4-c81007727e6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:26.159676 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5debd40a-0fc8-48a8-99b4-c81007727e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:26.159950 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5debd40a-0fc8-48a8-99b4-c81007727e6d admin admin] PATH_INFO: `/v3/projects/1f86edb1750441af89ecefc44ac2dba2` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:26.161125 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5debd40a-0fc8-48a8-99b4-c81007727e6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f86edb1750441af89ecefc44ac2dba2)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:26.163060 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5debd40a-0fc8-48a8-99b4-c81007727e6d admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:26.164299 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e9bd6a-53d9-48c5-8805-6b0d2692f1af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:26.164969 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e9bd6a-53d9-48c5-8805-6b0d2692f1af admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:26.165257 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e9bd6a-53d9-48c5-8805-6b0d2692f1af admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:26.165543 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e9bd6a-53d9-48c5-8805-6b0d2692f1af admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:26.166314 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e9bd6a-53d9-48c5-8805-6b0d2692f1af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:26.167916 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e9bd6a-53d9-48c5-8805-6b0d2692f1af admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:26.178185 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 930/1860] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:16:26 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:16:26.182183 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e9bd6a-53d9-48c5-8805-6b0d2692f1af admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:26.192246 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e9bd6a-53d9-48c5-8805-6b0d2692f1af admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:26.198139 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8c8aa5-683a-4f14-b019-95542e842809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:26.199027 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8c8aa5-683a-4f14-b019-95542e842809 admin admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:26.199378 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8c8aa5-683a-4f14-b019-95542e842809 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:26.199584 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8c8aa5-683a-4f14-b019-95542e842809 admin admin] PATH_INFO: `/v3/projects/229c47823cdf45ad90ff20199035b847/users/3a86b35237154ecd80aca2485870814f/roles/26d9c2ab5dfc4e6d9ca80c6014123906` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:26.201614 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8c8aa5-683a-4f14-b019-95542e842809 admin admin] RBAC: Authorizing `identity:create_grant(project_id=229c47823cdf45ad90ff20199035b847, user_id=3a86b35237154ecd80aca2485870814f, role_id=26d9c2ab5dfc4e6d9ca80c6014123906)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:26.204832 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8c8aa5-683a-4f14-b019-95542e842809 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:26.214575 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-5debd40a-0fc8-48a8-99b4-c81007727e6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f86edb1750441af89ecefc44ac2dba2', 'request_id': 'req-5debd40a-0fc8-48a8-99b4-c81007727e6d'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:26.215770 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 931/1861] 10.222.0.43 () {60 vars in 1482 bytes} [Wed Jun 22 10:16:26 2022] PUT /identity/v3/projects/229c47823cdf45ad90ff20199035b847/users/3a86b35237154ecd80aca2485870814f/roles/26d9c2ab5dfc4e6d9ca80c6014123906 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:16:26.220817 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-5debd40a-0fc8-48a8-99b4-c81007727e6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f86edb1750441af89ecefc44ac2dba2', 'request_id': 'req-5debd40a-0fc8-48a8-99b4-c81007727e6d'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:26.226432 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bafc145-442d-42a0-aeb2-d3a0abbb2502 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:26.226748 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bafc145-442d-42a0-aeb2-d3a0abbb2502 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:26.227055 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bafc145-442d-42a0-aeb2-d3a0abbb2502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:26.228583 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-5debd40a-0fc8-48a8-99b4-c81007727e6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f86edb1750441af89ecefc44ac2dba2', 'request_id': 'req-5debd40a-0fc8-48a8-99b4-c81007727e6d'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:26.239939 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-5debd40a-0fc8-48a8-99b4-c81007727e6d admin admin] The token cache is being invalidate because project 1f86edb1750441af89ecefc44ac2dba2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:16:26.240294 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-5debd40a-0fc8-48a8-99b4-c81007727e6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:26.240984 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-5debd40a-0fc8-48a8-99b4-c81007727e6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:26.242877 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 931/1862] 10.222.0.43 () {58 vars in 1232 bytes} [Wed Jun 22 10:16:26 2022] DELETE /identity/v3/projects/1f86edb1750441af89ecefc44ac2dba2 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:16:26.247198 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ccef25-f74b-4fae-9628-7f1abeda1548 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:26.247557 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ccef25-f74b-4fae-9628-7f1abeda1548 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:26.247762 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ccef25-f74b-4fae-9628-7f1abeda1548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:26.255265 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-7bafc145-442d-42a0-aeb2-d3a0abbb2502 None None] MFA Rules not processed for user `3a86b35237154ecd80aca2485870814f`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:16:26.257279 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-7bafc145-442d-42a0-aeb2-d3a0abbb2502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:16:26.268853 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-c9ccef25-f74b-4fae-9628-7f1abeda1548 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:16:26.270275 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-c9ccef25-f74b-4fae-9628-7f1abeda1548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:16:26.312958 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:16:26.391130 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 932/1863] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:16:26 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:16:26.395355 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156a3996-40f9-41e1-beee-8f1217b8fa08 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:26.396146 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156a3996-40f9-41e1-beee-8f1217b8fa08 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:26.396442 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156a3996-40f9-41e1-beee-8f1217b8fa08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:26.398186 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 932/1864] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:16:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:16:26.406249 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ccef25-f74b-4fae-9628-7f1abeda1548 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:26.408602 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-c9ccef25-f74b-4fae-9628-7f1abeda1548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:16:26.430963 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-156a3996-40f9-41e1-beee-8f1217b8fa08 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:16:26.432189 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-156a3996-40f9-41e1-beee-8f1217b8fa08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:16:26.443978 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 933/1865] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:16:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:16:26.448175 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156a3996-40f9-41e1-beee-8f1217b8fa08 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:26.469166 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156a3996-40f9-41e1-beee-8f1217b8fa08 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:26.478227 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f5d407-1928-4eec-9a31-ed0691b3a2f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:26.478487 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f5d407-1928-4eec-9a31-ed0691b3a2f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:26.478908 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f5d407-1928-4eec-9a31-ed0691b3a2f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:26.480338 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f5d407-1928-4eec-9a31-ed0691b3a2f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:26.480455 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f5d407-1928-4eec-9a31-ed0691b3a2f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:16:26.480862 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f5d407-1928-4eec-9a31-ed0691b3a2f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:26.482744 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f5d407-1928-4eec-9a31-ed0691b3a2f2 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:26.499284 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 934/1866] 10.222.0.43 () {58 vars in 1152 bytes} [Wed Jun 22 10:16:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:16:26.500424 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f5d407-1928-4eec-9a31-ed0691b3a2f2 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:26.529143 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f5d407-1928-4eec-9a31-ed0691b3a2f2 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:26.548257 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55da0df9-b612-4bf5-a007-16b5e956211d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:26.549202 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55da0df9-b612-4bf5-a007-16b5e956211d admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:26.549588 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55da0df9-b612-4bf5-a007-16b5e956211d admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:26.550022 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55da0df9-b612-4bf5-a007-16b5e956211d admin admin] PATH_INFO: `/v3/projects` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:26.550882 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55da0df9-b612-4bf5-a007-16b5e956211d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:26.552999 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55da0df9-b612-4bf5-a007-16b5e956211d admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:26.569867 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ccef25-f74b-4fae-9628-7f1abeda1548 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:26.575402 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c150ef-9541-4816-a314-f05749801740 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bbcb3d4dc704dfdb0097abc594ca855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:26.576448 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c150ef-9541-4816-a314-f05749801740 service cinder] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:26.577455 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c150ef-9541-4816-a314-f05749801740 service cinder] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:26.578157 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c150ef-9541-4816-a314-f05749801740 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:26.593019 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c150ef-9541-4816-a314-f05749801740 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:26.595601 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c150ef-9541-4816-a314-f05749801740 service cinder] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:26.609888 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 935/1867] 10.222.0.43 () {60 vars in 1152 bytes} [Wed Jun 22 10:16:26 2022] POST /identity/v3/projects => generated 405 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:16:26.613808 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 933/1868] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:16:26 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:16:26.614529 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55da0df9-b612-4bf5-a007-16b5e956211d admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:26.730966 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:16:26.751079 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55da0df9-b612-4bf5-a007-16b5e956211d admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:26.759116 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a57368f-de9d-4a01-9e6e-50a9953ad52b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:26.761495 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a57368f-de9d-4a01-9e6e-50a9953ad52b admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:26.761828 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a57368f-de9d-4a01-9e6e-50a9953ad52b admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:26.763256 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a57368f-de9d-4a01-9e6e-50a9953ad52b admin admin] PATH_INFO: `/v3/users` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:26.764501 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a57368f-de9d-4a01-9e6e-50a9953ad52b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:26.768407 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a57368f-de9d-4a01-9e6e-50a9953ad52b admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:26.791158 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c150ef-9541-4816-a314-f05749801740 service cinder] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:26.805795 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c150ef-9541-4816-a314-f05749801740 service cinder] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:26.819576 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 936/1869] 10.222.0.43 () {60 vars in 1143 bytes} [Wed Jun 22 10:16:26 2022] POST /identity/v3/users => generated 303 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:16:26.823467 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a57368f-de9d-4a01-9e6e-50a9953ad52b admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:26.834864 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a57368f-de9d-4a01-9e6e-50a9953ad52b admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:26.840072 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eee00f-506e-4863-ab67-24ac4b8303f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:26.840746 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eee00f-506e-4863-ab67-24ac4b8303f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:26.841037 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eee00f-506e-4863-ab67-24ac4b8303f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:26.841324 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eee00f-506e-4863-ab67-24ac4b8303f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:26.842254 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7eee00f-506e-4863-ab67-24ac4b8303f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:26.843911 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7eee00f-506e-4863-ab67-24ac4b8303f4 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:26.860248 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 937/1870] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:16:26 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 10:16:26.861964 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eee00f-506e-4863-ab67-24ac4b8303f4 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:26.873245 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eee00f-506e-4863-ab67-24ac4b8303f4 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:26.884534 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f30692-b54c-4308-94c4-ac34d8204fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:26.885223 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f30692-b54c-4308-94c4-ac34d8204fe1 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:26.885513 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f30692-b54c-4308-94c4-ac34d8204fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:26.885829 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f30692-b54c-4308-94c4-ac34d8204fe1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:26.886876 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f30692-b54c-4308-94c4-ac34d8204fe1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:26.889010 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f30692-b54c-4308-94c4-ac34d8204fe1 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:26.894587 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a4d00f-92e1-4474-9292-1bd74e903fef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bbcb3d4dc704dfdb0097abc594ca855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:26.895263 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a4d00f-92e1-4474-9292-1bd74e903fef service cinder] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:26.895556 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a4d00f-92e1-4474-9292-1bd74e903fef service cinder] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:26.895836 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a4d00f-92e1-4474-9292-1bd74e903fef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:26.898141 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-36a4d00f-92e1-4474-9292-1bd74e903fef service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:16:26.906481 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 938/1871] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:16:26 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:16:26.907649 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f30692-b54c-4308-94c4-ac34d8204fe1 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:26.919781 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f30692-b54c-4308-94c4-ac34d8204fe1 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:26.925673 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abf2ea8-4110-47b5-b25c-52d2fa16b3a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:26.926636 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abf2ea8-4110-47b5-b25c-52d2fa16b3a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:26.927048 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abf2ea8-4110-47b5-b25c-52d2fa16b3a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:26.927337 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abf2ea8-4110-47b5-b25c-52d2fa16b3a8 admin admin] PATH_INFO: `/v3/projects/58e0fb0a164241a5b29d13a059df08ac/users/d3b951324c7c437cbc27272da7454502/roles/9f88c83743f745a9a785a2f454753f06` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:26.944965 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abf2ea8-4110-47b5-b25c-52d2fa16b3a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58e0fb0a164241a5b29d13a059df08ac, user_id=d3b951324c7c437cbc27272da7454502, role_id=9f88c83743f745a9a785a2f454753f06)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:26.947906 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abf2ea8-4110-47b5-b25c-52d2fa16b3a8 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:26.967150 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 939/1872] 10.222.0.43 () {60 vars in 1482 bytes} [Wed Jun 22 10:16:26 2022] PUT /identity/v3/projects/58e0fb0a164241a5b29d13a059df08ac/users/d3b951324c7c437cbc27272da7454502/roles/9f88c83743f745a9a785a2f454753f06 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:16:26.973401 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dee2dc-6e5a-41a1-98e3-d060c2fc497e None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:26.973767 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dee2dc-6e5a-41a1-98e3-d060c2fc497e None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:26.974056 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dee2dc-6e5a-41a1-98e3-d060c2fc497e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:26.974790 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a4d00f-92e1-4474-9292-1bd74e903fef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:26.976325 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a4d00f-92e1-4474-9292-1bd74e903fef service cinder] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:26.991192 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 934/1873] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:16:26 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 10:16:26.996171 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-51dee2dc-6e5a-41a1-98e3-d060c2fc497e None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:16:26.997568 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-51dee2dc-6e5a-41a1-98e3-d060c2fc497e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:16:27.114850 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 940/1874] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:16:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:16:27.128996 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a4d00f-92e1-4474-9292-1bd74e903fef service cinder] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:27.130621 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-36a4d00f-92e1-4474-9292-1bd74e903fef service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:16:27.180203 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:16:27.225187 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a4d00f-92e1-4474-9292-1bd74e903fef service cinder] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:27.299782 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e812334-7f80-42ae-9f1d-95888dddbdf4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe93d4c0737249fd8623bb5ce188e34e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:27.301281 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e812334-7f80-42ae-9f1d-95888dddbdf4 service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:27.301781 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e812334-7f80-42ae-9f1d-95888dddbdf4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:27.302571 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e812334-7f80-42ae-9f1d-95888dddbdf4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:27.330276 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e812334-7f80-42ae-9f1d-95888dddbdf4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:27.331743 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e812334-7f80-42ae-9f1d-95888dddbdf4 service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:27.352578 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 935/1875] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:16:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:16:27.450824 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dee2dc-6e5a-41a1-98e3-d060c2fc497e None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:27.459449 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-51dee2dc-6e5a-41a1-98e3-d060c2fc497e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:16:27.484489 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dee2dc-6e5a-41a1-98e3-d060c2fc497e None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:27.497834 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be11380-145f-4e72-9749-8ff11158963a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:27.499115 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be11380-145f-4e72-9749-8ff11158963a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:27.499614 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be11380-145f-4e72-9749-8ff11158963a admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:27.500104 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be11380-145f-4e72-9749-8ff11158963a admin admin] PATH_INFO: `/v3/users/7cc8509ceff5408293ba7d58bad0d1b1` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:27.501807 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be11380-145f-4e72-9749-8ff11158963a admin admin] RBAC: Authorizing `identity:delete_user(user_id=7cc8509ceff5408293ba7d58bad0d1b1)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:27.504575 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be11380-145f-4e72-9749-8ff11158963a admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:27.578188 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-8be11380-145f-4e72-9749-8ff11158963a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7cc8509ceff5408293ba7d58bad0d1b1'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:27.601483 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-8be11380-145f-4e72-9749-8ff11158963a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7cc8509ceff5408293ba7d58bad0d1b1'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:27.618477 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-8be11380-145f-4e72-9749-8ff11158963a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7cc8509ceff5408293ba7d58bad0d1b1'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:27.632169 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-8be11380-145f-4e72-9749-8ff11158963a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7cc8509ceff5408293ba7d58bad0d1b1'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:27.633584 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-8be11380-145f-4e72-9749-8ff11158963a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7cc8509ceff5408293ba7d58bad0d1b1'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:27.642200 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 941/1876] 10.222.0.43 () {58 vars in 1223 bytes} [Wed Jun 22 10:16:27 2022] DELETE /identity/v3/users/7cc8509ceff5408293ba7d58bad0d1b1 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:16:27.646763 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123727da-0ae6-47c0-bc48-61d899e50498 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:27.647053 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123727da-0ae6-47c0-bc48-61d899e50498 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:27.647327 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123727da-0ae6-47c0-bc48-61d899e50498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:27.666317 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-123727da-0ae6-47c0-bc48-61d899e50498 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:16:27.667629 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-123727da-0ae6-47c0-bc48-61d899e50498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:16:27.750895 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 936/1877] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:16:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:16:27.786338 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be11380-145f-4e72-9749-8ff11158963a admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:27.788114 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-8be11380-145f-4e72-9749-8ff11158963a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:16:27.796569 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:16:27.862082 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be11380-145f-4e72-9749-8ff11158963a admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:27.865987 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9983811-6859-4e39-9e0c-2ebfdbe1d44d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe93d4c0737249fd8623bb5ce188e34e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:27.866754 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9983811-6859-4e39-9e0c-2ebfdbe1d44d service neutron] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:27.867046 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9983811-6859-4e39-9e0c-2ebfdbe1d44d service neutron] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:27.867369 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9983811-6859-4e39-9e0c-2ebfdbe1d44d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:27.880668 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9983811-6859-4e39-9e0c-2ebfdbe1d44d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:27.882328 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9983811-6859-4e39-9e0c-2ebfdbe1d44d service neutron] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:27.892999 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 942/1878] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:16:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:16:29.008884 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123727da-0ae6-47c0-bc48-61d899e50498 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:29.010503 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-123727da-0ae6-47c0-bc48-61d899e50498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:16:29.023281 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123727da-0ae6-47c0-bc48-61d899e50498 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:29.034989 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18d5f10-9cc4-457b-b561-583487931819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:29.035876 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18d5f10-9cc4-457b-b561-583487931819 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:29.036159 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18d5f10-9cc4-457b-b561-583487931819 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:29.036598 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18d5f10-9cc4-457b-b561-583487931819 admin admin] PATH_INFO: `/v3/projects/f718893cad6d4a9c925fdc026f1ad2a6` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:29.038000 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18d5f10-9cc4-457b-b561-583487931819 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f718893cad6d4a9c925fdc026f1ad2a6)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:29.040103 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18d5f10-9cc4-457b-b561-583487931819 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:29.115486 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-e18d5f10-9cc4-457b-b561-583487931819 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f718893cad6d4a9c925fdc026f1ad2a6', 'request_id': 'req-e18d5f10-9cc4-457b-b561-583487931819'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:29.122122 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-e18d5f10-9cc4-457b-b561-583487931819 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f718893cad6d4a9c925fdc026f1ad2a6', 'request_id': 'req-e18d5f10-9cc4-457b-b561-583487931819'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:29.140434 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-e18d5f10-9cc4-457b-b561-583487931819 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f718893cad6d4a9c925fdc026f1ad2a6', 'request_id': 'req-e18d5f10-9cc4-457b-b561-583487931819'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:29.161809 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9983811-6859-4e39-9e0c-2ebfdbe1d44d service neutron] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:29.164173 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-f9983811-6859-4e39-9e0c-2ebfdbe1d44d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:16:29.165022 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-e18d5f10-9cc4-457b-b561-583487931819 admin admin] The token cache is being invalidate because project f718893cad6d4a9c925fdc026f1ad2a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:16:29.165324 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-e18d5f10-9cc4-457b-b561-583487931819 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:29.166026 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-e18d5f10-9cc4-457b-b561-583487931819 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:29.169742 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 937/1879] 10.222.0.43 () {58 vars in 1232 bytes} [Wed Jun 22 10:16:29 2022] DELETE /identity/v3/projects/f718893cad6d4a9c925fdc026f1ad2a6 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:16:29.178550 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18d5f10-9cc4-457b-b561-583487931819 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:29.181268 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-e18d5f10-9cc4-457b-b561-583487931819 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:16:29.190386 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9983811-6859-4e39-9e0c-2ebfdbe1d44d service neutron] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:29.207019 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:16:29.302870 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c51f05-e07a-45dc-9257-5b347f6e8fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:29.304009 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c51f05-e07a-45dc-9257-5b347f6e8fc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:29.304449 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c51f05-e07a-45dc-9257-5b347f6e8fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:29.304876 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c51f05-e07a-45dc-9257-5b347f6e8fc6 admin admin] PATH_INFO: `/v3/users/23387cbe868b44fba54e82427897eb4f` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:29.306334 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c51f05-e07a-45dc-9257-5b347f6e8fc6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=23387cbe868b44fba54e82427897eb4f)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:29.308288 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c51f05-e07a-45dc-9257-5b347f6e8fc6 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:29.309240 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18d5f10-9cc4-457b-b561-583487931819 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:29.315319 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6a9a34-3c6e-40a1-a23d-a7ee3557f256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:29.316322 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6a9a34-3c6e-40a1-a23d-a7ee3557f256 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:29.316713 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6a9a34-3c6e-40a1-a23d-a7ee3557f256 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:29.317098 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6a9a34-3c6e-40a1-a23d-a7ee3557f256 admin admin] PATH_INFO: `/v3/users/3a86b35237154ecd80aca2485870814f` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:29.318469 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6a9a34-3c6e-40a1-a23d-a7ee3557f256 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a86b35237154ecd80aca2485870814f)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:29.320532 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6a9a34-3c6e-40a1-a23d-a7ee3557f256 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:29.369616 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-25c51f05-e07a-45dc-9257-5b347f6e8fc6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23387cbe868b44fba54e82427897eb4f'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:29.378973 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-1a6a9a34-3c6e-40a1-a23d-a7ee3557f256 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a86b35237154ecd80aca2485870814f'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:29.388363 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-25c51f05-e07a-45dc-9257-5b347f6e8fc6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23387cbe868b44fba54e82427897eb4f'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:29.394350 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-1a6a9a34-3c6e-40a1-a23d-a7ee3557f256 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a86b35237154ecd80aca2485870814f'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:29.398366 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-25c51f05-e07a-45dc-9257-5b347f6e8fc6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23387cbe868b44fba54e82427897eb4f'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:29.404699 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-1a6a9a34-3c6e-40a1-a23d-a7ee3557f256 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a86b35237154ecd80aca2485870814f'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:29.405626 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-1a6a9a34-3c6e-40a1-a23d-a7ee3557f256 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a86b35237154ecd80aca2485870814f'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:29.413017 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-25c51f05-e07a-45dc-9257-5b347f6e8fc6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23387cbe868b44fba54e82427897eb4f'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:29.413883 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-25c51f05-e07a-45dc-9257-5b347f6e8fc6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23387cbe868b44fba54e82427897eb4f'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:29.419697 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-1a6a9a34-3c6e-40a1-a23d-a7ee3557f256 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a86b35237154ecd80aca2485870814f'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:29.426110 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 943/1880] 10.222.0.43 () {58 vars in 1223 bytes} [Wed Jun 22 10:16:29 2022] DELETE /identity/v3/users/23387cbe868b44fba54e82427897eb4f => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:16:29.428993 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 938/1881] 10.222.0.43 () {58 vars in 1223 bytes} [Wed Jun 22 10:16:29 2022] DELETE /identity/v3/users/3a86b35237154ecd80aca2485870814f => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:16:29.434436 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafc2a48-1204-4d69-9004-bd149f40669b None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:29.434907 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafc2a48-1204-4d69-9004-bd149f40669b None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:29.435044 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a47a73-a313-4cd5-9527-1e7ebd63552a None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:29.435364 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a47a73-a313-4cd5-9527-1e7ebd63552a None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:29.435710 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafc2a48-1204-4d69-9004-bd149f40669b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:29.435822 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a47a73-a313-4cd5-9527-1e7ebd63552a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:29.480407 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-38a47a73-a313-4cd5-9527-1e7ebd63552a None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:16:29.480601 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-aafc2a48-1204-4d69-9004-bd149f40669b None None] MFA Rules not processed for user `d3b951324c7c437cbc27272da7454502`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:16:29.482226 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-aafc2a48-1204-4d69-9004-bd149f40669b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:16:29.483592 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-38a47a73-a313-4cd5-9527-1e7ebd63552a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:16:29.544044 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:16:29.619358 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 939/1882] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:16:29 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:16:29.623961 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafc2a48-1204-4d69-9004-bd149f40669b None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:29.626464 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-aafc2a48-1204-4d69-9004-bd149f40669b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:16:29.631600 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 944/1883] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:16:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:16:29.645816 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a47a73-a313-4cd5-9527-1e7ebd63552a None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:29.647487 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-38a47a73-a313-4cd5-9527-1e7ebd63552a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:16:29.688865 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafc2a48-1204-4d69-9004-bd149f40669b None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:29.706146 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac6bba4-17b5-4440-a308-c4dc50d12ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:29.707330 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac6bba4-17b5-4440-a308-c4dc50d12ac8 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:29.707846 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac6bba4-17b5-4440-a308-c4dc50d12ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:29.708230 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac6bba4-17b5-4440-a308-c4dc50d12ac8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:29.710358 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac6bba4-17b5-4440-a308-c4dc50d12ac8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:29.712801 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac6bba4-17b5-4440-a308-c4dc50d12ac8 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:29.735660 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:16:29.758102 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a47a73-a313-4cd5-9527-1e7ebd63552a None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:29.763508 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a2857c-82a0-4e05-93a9-89e313beec2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe93d4c0737249fd8623bb5ce188e34e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:29.764557 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a2857c-82a0-4e05-93a9-89e313beec2d service neutron] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:29.764907 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a2857c-82a0-4e05-93a9-89e313beec2d service neutron] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:29.765287 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a2857c-82a0-4e05-93a9-89e313beec2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:29.786470 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 940/1884] 10.222.0.43 () {60 vars in 1152 bytes} [Wed Jun 22 10:16:29 2022] POST /identity/v3/projects => generated 405 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 10:16:29.786682 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a2857c-82a0-4e05-93a9-89e313beec2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:29.786682 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a2857c-82a0-4e05-93a9-89e313beec2d service neutron] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:29.787714 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac6bba4-17b5-4440-a308-c4dc50d12ac8 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:29.802766 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 945/1885] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:16:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:16:29.870926 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac6bba4-17b5-4440-a308-c4dc50d12ac8 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:29.878166 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d76ea2-ffbc-4ae0-84d5-7654a7a664f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:29.878926 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d76ea2-ffbc-4ae0-84d5-7654a7a664f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:29.879230 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d76ea2-ffbc-4ae0-84d5-7654a7a664f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:29.880104 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d76ea2-ffbc-4ae0-84d5-7654a7a664f9 admin admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:29.880468 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d76ea2-ffbc-4ae0-84d5-7654a7a664f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:29.882659 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d76ea2-ffbc-4ae0-84d5-7654a7a664f9 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:29.919057 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 941/1886] 10.222.0.43 () {60 vars in 1143 bytes} [Wed Jun 22 10:16:29 2022] POST /identity/v3/users => generated 309 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:16:29.920478 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a2857c-82a0-4e05-93a9-89e313beec2d service neutron] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:29.930672 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a2857c-82a0-4e05-93a9-89e313beec2d service neutron] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:29.932715 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d76ea2-ffbc-4ae0-84d5-7654a7a664f9 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:29.934811 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-27d76ea2-ffbc-4ae0-84d5-7654a7a664f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:16:29.935633 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eae1826-0a08-4f75-bef7-a7ccd5248e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:29.936337 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eae1826-0a08-4f75-bef7-a7ccd5248e41 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:29.936665 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eae1826-0a08-4f75-bef7-a7ccd5248e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:29.936951 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eae1826-0a08-4f75-bef7-a7ccd5248e41 admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:29.937702 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eae1826-0a08-4f75-bef7-a7ccd5248e41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:29.939449 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eae1826-0a08-4f75-bef7-a7ccd5248e41 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:29.953154 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 946/1887] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:16:29 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:16:29.958261 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eae1826-0a08-4f75-bef7-a7ccd5248e41 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:29.961060 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d76ea2-ffbc-4ae0-84d5-7654a7a664f9 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:29.968731 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2fcbe7-ba23-4325-b555-ea14428abb3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:29.970322 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2fcbe7-ba23-4325-b555-ea14428abb3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:29.970927 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2fcbe7-ba23-4325-b555-ea14428abb3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:29.971418 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2fcbe7-ba23-4325-b555-ea14428abb3d admin admin] PATH_INFO: `/v3/projects/229c47823cdf45ad90ff20199035b847` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:29.973578 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2fcbe7-ba23-4325-b555-ea14428abb3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=229c47823cdf45ad90ff20199035b847)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:29.976833 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2fcbe7-ba23-4325-b555-ea14428abb3d admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:29.978352 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eae1826-0a08-4f75-bef7-a7ccd5248e41 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:29.994503 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85f5788-ff88-4de1-bd9a-9295167b33cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:29.996052 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85f5788-ff88-4de1-bd9a-9295167b33cb admin admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:29.996376 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85f5788-ff88-4de1-bd9a-9295167b33cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:29.996776 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85f5788-ff88-4de1-bd9a-9295167b33cb admin admin] PATH_INFO: `/v3/projects/50697233884d47208562353f0b6f9fb3/users/7b4e4214cc3446468531aff39d409f3e/roles/26d9c2ab5dfc4e6d9ca80c6014123906` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:30.034564 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85f5788-ff88-4de1-bd9a-9295167b33cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=50697233884d47208562353f0b6f9fb3, user_id=7b4e4214cc3446468531aff39d409f3e, role_id=26d9c2ab5dfc4e6d9ca80c6014123906)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:30.037340 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85f5788-ff88-4de1-bd9a-9295167b33cb admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:30.066255 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-1e2fcbe7-ba23-4325-b555-ea14428abb3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '229c47823cdf45ad90ff20199035b847', 'request_id': 'req-1e2fcbe7-ba23-4325-b555-ea14428abb3d'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:30.068689 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 947/1888] 10.222.0.43 () {60 vars in 1482 bytes} [Wed Jun 22 10:16:29 2022] PUT /identity/v3/projects/50697233884d47208562353f0b6f9fb3/users/7b4e4214cc3446468531aff39d409f3e/roles/26d9c2ab5dfc4e6d9ca80c6014123906 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:16:30.075434 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85f5788-ff88-4de1-bd9a-9295167b33cb admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:30.078400 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-1e2fcbe7-ba23-4325-b555-ea14428abb3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '229c47823cdf45ad90ff20199035b847', 'request_id': 'req-1e2fcbe7-ba23-4325-b555-ea14428abb3d'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:30.089449 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-1e2fcbe7-ba23-4325-b555-ea14428abb3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '229c47823cdf45ad90ff20199035b847', 'request_id': 'req-1e2fcbe7-ba23-4325-b555-ea14428abb3d'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:30.110422 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-1e2fcbe7-ba23-4325-b555-ea14428abb3d admin admin] The token cache is being invalidate because project 229c47823cdf45ad90ff20199035b847 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:16:30.111453 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-1e2fcbe7-ba23-4325-b555-ea14428abb3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:30.112467 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-1e2fcbe7-ba23-4325-b555-ea14428abb3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:30.114540 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 942/1889] 10.222.0.43 () {58 vars in 1232 bytes} [Wed Jun 22 10:16:29 2022] DELETE /identity/v3/projects/229c47823cdf45ad90ff20199035b847 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:16:30.119318 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a71690-838a-41a3-a074-8fe6ebad9497 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:30.119794 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a71690-838a-41a3-a074-8fe6ebad9497 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:30.120079 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a71690-838a-41a3-a074-8fe6ebad9497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:30.139853 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-71a71690-838a-41a3-a074-8fe6ebad9497 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:16:30.141072 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-71a71690-838a-41a3-a074-8fe6ebad9497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:16:30.160802 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85f5788-ff88-4de1-bd9a-9295167b33cb admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:30.165825 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c21fa7-86a6-469b-b074-e28d7882aaa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:30.166579 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c21fa7-86a6-469b-b074-e28d7882aaa4 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:30.166933 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c21fa7-86a6-469b-b074-e28d7882aaa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:30.167743 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c21fa7-86a6-469b-b074-e28d7882aaa4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:30.168098 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c21fa7-86a6-469b-b074-e28d7882aaa4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:30.170336 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c21fa7-86a6-469b-b074-e28d7882aaa4 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:30.185923 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 948/1890] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:16:30 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:16:30.189489 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c21fa7-86a6-469b-b074-e28d7882aaa4 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:30.191467 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-49c21fa7-86a6-469b-b074-e28d7882aaa4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:16:30.206501 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c21fa7-86a6-469b-b074-e28d7882aaa4 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:30.213170 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfe59ba-0e76-48e2-818f-768b09a8d96a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:30.214334 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfe59ba-0e76-48e2-818f-768b09a8d96a admin admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:30.214820 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfe59ba-0e76-48e2-818f-768b09a8d96a admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:30.215448 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfe59ba-0e76-48e2-818f-768b09a8d96a admin admin] PATH_INFO: `/v3/projects/50697233884d47208562353f0b6f9fb3/users/7b4e4214cc3446468531aff39d409f3e/roles/26d9c2ab5dfc4e6d9ca80c6014123906` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:30.215677 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 943/1891] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:16:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:16:30.217828 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfe59ba-0e76-48e2-818f-768b09a8d96a admin admin] RBAC: Authorizing `identity:create_grant(project_id=50697233884d47208562353f0b6f9fb3, user_id=7b4e4214cc3446468531aff39d409f3e, role_id=26d9c2ab5dfc4e6d9ca80c6014123906)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:30.221275 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfe59ba-0e76-48e2-818f-768b09a8d96a admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:30.223418 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed75e295-cdba-4e1f-b79a-44f0dfdbe9f6 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:30.223910 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed75e295-cdba-4e1f-b79a-44f0dfdbe9f6 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:30.224293 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed75e295-cdba-4e1f-b79a-44f0dfdbe9f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:30.232723 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 949/1892] 10.222.0.43 () {60 vars in 1482 bytes} [Wed Jun 22 10:16:30 2022] PUT /identity/v3/projects/50697233884d47208562353f0b6f9fb3/users/7b4e4214cc3446468531aff39d409f3e/roles/26d9c2ab5dfc4e6d9ca80c6014123906 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:16:30.250655 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-ed75e295-cdba-4e1f-b79a-44f0dfdbe9f6 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:16:30.252912 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-ed75e295-cdba-4e1f-b79a-44f0dfdbe9f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:16:30.259456 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:16:30.372379 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 944/1893] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:16:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:16:30.377471 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfe59ba-0e76-48e2-818f-768b09a8d96a admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:30.397113 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfe59ba-0e76-48e2-818f-768b09a8d96a admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:30.400951 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170ca2c3-d1f0-4ec5-80b1-11ccf47be512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:30.401941 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170ca2c3-d1f0-4ec5-80b1-11ccf47be512 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:30.402413 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170ca2c3-d1f0-4ec5-80b1-11ccf47be512 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:30.402931 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170ca2c3-d1f0-4ec5-80b1-11ccf47be512 admin admin] PATH_INFO: `/v3/domains` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:30.403962 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170ca2c3-d1f0-4ec5-80b1-11ccf47be512 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:16:30.404421 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170ca2c3-d1f0-4ec5-80b1-11ccf47be512 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:30.406798 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170ca2c3-d1f0-4ec5-80b1-11ccf47be512 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:30.425655 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 950/1894] 10.222.0.43 () {58 vars in 1152 bytes} [Wed Jun 22 10:16:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:16:30.430653 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed75e295-cdba-4e1f-b79a-44f0dfdbe9f6 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:30.442664 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed75e295-cdba-4e1f-b79a-44f0dfdbe9f6 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:30.452732 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170ca2c3-d1f0-4ec5-80b1-11ccf47be512 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:30.462608 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-170ca2c3-d1f0-4ec5-80b1-11ccf47be512 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:16:30.467007 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7141f9-8d1f-461b-9339-29390b7c3551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:30.468114 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7141f9-8d1f-461b-9339-29390b7c3551 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:30.468435 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7141f9-8d1f-461b-9339-29390b7c3551 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:30.468723 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7141f9-8d1f-461b-9339-29390b7c3551 admin admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:30.469486 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7141f9-8d1f-461b-9339-29390b7c3551 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:30.473683 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7141f9-8d1f-461b-9339-29390b7c3551 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:30.477907 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:16:30.487816 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170ca2c3-d1f0-4ec5-80b1-11ccf47be512 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:30.495978 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be084d18-3ee7-4a52-b477-22d13247d767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:30.500275 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be084d18-3ee7-4a52-b477-22d13247d767 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:30.500574 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be084d18-3ee7-4a52-b477-22d13247d767 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:30.500861 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be084d18-3ee7-4a52-b477-22d13247d767 admin admin] PATH_INFO: `/v3/projects/26dd426d226f4473b3b8d2fa78535ae4` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:30.503961 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be084d18-3ee7-4a52-b477-22d13247d767 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26dd426d226f4473b3b8d2fa78535ae4)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:30.511249 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be084d18-3ee7-4a52-b477-22d13247d767 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:30.553123 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 945/1895] 10.222.0.43 () {60 vars in 1152 bytes} [Wed Jun 22 10:16:30 2022] POST /identity/v3/projects => generated 359 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 10:16:30.558412 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7141f9-8d1f-461b-9339-29390b7c3551 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:30.638388 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-be084d18-3ee7-4a52-b477-22d13247d767 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26dd426d226f4473b3b8d2fa78535ae4', 'request_id': 'req-be084d18-3ee7-4a52-b477-22d13247d767'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:30.641081 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7141f9-8d1f-461b-9339-29390b7c3551 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:30.648521 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-be084d18-3ee7-4a52-b477-22d13247d767 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26dd426d226f4473b3b8d2fa78535ae4', 'request_id': 'req-be084d18-3ee7-4a52-b477-22d13247d767'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:30.675088 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-be084d18-3ee7-4a52-b477-22d13247d767 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26dd426d226f4473b3b8d2fa78535ae4', 'request_id': 'req-be084d18-3ee7-4a52-b477-22d13247d767'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:30.713744 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-be084d18-3ee7-4a52-b477-22d13247d767 admin admin] The token cache is being invalidate because project 26dd426d226f4473b3b8d2fa78535ae4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:16:30.714095 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-be084d18-3ee7-4a52-b477-22d13247d767 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:30.714919 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-be084d18-3ee7-4a52-b477-22d13247d767 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:30.717096 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 951/1896] 10.222.0.43 () {58 vars in 1232 bytes} [Wed Jun 22 10:16:30 2022] DELETE /identity/v3/projects/26dd426d226f4473b3b8d2fa78535ae4 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:16:30.774199 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c29d184-f37f-4141-9c16-2f7f3969f54a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:30.774915 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c29d184-f37f-4141-9c16-2f7f3969f54a admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:30.775223 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c29d184-f37f-4141-9c16-2f7f3969f54a admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:30.775478 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c29d184-f37f-4141-9c16-2f7f3969f54a admin admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:30.776266 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c29d184-f37f-4141-9c16-2f7f3969f54a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:30.778643 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c29d184-f37f-4141-9c16-2f7f3969f54a admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:30.814991 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be084d18-3ee7-4a52-b477-22d13247d767 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:30.815951 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 946/1897] 10.222.0.43 () {60 vars in 1143 bytes} [Wed Jun 22 10:16:30 2022] POST /identity/v3/users => generated 280 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:16:30.816692 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-be084d18-3ee7-4a52-b477-22d13247d767 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:16:30.831661 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be084d18-3ee7-4a52-b477-22d13247d767 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:30.840705 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425f0a3c-0cdf-4fe9-a3ab-32d664ee26f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:30.840705 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425f0a3c-0cdf-4fe9-a3ab-32d664ee26f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:30.840705 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425f0a3c-0cdf-4fe9-a3ab-32d664ee26f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:30.840705 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425f0a3c-0cdf-4fe9-a3ab-32d664ee26f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:30.841261 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425f0a3c-0cdf-4fe9-a3ab-32d664ee26f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:30.841261 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425f0a3c-0cdf-4fe9-a3ab-32d664ee26f2 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:30.857745 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c29d184-f37f-4141-9c16-2f7f3969f54a admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:30.865879 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 952/1898] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:16:30 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 10:16:30.870179 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c29d184-f37f-4141-9c16-2f7f3969f54a admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:30.882624 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6ef11d-8554-4094-86b6-05d7cce16c11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:30.883338 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6ef11d-8554-4094-86b6-05d7cce16c11 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:30.883628 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6ef11d-8554-4094-86b6-05d7cce16c11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:30.884134 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6ef11d-8554-4094-86b6-05d7cce16c11 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:30.884913 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6ef11d-8554-4094-86b6-05d7cce16c11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:30.890764 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6ef11d-8554-4094-86b6-05d7cce16c11 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:30.918065 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 947/1899] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:16:30 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:16:30.919187 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425f0a3c-0cdf-4fe9-a3ab-32d664ee26f2 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:30.930745 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425f0a3c-0cdf-4fe9-a3ab-32d664ee26f2 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:30.936993 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30463b60-c37f-4cb1-a858-578bfcd7066d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:30.938952 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30463b60-c37f-4cb1-a858-578bfcd7066d admin admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:30.939516 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30463b60-c37f-4cb1-a858-578bfcd7066d admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:30.940007 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30463b60-c37f-4cb1-a858-578bfcd7066d admin admin] PATH_INFO: `/v3/projects/7b4bdb4aae5c48d293c31ddde7c77fbd/users/4c157dd6aeea434887e16c7b6e6c92c8/roles/9f88c83743f745a9a785a2f454753f06` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:30.958107 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30463b60-c37f-4cb1-a858-578bfcd7066d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b4bdb4aae5c48d293c31ddde7c77fbd, user_id=4c157dd6aeea434887e16c7b6e6c92c8, role_id=9f88c83743f745a9a785a2f454753f06)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:30.960969 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30463b60-c37f-4cb1-a858-578bfcd7066d admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:30.979641 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 953/1900] 10.222.0.43 () {60 vars in 1482 bytes} [Wed Jun 22 10:16:30 2022] PUT /identity/v3/projects/7b4bdb4aae5c48d293c31ddde7c77fbd/users/4c157dd6aeea434887e16c7b6e6c92c8/roles/9f88c83743f745a9a785a2f454753f06 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:16:30.991067 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03dea73-27d8-4d59-a46c-088914d9a4d9 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:30.993076 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03dea73-27d8-4d59-a46c-088914d9a4d9 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:30.993811 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03dea73-27d8-4d59-a46c-088914d9a4d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:31.052202 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:16:31.056072 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-c03dea73-27d8-4d59-a46c-088914d9a4d9 None None] MFA Rules not processed for user `4c157dd6aeea434887e16c7b6e6c92c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:16:31.060069 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-c03dea73-27d8-4d59-a46c-088914d9a4d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:16:31.151388 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 948/1901] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:16:30 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:16:31.188859 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30463b60-c37f-4cb1-a858-578bfcd7066d admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:31.191205 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-30463b60-c37f-4cb1-a858-578bfcd7066d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:16:31.259813 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30463b60-c37f-4cb1-a858-578bfcd7066d admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:31.264832 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059345d1-26bf-44ff-9412-077938a07d98 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bbcb3d4dc704dfdb0097abc594ca855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:31.265584 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059345d1-26bf-44ff-9412-077938a07d98 service cinder] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:31.265997 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059345d1-26bf-44ff-9412-077938a07d98 service cinder] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:31.267152 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059345d1-26bf-44ff-9412-077938a07d98 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:31.281664 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059345d1-26bf-44ff-9412-077938a07d98 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:31.284915 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059345d1-26bf-44ff-9412-077938a07d98 service cinder] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:31.315200 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 954/1902] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:16:31 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:16:31.330313 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03dea73-27d8-4d59-a46c-088914d9a4d9 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:31.502624 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03dea73-27d8-4d59-a46c-088914d9a4d9 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:31.509407 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9661e5d-5fe7-4858-a267-6fdac827216f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:31.510676 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9661e5d-5fe7-4858-a267-6fdac827216f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:31.511222 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9661e5d-5fe7-4858-a267-6fdac827216f admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:31.512417 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9661e5d-5fe7-4858-a267-6fdac827216f admin admin] PATH_INFO: `/v3/users/4c157dd6aeea434887e16c7b6e6c92c8` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:31.515418 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9661e5d-5fe7-4858-a267-6fdac827216f admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c157dd6aeea434887e16c7b6e6c92c8)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:31.517916 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9661e5d-5fe7-4858-a267-6fdac827216f admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:31.589901 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-a9661e5d-5fe7-4858-a267-6fdac827216f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c157dd6aeea434887e16c7b6e6c92c8'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:31.605140 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-a9661e5d-5fe7-4858-a267-6fdac827216f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c157dd6aeea434887e16c7b6e6c92c8'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:31.615454 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-a9661e5d-5fe7-4858-a267-6fdac827216f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c157dd6aeea434887e16c7b6e6c92c8'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:31.616506 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-a9661e5d-5fe7-4858-a267-6fdac827216f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c157dd6aeea434887e16c7b6e6c92c8'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:31.627883 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-a9661e5d-5fe7-4858-a267-6fdac827216f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c157dd6aeea434887e16c7b6e6c92c8'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:31.634565 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 949/1903] 10.222.0.43 () {58 vars in 1223 bytes} [Wed Jun 22 10:16:31 2022] DELETE /identity/v3/users/4c157dd6aeea434887e16c7b6e6c92c8 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:16:31.638968 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84386ad-8284-4fab-aa10-53dde675f522 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:31.639822 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84386ad-8284-4fab-aa10-53dde675f522 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:31.639822 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84386ad-8284-4fab-aa10-53dde675f522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:31.659752 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-d84386ad-8284-4fab-aa10-53dde675f522 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:16:31.660997 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-d84386ad-8284-4fab-aa10-53dde675f522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:16:31.720632 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:16:31.761880 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 955/1904] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:16:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:16:31.767353 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9661e5d-5fe7-4858-a267-6fdac827216f admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:31.769333 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-a9661e5d-5fe7-4858-a267-6fdac827216f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:16:31.815600 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:16:31.859058 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55611882-9456-49b5-b849-2d436dc8d157 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:31.859350 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55611882-9456-49b5-b849-2d436dc8d157 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:31.859633 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55611882-9456-49b5-b849-2d436dc8d157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:31.935995 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9661e5d-5fe7-4858-a267-6fdac827216f admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:31.955374 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027fd442-84f5-4ac5-b91c-c5e86b8eb409 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe93d4c0737249fd8623bb5ce188e34e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:31.959427 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027fd442-84f5-4ac5-b91c-c5e86b8eb409 service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:31.959851 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027fd442-84f5-4ac5-b91c-c5e86b8eb409 service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:31.960078 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027fd442-84f5-4ac5-b91c-c5e86b8eb409 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:31.967387 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-55611882-9456-49b5-b849-2d436dc8d157 None None] MFA Rules not processed for user `7b4e4214cc3446468531aff39d409f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:16:31.968727 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-55611882-9456-49b5-b849-2d436dc8d157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:16:32.003199 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027fd442-84f5-4ac5-b91c-c5e86b8eb409 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:32.005186 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027fd442-84f5-4ac5-b91c-c5e86b8eb409 service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:32.031870 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 950/1905] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:16:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:16:32.162124 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 956/1906] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:16:31 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:16:32.674821 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027fd442-84f5-4ac5-b91c-c5e86b8eb409 service neutron] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:32.676724 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-027fd442-84f5-4ac5-b91c-c5e86b8eb409 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:16:32.701007 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027fd442-84f5-4ac5-b91c-c5e86b8eb409 service neutron] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:32.706368 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ca6e55-0dcf-452f-843a-74e4b3fce19c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:32.708031 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ca6e55-0dcf-452f-843a-74e4b3fce19c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:32.708031 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ca6e55-0dcf-452f-843a-74e4b3fce19c admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:32.708268 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ca6e55-0dcf-452f-843a-74e4b3fce19c admin admin] PATH_INFO: `/v3/projects/7b4bdb4aae5c48d293c31ddde7c77fbd` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:32.709625 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ca6e55-0dcf-452f-843a-74e4b3fce19c admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b4bdb4aae5c48d293c31ddde7c77fbd)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:32.711874 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ca6e55-0dcf-452f-843a-74e4b3fce19c admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:32.780966 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-80ca6e55-0dcf-452f-843a-74e4b3fce19c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b4bdb4aae5c48d293c31ddde7c77fbd', 'request_id': 'req-80ca6e55-0dcf-452f-843a-74e4b3fce19c'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:32.789908 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-80ca6e55-0dcf-452f-843a-74e4b3fce19c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b4bdb4aae5c48d293c31ddde7c77fbd', 'request_id': 'req-80ca6e55-0dcf-452f-843a-74e4b3fce19c'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:32.806664 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-80ca6e55-0dcf-452f-843a-74e4b3fce19c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b4bdb4aae5c48d293c31ddde7c77fbd', 'request_id': 'req-80ca6e55-0dcf-452f-843a-74e4b3fce19c'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:32.840856 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-80ca6e55-0dcf-452f-843a-74e4b3fce19c admin admin] The token cache is being invalidate because project 7b4bdb4aae5c48d293c31ddde7c77fbd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:16:32.841286 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-80ca6e55-0dcf-452f-843a-74e4b3fce19c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:32.842259 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-80ca6e55-0dcf-452f-843a-74e4b3fce19c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:32.845740 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 951/1907] 10.222.0.43 () {58 vars in 1232 bytes} [Wed Jun 22 10:16:32 2022] DELETE /identity/v3/projects/7b4bdb4aae5c48d293c31ddde7c77fbd => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:16:32.850101 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3309f820-45f1-4c7b-aa67-9ff681117962 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:32.850600 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3309f820-45f1-4c7b-aa67-9ff681117962 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:32.850942 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3309f820-45f1-4c7b-aa67-9ff681117962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:32.879302 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-3309f820-45f1-4c7b-aa67-9ff681117962 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:16:32.881661 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-3309f820-45f1-4c7b-aa67-9ff681117962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:16:32.989386 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 957/1908] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:16:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:16:32.996959 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7d92f6-0a9b-48d2-a67a-51881045fdfb None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:32.997726 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7d92f6-0a9b-48d2-a67a-51881045fdfb None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:32.997726 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7d92f6-0a9b-48d2-a67a-51881045fdfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:33.019370 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-aa7d92f6-0a9b-48d2-a67a-51881045fdfb None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:16:33.020970 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-aa7d92f6-0a9b-48d2-a67a-51881045fdfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:16:33.033161 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 952/1909] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:16:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:16:33.037062 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3309f820-45f1-4c7b-aa67-9ff681117962 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:33.048760 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3309f820-45f1-4c7b-aa67-9ff681117962 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:33.053879 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3b14e8-d071-4dad-a214-7d8e576268df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:33.055030 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3b14e8-d071-4dad-a214-7d8e576268df admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:33.055030 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3b14e8-d071-4dad-a214-7d8e576268df admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:33.055199 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3b14e8-d071-4dad-a214-7d8e576268df admin admin] PATH_INFO: `/v3/domains` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:33.056135 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3b14e8-d071-4dad-a214-7d8e576268df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:16:33.056511 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3b14e8-d071-4dad-a214-7d8e576268df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:33.059356 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3b14e8-d071-4dad-a214-7d8e576268df admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:33.072436 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 958/1910] 10.222.0.43 () {58 vars in 1152 bytes} [Wed Jun 22 10:16:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:16:33.076621 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7d92f6-0a9b-48d2-a67a-51881045fdfb None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:33.087205 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7d92f6-0a9b-48d2-a67a-51881045fdfb None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:33.108338 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21840e0-a1aa-42b5-91cf-d286f51bcae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:33.109033 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21840e0-a1aa-42b5-91cf-d286f51bcae6 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:33.109311 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21840e0-a1aa-42b5-91cf-d286f51bcae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:33.109596 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21840e0-a1aa-42b5-91cf-d286f51bcae6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:33.110932 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21840e0-a1aa-42b5-91cf-d286f51bcae6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:33.112996 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21840e0-a1aa-42b5-91cf-d286f51bcae6 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:33.147547 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 953/1911] 10.222.0.43 () {60 vars in 1152 bytes} [Wed Jun 22 10:16:33 2022] POST /identity/v3/projects => generated 377 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:16:33.149600 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3b14e8-d071-4dad-a214-7d8e576268df admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:33.160412 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3b14e8-d071-4dad-a214-7d8e576268df admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:33.246948 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a832ca67-02fa-4b33-8f8a-b4f47b693de9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:33.248117 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a832ca67-02fa-4b33-8f8a-b4f47b693de9 admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:33.248681 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a832ca67-02fa-4b33-8f8a-b4f47b693de9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:33.249069 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a832ca67-02fa-4b33-8f8a-b4f47b693de9 admin admin] PATH_INFO: `/v3/users` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:33.249907 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a832ca67-02fa-4b33-8f8a-b4f47b693de9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:33.252837 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a832ca67-02fa-4b33-8f8a-b4f47b693de9 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:33.273479 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:16:33.280465 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 959/1912] 10.222.0.43 () {60 vars in 1143 bytes} [Wed Jun 22 10:16:33 2022] POST /identity/v3/users => generated 289 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:16:33.285094 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21840e0-a1aa-42b5-91cf-d286f51bcae6 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:33.295994 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21840e0-a1aa-42b5-91cf-d286f51bcae6 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:33.301340 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33333ed7-1fb7-4748-9eef-3e0ec8d6ba47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:33.302147 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33333ed7-1fb7-4748-9eef-3e0ec8d6ba47 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:33.302507 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33333ed7-1fb7-4748-9eef-3e0ec8d6ba47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:33.302856 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33333ed7-1fb7-4748-9eef-3e0ec8d6ba47 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:33.303685 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33333ed7-1fb7-4748-9eef-3e0ec8d6ba47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:33.305367 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33333ed7-1fb7-4748-9eef-3e0ec8d6ba47 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:33.317468 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 954/1913] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:16:33 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 10:16:33.321612 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a832ca67-02fa-4b33-8f8a-b4f47b693de9 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:33.333010 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a832ca67-02fa-4b33-8f8a-b4f47b693de9 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:33.338076 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1799b04a-3826-4fda-a51b-4c4216b144da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:33.338752 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1799b04a-3826-4fda-a51b-4c4216b144da admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:33.339042 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1799b04a-3826-4fda-a51b-4c4216b144da admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:33.339323 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1799b04a-3826-4fda-a51b-4c4216b144da admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:33.340062 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1799b04a-3826-4fda-a51b-4c4216b144da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:33.341676 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1799b04a-3826-4fda-a51b-4c4216b144da admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:33.354526 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 960/1914] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:16:33 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:16:33.358986 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33333ed7-1fb7-4748-9eef-3e0ec8d6ba47 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:33.370378 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33333ed7-1fb7-4748-9eef-3e0ec8d6ba47 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:33.375389 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaf1d5f-4fc2-48da-b14b-f39ea01b1fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:33.377071 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaf1d5f-4fc2-48da-b14b-f39ea01b1fe5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:33.377381 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaf1d5f-4fc2-48da-b14b-f39ea01b1fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:33.377638 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaf1d5f-4fc2-48da-b14b-f39ea01b1fe5 admin admin] PATH_INFO: `/v3/projects/d6bb6cb824414629be06a38cead402ce/users/43ca51d86e6a46f4b1dc1687528a93f3/roles/9f88c83743f745a9a785a2f454753f06` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:33.397131 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beaf1d5f-4fc2-48da-b14b-f39ea01b1fe5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6bb6cb824414629be06a38cead402ce, user_id=43ca51d86e6a46f4b1dc1687528a93f3, role_id=9f88c83743f745a9a785a2f454753f06)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:33.399812 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beaf1d5f-4fc2-48da-b14b-f39ea01b1fe5 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:33.414814 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 955/1915] 10.222.0.43 () {60 vars in 1482 bytes} [Wed Jun 22 10:16:33 2022] PUT /identity/v3/projects/d6bb6cb824414629be06a38cead402ce/users/43ca51d86e6a46f4b1dc1687528a93f3/roles/9f88c83743f745a9a785a2f454753f06 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:16:33.428045 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7e10e9-94f3-4dbc-adf6-957901c24023 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:33.431251 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7e10e9-94f3-4dbc-adf6-957901c24023 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:33.431544 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7e10e9-94f3-4dbc-adf6-957901c24023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:33.446423 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44a793c-b3b4-4dcc-9d7c-8659ed3c4b04 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:33.446731 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44a793c-b3b4-4dcc-9d7c-8659ed3c4b04 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:33.447105 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44a793c-b3b4-4dcc-9d7c-8659ed3c4b04 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:33.448651 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 956/1916] 10.222.0.43 () {54 vars in 921 bytes} [Wed Jun 22 10:16:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:16:33.460508 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-8f7e10e9-94f3-4dbc-adf6-957901c24023 None None] MFA Rules not processed for user `43ca51d86e6a46f4b1dc1687528a93f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:16:33.461788 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-8f7e10e9-94f3-4dbc-adf6-957901c24023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:16:33.484260 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a04c80-5686-449f-aa2b-483c2ed8b6a6 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:33.484587 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a04c80-5686-449f-aa2b-483c2ed8b6a6 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:33.484835 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a04c80-5686-449f-aa2b-483c2ed8b6a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:33.510826 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-81a04c80-5686-449f-aa2b-483c2ed8b6a6 None None] MFA Rules not processed for user `341ec95408c94dae8539ccff7225e3ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:16:33.512054 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-81a04c80-5686-449f-aa2b-483c2ed8b6a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:16:33.582223 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 961/1917] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:16:33 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:16:33.593485 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7e10e9-94f3-4dbc-adf6-957901c24023 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:33.596323 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-8f7e10e9-94f3-4dbc-adf6-957901c24023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:16:33.601292 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:16:33.700149 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 957/1918] 10.222.0.43 () {58 vars in 1018 bytes} [Wed Jun 22 10:16:33 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:16:33.757425 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a04c80-5686-449f-aa2b-483c2ed8b6a6 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:33.759588 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-81a04c80-5686-449f-aa2b-483c2ed8b6a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:16:33.775083 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7e10e9-94f3-4dbc-adf6-957901c24023 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:33.781009 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bdd553-14a0-46b2-8fe5-831b2cbc88b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bbcb3d4dc704dfdb0097abc594ca855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:33.781841 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bdd553-14a0-46b2-8fe5-831b2cbc88b5 service cinder] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:33.782829 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bdd553-14a0-46b2-8fe5-831b2cbc88b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:33.783456 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bdd553-14a0-46b2-8fe5-831b2cbc88b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:33.787251 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a04c80-5686-449f-aa2b-483c2ed8b6a6 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:33.797193 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bdd553-14a0-46b2-8fe5-831b2cbc88b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:33.800130 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bdd553-14a0-46b2-8fe5-831b2cbc88b5 service cinder] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:33.807078 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8b6130-7c6a-4e4b-ab36-82c39cc44862 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '341ec95408c94dae8539ccff7225e3ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:33.807755 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8b6130-7c6a-4e4b-ab36-82c39cc44862 service placement] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:33.808040 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8b6130-7c6a-4e4b-ab36-82c39cc44862 service placement] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:33.808324 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8b6130-7c6a-4e4b-ab36-82c39cc44862 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:33.816663 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 962/1919] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:16:33 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:16:33.848870 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8b6130-7c6a-4e4b-ab36-82c39cc44862 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:33.850733 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8b6130-7c6a-4e4b-ab36-82c39cc44862 service placement] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:33.869797 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 958/1920] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:16:33 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:16:34.841707 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a180320b-c6d0-4e8b-a3f0-06d5aaf206fd None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:34.842247 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a180320b-c6d0-4e8b-a3f0-06d5aaf206fd None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:34.842341 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a180320b-c6d0-4e8b-a3f0-06d5aaf206fd None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:34.844212 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 963/1921] 10.222.0.43 () {54 vars in 921 bytes} [Wed Jun 22 10:16:34 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:16:34.863232 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ff78ef-5b27-4a70-a519-7e26207a5865 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:34.863700 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ff78ef-5b27-4a70-a519-7e26207a5865 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:34.864163 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ff78ef-5b27-4a70-a519-7e26207a5865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:34.895325 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-d8ff78ef-5b27-4a70-a519-7e26207a5865 None None] MFA Rules not processed for user `341ec95408c94dae8539ccff7225e3ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:16:34.896831 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-d8ff78ef-5b27-4a70-a519-7e26207a5865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:16:34.914496 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 959/1922] 10.222.0.43 () {58 vars in 1018 bytes} [Wed Jun 22 10:16:34 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:16:34.935988 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a180320b-c6d0-4e8b-a3f0-06d5aaf206fd None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:34.970491 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a180320b-c6d0-4e8b-a3f0-06d5aaf206fd None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:34.980507 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3bb275-8ef9-4fd6-b744-b07feb0fc9ce service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '341ec95408c94dae8539ccff7225e3ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:34.982629 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3bb275-8ef9-4fd6-b744-b07feb0fc9ce service placement] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:34.982921 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3bb275-8ef9-4fd6-b744-b07feb0fc9ce service placement] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:34.983203 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3bb275-8ef9-4fd6-b744-b07feb0fc9ce service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:34.995188 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3bb275-8ef9-4fd6-b744-b07feb0fc9ce service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:34.997723 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3bb275-8ef9-4fd6-b744-b07feb0fc9ce service placement] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:34.999297 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ff78ef-5b27-4a70-a519-7e26207a5865 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:35.000971 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-d8ff78ef-5b27-4a70-a519-7e26207a5865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:16:35.024920 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 964/1923] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:16:34 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 10:16:35.081569 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ff78ef-5b27-4a70-a519-7e26207a5865 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:35.087293 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe2f331-c04a-4552-ab06-a93cc3393ee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:35.088435 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe2f331-c04a-4552-ab06-a93cc3393ee9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:35.088921 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe2f331-c04a-4552-ab06-a93cc3393ee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:35.089398 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe2f331-c04a-4552-ab06-a93cc3393ee9 admin admin] PATH_INFO: `/v3/users/d3b951324c7c437cbc27272da7454502` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:35.090887 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe2f331-c04a-4552-ab06-a93cc3393ee9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3b951324c7c437cbc27272da7454502)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:35.093241 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe2f331-c04a-4552-ab06-a93cc3393ee9 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:35.180105 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-0fe2f331-c04a-4552-ab06-a93cc3393ee9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3b951324c7c437cbc27272da7454502'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:35.207628 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-0fe2f331-c04a-4552-ab06-a93cc3393ee9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3b951324c7c437cbc27272da7454502'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:35.227042 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-0fe2f331-c04a-4552-ab06-a93cc3393ee9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3b951324c7c437cbc27272da7454502'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:35.227884 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-0fe2f331-c04a-4552-ab06-a93cc3393ee9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3b951324c7c437cbc27272da7454502'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:35.247240 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-0fe2f331-c04a-4552-ab06-a93cc3393ee9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3b951324c7c437cbc27272da7454502'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:35.257529 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 960/1924] 10.222.0.43 () {58 vars in 1223 bytes} [Wed Jun 22 10:16:34 2022] DELETE /identity/v3/users/d3b951324c7c437cbc27272da7454502 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:16:35.939886 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3bb275-8ef9-4fd6-b744-b07feb0fc9ce service placement] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:35.953747 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3bb275-8ef9-4fd6-b744-b07feb0fc9ce service placement] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:36.049621 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fe19af-da02-45b0-a459-b1af59247987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:36.050524 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fe19af-da02-45b0-a459-b1af59247987 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:36.050841 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fe19af-da02-45b0-a459-b1af59247987 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:36.051121 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fe19af-da02-45b0-a459-b1af59247987 admin admin] PATH_INFO: `/v3/projects/58e0fb0a164241a5b29d13a059df08ac` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:36.052314 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fe19af-da02-45b0-a459-b1af59247987 admin admin] RBAC: Authorizing `identity:delete_project(project_id=58e0fb0a164241a5b29d13a059df08ac)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:36.054283 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fe19af-da02-45b0-a459-b1af59247987 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:36.062552 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:16:36.105478 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-e2fe19af-da02-45b0-a459-b1af59247987 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58e0fb0a164241a5b29d13a059df08ac', 'request_id': 'req-e2fe19af-da02-45b0-a459-b1af59247987'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:36.112211 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-e2fe19af-da02-45b0-a459-b1af59247987 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58e0fb0a164241a5b29d13a059df08ac', 'request_id': 'req-e2fe19af-da02-45b0-a459-b1af59247987'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:36.118206 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-e2fe19af-da02-45b0-a459-b1af59247987 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58e0fb0a164241a5b29d13a059df08ac', 'request_id': 'req-e2fe19af-da02-45b0-a459-b1af59247987'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:36.134077 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-e2fe19af-da02-45b0-a459-b1af59247987 admin admin] The token cache is being invalidate because project 58e0fb0a164241a5b29d13a059df08ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:16:36.134368 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-e2fe19af-da02-45b0-a459-b1af59247987 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:36.134992 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-e2fe19af-da02-45b0-a459-b1af59247987 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:36.136671 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 965/1925] 10.222.0.43 () {58 vars in 1232 bytes} [Wed Jun 22 10:16:35 2022] DELETE /identity/v3/projects/58e0fb0a164241a5b29d13a059df08ac => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:16:36.140635 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe2f331-c04a-4552-ab06-a93cc3393ee9 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:36.142285 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-0fe2f331-c04a-4552-ab06-a93cc3393ee9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:16:36.155297 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe2f331-c04a-4552-ab06-a93cc3393ee9 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:36.196738 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:16:36.216769 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9759601-789e-4577-accb-60bbe5c30112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:36.217662 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9759601-789e-4577-accb-60bbe5c30112 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:36.217976 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9759601-789e-4577-accb-60bbe5c30112 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:36.218260 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9759601-789e-4577-accb-60bbe5c30112 admin admin] PATH_INFO: `/v3/users/7b4e4214cc3446468531aff39d409f3e` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:36.220714 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9759601-789e-4577-accb-60bbe5c30112 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b4e4214cc3446468531aff39d409f3e)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:36.222428 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9759601-789e-4577-accb-60bbe5c30112 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:36.277326 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-a9759601-789e-4577-accb-60bbe5c30112 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b4e4214cc3446468531aff39d409f3e'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:36.292223 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-a9759601-789e-4577-accb-60bbe5c30112 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b4e4214cc3446468531aff39d409f3e'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:36.300961 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-a9759601-789e-4577-accb-60bbe5c30112 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b4e4214cc3446468531aff39d409f3e'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:36.301907 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-a9759601-789e-4577-accb-60bbe5c30112 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b4e4214cc3446468531aff39d409f3e'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:36.309928 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-a9759601-789e-4577-accb-60bbe5c30112 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b4e4214cc3446468531aff39d409f3e'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:36.316400 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 961/1926] 10.222.0.43 () {58 vars in 1223 bytes} [Wed Jun 22 10:16:36 2022] DELETE /identity/v3/users/7b4e4214cc3446468531aff39d409f3e => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:16:36.507296 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fe19af-da02-45b0-a459-b1af59247987 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:36.508908 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-e2fe19af-da02-45b0-a459-b1af59247987 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:16:36.529288 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fe19af-da02-45b0-a459-b1af59247987 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:36.627501 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1972a80f-8052-43dc-8a22-e06893faea3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:36.629751 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1972a80f-8052-43dc-8a22-e06893faea3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:36.629751 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1972a80f-8052-43dc-8a22-e06893faea3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:36.629751 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1972a80f-8052-43dc-8a22-e06893faea3e admin admin] PATH_INFO: `/v3/projects/50697233884d47208562353f0b6f9fb3` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:36.630217 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1972a80f-8052-43dc-8a22-e06893faea3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=50697233884d47208562353f0b6f9fb3)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:36.632541 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1972a80f-8052-43dc-8a22-e06893faea3e admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:36.700151 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-1972a80f-8052-43dc-8a22-e06893faea3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50697233884d47208562353f0b6f9fb3', 'request_id': 'req-1972a80f-8052-43dc-8a22-e06893faea3e'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:36.707083 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-1972a80f-8052-43dc-8a22-e06893faea3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50697233884d47208562353f0b6f9fb3', 'request_id': 'req-1972a80f-8052-43dc-8a22-e06893faea3e'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:36.713486 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-1972a80f-8052-43dc-8a22-e06893faea3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50697233884d47208562353f0b6f9fb3', 'request_id': 'req-1972a80f-8052-43dc-8a22-e06893faea3e'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:36.728528 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-1972a80f-8052-43dc-8a22-e06893faea3e admin admin] The token cache is being invalidate because project 50697233884d47208562353f0b6f9fb3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:16:36.728971 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-1972a80f-8052-43dc-8a22-e06893faea3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:36.729989 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-1972a80f-8052-43dc-8a22-e06893faea3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:36.731932 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 966/1927] 10.222.0.43 () {58 vars in 1232 bytes} [Wed Jun 22 10:16:36 2022] DELETE /identity/v3/projects/50697233884d47208562353f0b6f9fb3 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:16:36.737545 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58a535b-bdb6-4d16-b972-41600c534b80 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:36.738115 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58a535b-bdb6-4d16-b972-41600c534b80 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:36.738485 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58a535b-bdb6-4d16-b972-41600c534b80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:36.759217 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-d58a535b-bdb6-4d16-b972-41600c534b80 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:16:36.760498 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-d58a535b-bdb6-4d16-b972-41600c534b80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:16:36.825162 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 962/1928] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:16:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:16:36.833716 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9860755-6feb-41fe-8a1f-77616abc9055 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:36.834056 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9860755-6feb-41fe-8a1f-77616abc9055 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:36.834340 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9860755-6feb-41fe-8a1f-77616abc9055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:36.853082 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-f9860755-6feb-41fe-8a1f-77616abc9055 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:16:36.854585 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-f9860755-6feb-41fe-8a1f-77616abc9055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:16:36.863004 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 967/1929] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:16:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:16:36.867199 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58a535b-bdb6-4d16-b972-41600c534b80 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:36.880992 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58a535b-bdb6-4d16-b972-41600c534b80 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:36.886928 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e34ba3-331f-416e-a1c6-53bc552562ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:36.887598 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e34ba3-331f-416e-a1c6-53bc552562ac admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:36.887887 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e34ba3-331f-416e-a1c6-53bc552562ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:36.888169 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e34ba3-331f-416e-a1c6-53bc552562ac admin admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:36.888914 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e34ba3-331f-416e-a1c6-53bc552562ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:16:36.889226 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e34ba3-331f-416e-a1c6-53bc552562ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:36.890878 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e34ba3-331f-416e-a1c6-53bc552562ac admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:36.903942 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 963/1930] 10.222.0.43 () {58 vars in 1152 bytes} [Wed Jun 22 10:16:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:16:36.908403 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9860755-6feb-41fe-8a1f-77616abc9055 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:36.917775 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9860755-6feb-41fe-8a1f-77616abc9055 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:36.922423 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dd827a-d7e0-448b-aa4d-6b0748ed6a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:36.923151 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dd827a-d7e0-448b-aa4d-6b0748ed6a99 admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:36.923445 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dd827a-d7e0-448b-aa4d-6b0748ed6a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:36.923721 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dd827a-d7e0-448b-aa4d-6b0748ed6a99 admin admin] PATH_INFO: `/v3/projects` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:36.924414 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dd827a-d7e0-448b-aa4d-6b0748ed6a99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:36.926433 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dd827a-d7e0-448b-aa4d-6b0748ed6a99 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:36.946090 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:16:36.956584 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 968/1931] 10.222.0.43 () {60 vars in 1152 bytes} [Wed Jun 22 10:16:36 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:16:36.960109 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e34ba3-331f-416e-a1c6-53bc552562ac admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:36.972290 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e34ba3-331f-416e-a1c6-53bc552562ac admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:37.026868 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:16:37.051080 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eea693f-e59b-4635-801b-060c88d7b54d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:37.051903 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eea693f-e59b-4635-801b-060c88d7b54d admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:37.052297 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eea693f-e59b-4635-801b-060c88d7b54d admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:37.052705 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eea693f-e59b-4635-801b-060c88d7b54d admin admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:37.053526 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eea693f-e59b-4635-801b-060c88d7b54d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:37.056521 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eea693f-e59b-4635-801b-060c88d7b54d admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:37.085906 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 964/1932] 10.222.0.43 () {60 vars in 1143 bytes} [Wed Jun 22 10:16:36 2022] POST /identity/v3/users => generated 287 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:16:37.089951 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dd827a-d7e0-448b-aa4d-6b0748ed6a99 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:37.115893 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dd827a-d7e0-448b-aa4d-6b0748ed6a99 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:37.120555 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02de9243-d2f7-4ccf-9e15-bb7c0fa2db9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:37.121236 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02de9243-d2f7-4ccf-9e15-bb7c0fa2db9d admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:37.121521 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02de9243-d2f7-4ccf-9e15-bb7c0fa2db9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:37.121827 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02de9243-d2f7-4ccf-9e15-bb7c0fa2db9d admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:37.122562 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02de9243-d2f7-4ccf-9e15-bb7c0fa2db9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:37.124273 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02de9243-d2f7-4ccf-9e15-bb7c0fa2db9d admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:37.136543 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 969/1933] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:16:37 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:16:37.140172 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eea693f-e59b-4635-801b-060c88d7b54d admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:37.151571 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eea693f-e59b-4635-801b-060c88d7b54d admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:37.157032 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e071b78-9793-4faa-ba8f-be4b1b377b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:37.157930 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e071b78-9793-4faa-ba8f-be4b1b377b07 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:37.158258 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e071b78-9793-4faa-ba8f-be4b1b377b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:37.158633 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e071b78-9793-4faa-ba8f-be4b1b377b07 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:37.159572 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e071b78-9793-4faa-ba8f-be4b1b377b07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:37.161275 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e071b78-9793-4faa-ba8f-be4b1b377b07 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:37.176062 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 965/1934] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:16:37 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:16:37.177267 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02de9243-d2f7-4ccf-9e15-bb7c0fa2db9d admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:37.187302 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02de9243-d2f7-4ccf-9e15-bb7c0fa2db9d admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:37.192677 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0958da4-ee92-4f21-83a3-527fc1d3f5e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:37.193601 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0958da4-ee92-4f21-83a3-527fc1d3f5e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:37.193918 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0958da4-ee92-4f21-83a3-527fc1d3f5e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:37.194228 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0958da4-ee92-4f21-83a3-527fc1d3f5e4 admin admin] PATH_INFO: `/v3/projects/0de3b18b0f4b414da5a10ee0e3ffd9b0/users/5ae75662e9924df1b9376815043566a1/roles/9f88c83743f745a9a785a2f454753f06` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:37.210571 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0958da4-ee92-4f21-83a3-527fc1d3f5e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0de3b18b0f4b414da5a10ee0e3ffd9b0, user_id=5ae75662e9924df1b9376815043566a1, role_id=9f88c83743f745a9a785a2f454753f06)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:37.213302 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0958da4-ee92-4f21-83a3-527fc1d3f5e4 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:37.228356 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 970/1935] 10.222.0.43 () {60 vars in 1482 bytes} [Wed Jun 22 10:16:37 2022] PUT /identity/v3/projects/0de3b18b0f4b414da5a10ee0e3ffd9b0/users/5ae75662e9924df1b9376815043566a1/roles/9f88c83743f745a9a785a2f454753f06 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:16:37.241581 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b07913f-707e-4a84-8a0c-d871bb2c1e18 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:37.242023 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b07913f-707e-4a84-8a0c-d871bb2c1e18 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:37.242315 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b07913f-707e-4a84-8a0c-d871bb2c1e18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:37.271283 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-2b07913f-707e-4a84-8a0c-d871bb2c1e18 None None] MFA Rules not processed for user `5ae75662e9924df1b9376815043566a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:16:37.272559 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-2b07913f-707e-4a84-8a0c-d871bb2c1e18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:16:37.340314 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 966/1936] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:16:37 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:16:37.344720 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0958da4-ee92-4f21-83a3-527fc1d3f5e4 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:37.408817 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0958da4-ee92-4f21-83a3-527fc1d3f5e4 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:37.413442 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1037ebb-17ad-4da8-a397-c53d7ffd9db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:37.414151 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1037ebb-17ad-4da8-a397-c53d7ffd9db1 admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:37.414437 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1037ebb-17ad-4da8-a397-c53d7ffd9db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:37.414717 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1037ebb-17ad-4da8-a397-c53d7ffd9db1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:37.415407 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1037ebb-17ad-4da8-a397-c53d7ffd9db1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:37.417333 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1037ebb-17ad-4da8-a397-c53d7ffd9db1 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:37.450271 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 971/1937] 10.222.0.43 () {60 vars in 1152 bytes} [Wed Jun 22 10:16:37 2022] POST /identity/v3/projects => generated 371 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:16:37.454714 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b07913f-707e-4a84-8a0c-d871bb2c1e18 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:37.465641 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b07913f-707e-4a84-8a0c-d871bb2c1e18 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:37.526334 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6ba5af-8c8f-4a47-861f-e34810fba966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:37.527026 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6ba5af-8c8f-4a47-861f-e34810fba966 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:37.527313 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6ba5af-8c8f-4a47-861f-e34810fba966 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:37.527599 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6ba5af-8c8f-4a47-861f-e34810fba966 admin admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:37.528311 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6ba5af-8c8f-4a47-861f-e34810fba966 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:37.530352 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6ba5af-8c8f-4a47-861f-e34810fba966 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:37.554407 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 967/1938] 10.222.0.43 () {60 vars in 1143 bytes} [Wed Jun 22 10:16:37 2022] POST /identity/v3/users => generated 292 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:16:37.558444 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1037ebb-17ad-4da8-a397-c53d7ffd9db1 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:37.572194 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1037ebb-17ad-4da8-a397-c53d7ffd9db1 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:37.577663 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692cf350-129f-45c9-ab42-7d2a196439ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:37.578489 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692cf350-129f-45c9-ab42-7d2a196439ca admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:37.578627 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692cf350-129f-45c9-ab42-7d2a196439ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:37.579697 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692cf350-129f-45c9-ab42-7d2a196439ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:37.580439 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692cf350-129f-45c9-ab42-7d2a196439ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:37.582082 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692cf350-129f-45c9-ab42-7d2a196439ca admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:37.594970 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 972/1939] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:16:37 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:16:37.599064 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6ba5af-8c8f-4a47-861f-e34810fba966 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:37.609594 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6ba5af-8c8f-4a47-861f-e34810fba966 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:37.614941 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8058f1b-6e1b-41ce-8804-878cb7d7abcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:37.615976 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8058f1b-6e1b-41ce-8804-878cb7d7abcd admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:37.616366 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8058f1b-6e1b-41ce-8804-878cb7d7abcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:37.616782 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8058f1b-6e1b-41ce-8804-878cb7d7abcd admin admin] PATH_INFO: `/v3/projects/8e86aeb2d9e94f31a07d648692cfd87c/users/44f7bb6bf7424bb185a4ff1f67dcdc57/roles/26d9c2ab5dfc4e6d9ca80c6014123906` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:37.634238 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8058f1b-6e1b-41ce-8804-878cb7d7abcd admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e86aeb2d9e94f31a07d648692cfd87c, user_id=44f7bb6bf7424bb185a4ff1f67dcdc57, role_id=26d9c2ab5dfc4e6d9ca80c6014123906)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:37.637289 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8058f1b-6e1b-41ce-8804-878cb7d7abcd admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:37.655927 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 968/1940] 10.222.0.43 () {60 vars in 1482 bytes} [Wed Jun 22 10:16:37 2022] PUT /identity/v3/projects/8e86aeb2d9e94f31a07d648692cfd87c/users/44f7bb6bf7424bb185a4ff1f67dcdc57/roles/26d9c2ab5dfc4e6d9ca80c6014123906 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:16:37.658744 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692cf350-129f-45c9-ab42-7d2a196439ca admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:37.673628 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692cf350-129f-45c9-ab42-7d2a196439ca admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:37.749388 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5129f8-9da8-4493-954d-1121ecd25a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:37.750103 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5129f8-9da8-4493-954d-1121ecd25a1c admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:37.750383 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5129f8-9da8-4493-954d-1121ecd25a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:37.751292 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5129f8-9da8-4493-954d-1121ecd25a1c admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:37.752030 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5129f8-9da8-4493-954d-1121ecd25a1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:37.755231 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5129f8-9da8-4493-954d-1121ecd25a1c admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:37.770617 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 973/1941] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:16:37 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:16:37.771880 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8058f1b-6e1b-41ce-8804-878cb7d7abcd admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:37.795455 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8058f1b-6e1b-41ce-8804-878cb7d7abcd admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:37.811224 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f7b0d9-9587-473a-9c51-e7c37af5a71b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:37.812142 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f7b0d9-9587-473a-9c51-e7c37af5a71b admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:37.812428 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f7b0d9-9587-473a-9c51-e7c37af5a71b admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:37.812708 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f7b0d9-9587-473a-9c51-e7c37af5a71b admin admin] PATH_INFO: `/v3/projects/8e86aeb2d9e94f31a07d648692cfd87c/users/44f7bb6bf7424bb185a4ff1f67dcdc57/roles/26d9c2ab5dfc4e6d9ca80c6014123906` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:37.815725 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f7b0d9-9587-473a-9c51-e7c37af5a71b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e86aeb2d9e94f31a07d648692cfd87c, user_id=44f7bb6bf7424bb185a4ff1f67dcdc57, role_id=26d9c2ab5dfc4e6d9ca80c6014123906)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:37.818837 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f7b0d9-9587-473a-9c51-e7c37af5a71b admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:37.830534 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 969/1942] 10.222.0.43 () {60 vars in 1482 bytes} [Wed Jun 22 10:16:37 2022] PUT /identity/v3/projects/8e86aeb2d9e94f31a07d648692cfd87c/users/44f7bb6bf7424bb185a4ff1f67dcdc57/roles/26d9c2ab5dfc4e6d9ca80c6014123906 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:16:37.840819 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed34974-122c-4fac-8ca3-e89cbb74e919 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:37.841189 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed34974-122c-4fac-8ca3-e89cbb74e919 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:37.841483 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed34974-122c-4fac-8ca3-e89cbb74e919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:37.871775 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-aed34974-122c-4fac-8ca3-e89cbb74e919 None None] MFA Rules not processed for user `44f7bb6bf7424bb185a4ff1f67dcdc57`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:16:37.873331 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-aed34974-122c-4fac-8ca3-e89cbb74e919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:16:37.899656 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:16:37.959033 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 974/1943] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:16:37 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:16:37.970609 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f7b0d9-9587-473a-9c51-e7c37af5a71b admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:37.972346 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-e1f7b0d9-9587-473a-9c51-e7c37af5a71b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:16:37.983211 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:16:38.037006 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f7b0d9-9587-473a-9c51-e7c37af5a71b admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:38.040764 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38814a35-882b-41e8-ba83-83ed8e944b27 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bbcb3d4dc704dfdb0097abc594ca855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:38.041418 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38814a35-882b-41e8-ba83-83ed8e944b27 service cinder] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:38.041729 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38814a35-882b-41e8-ba83-83ed8e944b27 service cinder] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:38.042022 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38814a35-882b-41e8-ba83-83ed8e944b27 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:38.052611 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38814a35-882b-41e8-ba83-83ed8e944b27 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:38.054111 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38814a35-882b-41e8-ba83-83ed8e944b27 service cinder] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:38.064735 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 970/1944] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:16:37 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:16:38.154108 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed34974-122c-4fac-8ca3-e89cbb74e919 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:38.164730 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed34974-122c-4fac-8ca3-e89cbb74e919 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:38.168705 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed01ac8-08fd-495c-bc15-6140c43bb231 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bbcb3d4dc704dfdb0097abc594ca855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:38.169394 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed01ac8-08fd-495c-bc15-6140c43bb231 service cinder] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:38.169662 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed01ac8-08fd-495c-bc15-6140c43bb231 service cinder] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:38.170084 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed01ac8-08fd-495c-bc15-6140c43bb231 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:38.238875 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed01ac8-08fd-495c-bc15-6140c43bb231 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:38.241423 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed01ac8-08fd-495c-bc15-6140c43bb231 service cinder] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:38.259565 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 975/1945] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:16:38 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:16:48.059858 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=23 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:16:48.250228 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=47 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:16:58.278673 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38814a35-882b-41e8-ba83-83ed8e944b27 service cinder] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:58.280077 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-38814a35-882b-41e8-ba83-83ed8e944b27 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:16:58.359919 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38814a35-882b-41e8-ba83-83ed8e944b27 service cinder] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:58.365358 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0d4d50-3f9c-4a70-9f07-3813db5fabdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:58.366168 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0d4d50-3f9c-4a70-9f07-3813db5fabdc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:58.366460 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0d4d50-3f9c-4a70-9f07-3813db5fabdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:58.366741 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0d4d50-3f9c-4a70-9f07-3813db5fabdc admin admin] PATH_INFO: `/v3/users/43ca51d86e6a46f4b1dc1687528a93f3` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:58.367936 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0d4d50-3f9c-4a70-9f07-3813db5fabdc admin admin] RBAC: Authorizing `identity:delete_user(user_id=43ca51d86e6a46f4b1dc1687528a93f3)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:58.369929 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0d4d50-3f9c-4a70-9f07-3813db5fabdc admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:58.427071 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-0d0d4d50-3f9c-4a70-9f07-3813db5fabdc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43ca51d86e6a46f4b1dc1687528a93f3'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:58.442101 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-0d0d4d50-3f9c-4a70-9f07-3813db5fabdc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43ca51d86e6a46f4b1dc1687528a93f3'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:58.451636 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-0d0d4d50-3f9c-4a70-9f07-3813db5fabdc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43ca51d86e6a46f4b1dc1687528a93f3'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:58.452583 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-0d0d4d50-3f9c-4a70-9f07-3813db5fabdc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43ca51d86e6a46f4b1dc1687528a93f3'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:58.461652 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-0d0d4d50-3f9c-4a70-9f07-3813db5fabdc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43ca51d86e6a46f4b1dc1687528a93f3'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:58.468270 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 971/1946] 10.222.0.43 () {58 vars in 1223 bytes} [Wed Jun 22 10:16:58 2022] DELETE /identity/v3/users/43ca51d86e6a46f4b1dc1687528a93f3 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:16:58.472821 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eaf8a1-fa53-4943-856d-80e626275c17 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:58.473313 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eaf8a1-fa53-4943-856d-80e626275c17 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:58.473420 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eaf8a1-fa53-4943-856d-80e626275c17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:58.492139 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-27eaf8a1-fa53-4943-856d-80e626275c17 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:16:58.493344 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-27eaf8a1-fa53-4943-856d-80e626275c17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:16:58.553319 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 976/1947] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:16:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:16:58.563074 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0d4d50-3f9c-4a70-9f07-3813db5fabdc admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:58.564514 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-0d0d4d50-3f9c-4a70-9f07-3813db5fabdc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:16:58.623599 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0d4d50-3f9c-4a70-9f07-3813db5fabdc admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:58.627194 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b637c6f5-5dfc-42c5-adab-4493cd1d2d89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe93d4c0737249fd8623bb5ce188e34e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:58.627841 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b637c6f5-5dfc-42c5-adab-4493cd1d2d89 service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:58.628656 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b637c6f5-5dfc-42c5-adab-4493cd1d2d89 service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:58.629210 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b637c6f5-5dfc-42c5-adab-4493cd1d2d89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:58.637969 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b637c6f5-5dfc-42c5-adab-4493cd1d2d89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:58.639386 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b637c6f5-5dfc-42c5-adab-4493cd1d2d89 service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:58.649370 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 972/1948] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:16:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:16:58.923897 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27eaf8a1-fa53-4943-856d-80e626275c17 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:58.926689 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-27eaf8a1-fa53-4943-856d-80e626275c17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:16:58.938775 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27eaf8a1-fa53-4943-856d-80e626275c17 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:58.945040 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca72b18-bfbb-4fa9-b414-0b78da7940ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:58.946070 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca72b18-bfbb-4fa9-b414-0b78da7940ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:58.946390 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca72b18-bfbb-4fa9-b414-0b78da7940ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:58.946630 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca72b18-bfbb-4fa9-b414-0b78da7940ea admin admin] PATH_INFO: `/v3/projects/d6bb6cb824414629be06a38cead402ce` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:58.947976 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca72b18-bfbb-4fa9-b414-0b78da7940ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6bb6cb824414629be06a38cead402ce)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:58.950141 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca72b18-bfbb-4fa9-b414-0b78da7940ea admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:59.009111 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-6ca72b18-bfbb-4fa9-b414-0b78da7940ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6bb6cb824414629be06a38cead402ce', 'request_id': 'req-6ca72b18-bfbb-4fa9-b414-0b78da7940ea'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:59.015687 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-6ca72b18-bfbb-4fa9-b414-0b78da7940ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6bb6cb824414629be06a38cead402ce', 'request_id': 'req-6ca72b18-bfbb-4fa9-b414-0b78da7940ea'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:59.021669 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-6ca72b18-bfbb-4fa9-b414-0b78da7940ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6bb6cb824414629be06a38cead402ce', 'request_id': 'req-6ca72b18-bfbb-4fa9-b414-0b78da7940ea'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:59.035717 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-6ca72b18-bfbb-4fa9-b414-0b78da7940ea admin admin] The token cache is being invalidate because project d6bb6cb824414629be06a38cead402ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:16:59.036101 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-6ca72b18-bfbb-4fa9-b414-0b78da7940ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:59.036805 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-6ca72b18-bfbb-4fa9-b414-0b78da7940ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:16:59.038836 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 977/1949] 10.222.0.43 () {58 vars in 1232 bytes} [Wed Jun 22 10:16:58 2022] DELETE /identity/v3/projects/d6bb6cb824414629be06a38cead402ce => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:16:59.043768 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abc812a-062b-4fb4-9d69-1884543ef6ec None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:59.044068 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abc812a-062b-4fb4-9d69-1884543ef6ec None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:59.044351 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abc812a-062b-4fb4-9d69-1884543ef6ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:59.076392 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-6abc812a-062b-4fb4-9d69-1884543ef6ec None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:16:59.076392 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-6abc812a-062b-4fb4-9d69-1884543ef6ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:16:59.092346 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:16:59.140396 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 973/1950] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:16:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:16:59.148168 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6e2731-f813-410a-9d6e-68d998c9a877 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:59.148542 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6e2731-f813-410a-9d6e-68d998c9a877 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:59.148891 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6e2731-f813-410a-9d6e-68d998c9a877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:59.169936 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-0d6e2731-f813-410a-9d6e-68d998c9a877 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:16:59.171351 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-0d6e2731-f813-410a-9d6e-68d998c9a877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:16:59.180423 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 978/1951] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:16:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:16:59.184673 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abc812a-062b-4fb4-9d69-1884543ef6ec None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:59.194698 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abc812a-062b-4fb4-9d69-1884543ef6ec None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:59.201311 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d11408f-eca4-4a09-ab5a-5d87f5345bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:59.202024 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d11408f-eca4-4a09-ab5a-5d87f5345bd9 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:59.202416 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d11408f-eca4-4a09-ab5a-5d87f5345bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:59.202582 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d11408f-eca4-4a09-ab5a-5d87f5345bd9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:59.203327 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d11408f-eca4-4a09-ab5a-5d87f5345bd9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:16:59.203618 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d11408f-eca4-4a09-ab5a-5d87f5345bd9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:59.205210 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d11408f-eca4-4a09-ab5a-5d87f5345bd9 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:59.220922 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 974/1952] 10.222.0.43 () {58 vars in 1152 bytes} [Wed Jun 22 10:16:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:16:59.223290 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6e2731-f813-410a-9d6e-68d998c9a877 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:59.233196 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6e2731-f813-410a-9d6e-68d998c9a877 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:59.238688 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392a13ce-8859-4c3f-96a6-1c5618cd9eae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:59.239356 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392a13ce-8859-4c3f-96a6-1c5618cd9eae admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:59.239639 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392a13ce-8859-4c3f-96a6-1c5618cd9eae admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:59.239914 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392a13ce-8859-4c3f-96a6-1c5618cd9eae admin admin] PATH_INFO: `/v3/projects` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:59.240608 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392a13ce-8859-4c3f-96a6-1c5618cd9eae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:59.242559 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392a13ce-8859-4c3f-96a6-1c5618cd9eae admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:59.270747 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 979/1953] 10.222.0.43 () {60 vars in 1152 bytes} [Wed Jun 22 10:16:59 2022] POST /identity/v3/projects => generated 375 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:16:59.275772 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d11408f-eca4-4a09-ab5a-5d87f5345bd9 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:59.287778 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d11408f-eca4-4a09-ab5a-5d87f5345bd9 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:59.369589 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c79338-72aa-40b5-a7f3-7305703e8147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:59.370992 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c79338-72aa-40b5-a7f3-7305703e8147 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:59.371451 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c79338-72aa-40b5-a7f3-7305703e8147 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:59.371730 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c79338-72aa-40b5-a7f3-7305703e8147 admin admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:59.372504 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c79338-72aa-40b5-a7f3-7305703e8147 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:59.374825 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c79338-72aa-40b5-a7f3-7305703e8147 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:59.399110 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 975/1954] 10.222.0.43 () {60 vars in 1143 bytes} [Wed Jun 22 10:16:59 2022] POST /identity/v3/users => generated 288 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:16:59.403200 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392a13ce-8859-4c3f-96a6-1c5618cd9eae admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:59.414526 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392a13ce-8859-4c3f-96a6-1c5618cd9eae admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:59.420008 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14421370-b1a9-4606-bd40-3cdd8a5bcaae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:59.420686 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14421370-b1a9-4606-bd40-3cdd8a5bcaae admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:59.420976 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14421370-b1a9-4606-bd40-3cdd8a5bcaae admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:59.421258 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14421370-b1a9-4606-bd40-3cdd8a5bcaae admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:59.422058 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14421370-b1a9-4606-bd40-3cdd8a5bcaae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:59.423673 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14421370-b1a9-4606-bd40-3cdd8a5bcaae admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:59.434975 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 980/1955] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:16:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:16:59.438913 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c79338-72aa-40b5-a7f3-7305703e8147 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:59.449201 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c79338-72aa-40b5-a7f3-7305703e8147 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:59.454171 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a30418-9d00-4ade-a6ef-3d7c6fbc4ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:59.454867 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a30418-9d00-4ade-a6ef-3d7c6fbc4ac4 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:59.455202 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a30418-9d00-4ade-a6ef-3d7c6fbc4ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:59.455485 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a30418-9d00-4ade-a6ef-3d7c6fbc4ac4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:59.456297 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a30418-9d00-4ade-a6ef-3d7c6fbc4ac4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:59.458170 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a30418-9d00-4ade-a6ef-3d7c6fbc4ac4 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:59.468071 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 976/1956] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:16:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:16:59.472715 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14421370-b1a9-4606-bd40-3cdd8a5bcaae admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:59.483120 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14421370-b1a9-4606-bd40-3cdd8a5bcaae admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:59.488618 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a45f0e2-b01e-45ef-b10a-baa5edb6b9be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:59.489422 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a45f0e2-b01e-45ef-b10a-baa5edb6b9be admin admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:59.489756 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a45f0e2-b01e-45ef-b10a-baa5edb6b9be admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:59.490040 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a45f0e2-b01e-45ef-b10a-baa5edb6b9be admin admin] PATH_INFO: `/v3/projects/b97e48bc75b74b49aec21b8a8b2810d5/users/7b4ef2f1a6dd45ccaea982213e051ee8/roles/9f88c83743f745a9a785a2f454753f06` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:59.504457 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a45f0e2-b01e-45ef-b10a-baa5edb6b9be admin admin] RBAC: Authorizing `identity:create_grant(project_id=b97e48bc75b74b49aec21b8a8b2810d5, user_id=7b4ef2f1a6dd45ccaea982213e051ee8, role_id=9f88c83743f745a9a785a2f454753f06)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:59.508674 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a45f0e2-b01e-45ef-b10a-baa5edb6b9be admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:59.522356 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 981/1957] 10.222.0.43 () {60 vars in 1482 bytes} [Wed Jun 22 10:16:59 2022] PUT /identity/v3/projects/b97e48bc75b74b49aec21b8a8b2810d5/users/7b4ef2f1a6dd45ccaea982213e051ee8/roles/9f88c83743f745a9a785a2f454753f06 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:16:59.535367 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faafbd9-bbee-477d-a711-bb83c8daa096 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:59.535367 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faafbd9-bbee-477d-a711-bb83c8daa096 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:59.535367 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faafbd9-bbee-477d-a711-bb83c8daa096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:59.561899 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-4faafbd9-bbee-477d-a711-bb83c8daa096 None None] MFA Rules not processed for user `7b4ef2f1a6dd45ccaea982213e051ee8`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:16:59.563258 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-4faafbd9-bbee-477d-a711-bb83c8daa096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:16:59.635274 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 977/1958] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:16:59 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:16:59.645974 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a45f0e2-b01e-45ef-b10a-baa5edb6b9be admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:16:59.647777 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-6a45f0e2-b01e-45ef-b10a-baa5edb6b9be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:16:59.672987 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:16:59.713750 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a45f0e2-b01e-45ef-b10a-baa5edb6b9be admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:16:59.717463 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dce509-8e06-44d3-a86d-f06246eecdab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bbcb3d4dc704dfdb0097abc594ca855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:16:59.718159 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dce509-8e06-44d3-a86d-f06246eecdab service cinder] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:16:59.718499 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dce509-8e06-44d3-a86d-f06246eecdab service cinder] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:16:59.718736 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dce509-8e06-44d3-a86d-f06246eecdab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:16:59.727634 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dce509-8e06-44d3-a86d-f06246eecdab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:16:59.729327 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dce509-8e06-44d3-a86d-f06246eecdab service cinder] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:16:59.738889 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 982/1959] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:16:59 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:17:01.098610 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a02f38-4ef6-4dee-a48c-af00b5dfee84 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:01.099120 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a02f38-4ef6-4dee-a48c-af00b5dfee84 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:01.099665 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a02f38-4ef6-4dee-a48c-af00b5dfee84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:01.118706 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-e9a02f38-4ef6-4dee-a48c-af00b5dfee84 None None] MFA Rules not processed for user `7b4ef2f1a6dd45ccaea982213e051ee8`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:17:01.119925 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-e9a02f38-4ef6-4dee-a48c-af00b5dfee84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:17:01.126890 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 978/1960] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:17:01 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:17:03.704029 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dce509-8e06-44d3-a86d-f06246eecdab service cinder] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:17:03.707175 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-28dce509-8e06-44d3-a86d-f06246eecdab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:17:03.783728 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dce509-8e06-44d3-a86d-f06246eecdab service cinder] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:17:03.788499 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ba49ac-7ca1-4c98-85ca-a42463cf7124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:17:03.789444 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ba49ac-7ca1-4c98-85ca-a42463cf7124 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:03.790034 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ba49ac-7ca1-4c98-85ca-a42463cf7124 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:03.790034 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ba49ac-7ca1-4c98-85ca-a42463cf7124 admin admin] PATH_INFO: `/v3/users/2b3af9bfaaaa4dcca0747f776115c826` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:03.791407 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ba49ac-7ca1-4c98-85ca-a42463cf7124 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b3af9bfaaaa4dcca0747f776115c826)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:17:03.793469 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ba49ac-7ca1-4c98-85ca-a42463cf7124 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:17:03.850163 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-78ba49ac-7ca1-4c98-85ca-a42463cf7124 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b3af9bfaaaa4dcca0747f776115c826'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:17:03.864431 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-78ba49ac-7ca1-4c98-85ca-a42463cf7124 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b3af9bfaaaa4dcca0747f776115c826'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:17:03.872606 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-78ba49ac-7ca1-4c98-85ca-a42463cf7124 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b3af9bfaaaa4dcca0747f776115c826'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:17:03.883042 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-78ba49ac-7ca1-4c98-85ca-a42463cf7124 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b3af9bfaaaa4dcca0747f776115c826'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:17:03.884006 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-78ba49ac-7ca1-4c98-85ca-a42463cf7124 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b3af9bfaaaa4dcca0747f776115c826'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:17:03.890991 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 983/1961] 10.222.0.43 () {58 vars in 1223 bytes} [Wed Jun 22 10:17:03 2022] DELETE /identity/v3/users/2b3af9bfaaaa4dcca0747f776115c826 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:17:04.235354 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a02f38-4ef6-4dee-a48c-af00b5dfee84 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:17:04.246835 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a02f38-4ef6-4dee-a48c-af00b5dfee84 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:17:04.257004 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:17:04.329404 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57946054-a8a9-4ce7-8492-135d922f6431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:17:04.330492 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57946054-a8a9-4ce7-8492-135d922f6431 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:04.330929 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57946054-a8a9-4ce7-8492-135d922f6431 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:04.331794 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57946054-a8a9-4ce7-8492-135d922f6431 admin admin] PATH_INFO: `/v3/projects/d4765b82e21647a9b391a98f446a0e17` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:04.333751 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57946054-a8a9-4ce7-8492-135d922f6431 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4765b82e21647a9b391a98f446a0e17)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:17:04.336262 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57946054-a8a9-4ce7-8492-135d922f6431 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:17:04.407624 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-57946054-a8a9-4ce7-8492-135d922f6431 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4765b82e21647a9b391a98f446a0e17', 'request_id': 'req-57946054-a8a9-4ce7-8492-135d922f6431'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:17:04.415572 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-57946054-a8a9-4ce7-8492-135d922f6431 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4765b82e21647a9b391a98f446a0e17', 'request_id': 'req-57946054-a8a9-4ce7-8492-135d922f6431'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:17:04.428758 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-57946054-a8a9-4ce7-8492-135d922f6431 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4765b82e21647a9b391a98f446a0e17', 'request_id': 'req-57946054-a8a9-4ce7-8492-135d922f6431'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:17:04.442190 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-57946054-a8a9-4ce7-8492-135d922f6431 admin admin] The token cache is being invalidate because project d4765b82e21647a9b391a98f446a0e17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:17:04.442725 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-57946054-a8a9-4ce7-8492-135d922f6431 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:17:04.443859 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-57946054-a8a9-4ce7-8492-135d922f6431 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:17:04.445589 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 979/1962] 10.222.0.43 () {58 vars in 1232 bytes} [Wed Jun 22 10:17:04 2022] DELETE /identity/v3/projects/d4765b82e21647a9b391a98f446a0e17 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:17:04.450463 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f414c8ed-cf23-4dd4-8b37-f0e459dd6628 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:04.450757 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f414c8ed-cf23-4dd4-8b37-f0e459dd6628 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:04.451048 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f414c8ed-cf23-4dd4-8b37-f0e459dd6628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:04.472165 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-f414c8ed-cf23-4dd4-8b37-f0e459dd6628 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:17:04.474359 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-f414c8ed-cf23-4dd4-8b37-f0e459dd6628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:17:04.520189 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:17:04.547713 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 984/1963] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:17:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:17:04.556013 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f120bb7a-3a28-443c-a778-a08e80cb52e2 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:04.556400 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f120bb7a-3a28-443c-a778-a08e80cb52e2 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:04.556781 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f120bb7a-3a28-443c-a778-a08e80cb52e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:04.576930 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-f120bb7a-3a28-443c-a778-a08e80cb52e2 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:17:04.578920 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-f120bb7a-3a28-443c-a778-a08e80cb52e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:17:04.588414 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 980/1964] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:17:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:17:04.593008 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f414c8ed-cf23-4dd4-8b37-f0e459dd6628 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:17:04.606075 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f414c8ed-cf23-4dd4-8b37-f0e459dd6628 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:17:04.613588 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068f6f25-89fa-42ad-9ee8-190415f65ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:17:04.614346 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068f6f25-89fa-42ad-9ee8-190415f65ce4 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:04.614650 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068f6f25-89fa-42ad-9ee8-190415f65ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:04.614972 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068f6f25-89fa-42ad-9ee8-190415f65ce4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:04.616636 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068f6f25-89fa-42ad-9ee8-190415f65ce4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:17:04.617029 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068f6f25-89fa-42ad-9ee8-190415f65ce4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:17:04.618839 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068f6f25-89fa-42ad-9ee8-190415f65ce4 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:17:04.634562 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 985/1965] 10.222.0.43 () {58 vars in 1152 bytes} [Wed Jun 22 10:17:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:17:04.639141 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f120bb7a-3a28-443c-a778-a08e80cb52e2 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:17:04.650503 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f120bb7a-3a28-443c-a778-a08e80cb52e2 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:17:04.655259 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57cb295-bd79-47e5-ab89-7dd491266a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:17:04.655981 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57cb295-bd79-47e5-ab89-7dd491266a0d admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:04.656268 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57cb295-bd79-47e5-ab89-7dd491266a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:04.656548 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57cb295-bd79-47e5-ab89-7dd491266a0d admin admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:04.657250 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57cb295-bd79-47e5-ab89-7dd491266a0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:17:04.659269 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57cb295-bd79-47e5-ab89-7dd491266a0d admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:17:04.689335 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 981/1966] 10.222.0.43 () {60 vars in 1152 bytes} [Wed Jun 22 10:17:04 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 10:17:04.691104 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068f6f25-89fa-42ad-9ee8-190415f65ce4 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:17:04.700960 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068f6f25-89fa-42ad-9ee8-190415f65ce4 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:17:04.762867 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc9e9ab-22fe-4519-bce6-d8ed0cc62c1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:17:04.763629 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc9e9ab-22fe-4519-bce6-d8ed0cc62c1d admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:04.763910 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc9e9ab-22fe-4519-bce6-d8ed0cc62c1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:04.764227 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc9e9ab-22fe-4519-bce6-d8ed0cc62c1d admin admin] PATH_INFO: `/v3/users` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:04.765051 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc9e9ab-22fe-4519-bce6-d8ed0cc62c1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:17:04.767131 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc9e9ab-22fe-4519-bce6-d8ed0cc62c1d admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:17:04.788671 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 986/1967] 10.222.0.43 () {60 vars in 1143 bytes} [Wed Jun 22 10:17:04 2022] POST /identity/v3/users => generated 287 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:17:04.792727 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57cb295-bd79-47e5-ab89-7dd491266a0d admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:17:04.807668 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57cb295-bd79-47e5-ab89-7dd491266a0d admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:17:04.813370 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8e62b6-952e-48dc-ba85-3895749d462d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:17:04.814099 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8e62b6-952e-48dc-ba85-3895749d462d admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:04.814404 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8e62b6-952e-48dc-ba85-3895749d462d admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:04.815117 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8e62b6-952e-48dc-ba85-3895749d462d admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:04.817673 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8e62b6-952e-48dc-ba85-3895749d462d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:17:04.819312 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8e62b6-952e-48dc-ba85-3895749d462d admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:17:04.830624 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 982/1968] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:17:04 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:17:04.835382 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc9e9ab-22fe-4519-bce6-d8ed0cc62c1d admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:17:04.848042 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc9e9ab-22fe-4519-bce6-d8ed0cc62c1d admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:17:04.854593 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3445db2-f03a-487b-a0dc-6f7af9f29bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:17:04.855470 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3445db2-f03a-487b-a0dc-6f7af9f29bd8 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:04.856183 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3445db2-f03a-487b-a0dc-6f7af9f29bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:04.856563 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3445db2-f03a-487b-a0dc-6f7af9f29bd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:04.857414 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3445db2-f03a-487b-a0dc-6f7af9f29bd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:17:04.859234 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3445db2-f03a-487b-a0dc-6f7af9f29bd8 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:17:04.873796 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 987/1969] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:17:04 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:17:04.876812 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8e62b6-952e-48dc-ba85-3895749d462d admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:17:04.888706 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8e62b6-952e-48dc-ba85-3895749d462d admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:17:04.898820 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1438d9b-cf49-409c-87b5-d3b3d26a7efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:17:04.899770 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1438d9b-cf49-409c-87b5-d3b3d26a7efc admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:04.900014 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1438d9b-cf49-409c-87b5-d3b3d26a7efc admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:04.900293 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1438d9b-cf49-409c-87b5-d3b3d26a7efc admin admin] PATH_INFO: `/v3/projects/0d651176f9b74f8d9ac26d0004d73e08/users/9950cfb0f136480cacdf53f93d988bd8/roles/9f88c83743f745a9a785a2f454753f06` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:04.919722 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1438d9b-cf49-409c-87b5-d3b3d26a7efc admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d651176f9b74f8d9ac26d0004d73e08, user_id=9950cfb0f136480cacdf53f93d988bd8, role_id=9f88c83743f745a9a785a2f454753f06)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:17:04.922709 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1438d9b-cf49-409c-87b5-d3b3d26a7efc admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:17:04.939765 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 983/1970] 10.222.0.43 () {60 vars in 1482 bytes} [Wed Jun 22 10:17:04 2022] PUT /identity/v3/projects/0d651176f9b74f8d9ac26d0004d73e08/users/9950cfb0f136480cacdf53f93d988bd8/roles/9f88c83743f745a9a785a2f454753f06 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:17:04.950126 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60311a5-81cd-4b09-af4a-83b22226aff4 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:04.950421 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60311a5-81cd-4b09-af4a-83b22226aff4 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:04.950708 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60311a5-81cd-4b09-af4a-83b22226aff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:04.982540 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-a60311a5-81cd-4b09-af4a-83b22226aff4 None None] MFA Rules not processed for user `9950cfb0f136480cacdf53f93d988bd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:17:04.983571 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-a60311a5-81cd-4b09-af4a-83b22226aff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:17:05.069901 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 988/1971] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:17:04 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:17:05.083283 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1438d9b-cf49-409c-87b5-d3b3d26a7efc admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:17:05.086112 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-d1438d9b-cf49-409c-87b5-d3b3d26a7efc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:17:05.178030 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:17:05.217345 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1438d9b-cf49-409c-87b5-d3b3d26a7efc admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:17:05.224517 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38d288c-a0d1-4930-a7c8-87d4abbb7d75 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '158a49aa3750478a84bf71b9aad24397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:17:05.225897 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38d288c-a0d1-4930-a7c8-87d4abbb7d75 service nova] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:05.226277 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38d288c-a0d1-4930-a7c8-87d4abbb7d75 service nova] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:05.226648 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38d288c-a0d1-4930-a7c8-87d4abbb7d75 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:05.237900 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38d288c-a0d1-4930-a7c8-87d4abbb7d75 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:17:05.239788 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38d288c-a0d1-4930-a7c8-87d4abbb7d75 service nova] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:17:05.250423 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 984/1972] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:17:05 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:17:13.374709 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60311a5-81cd-4b09-af4a-83b22226aff4 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:17:13.427646 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:17:13.451000 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60311a5-81cd-4b09-af4a-83b22226aff4 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:17:13.455532 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd71434-00b2-46e0-b019-824ee67bc50b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:17:13.456990 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd71434-00b2-46e0-b019-824ee67bc50b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:13.457270 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd71434-00b2-46e0-b019-824ee67bc50b admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:13.457550 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd71434-00b2-46e0-b019-824ee67bc50b admin admin] PATH_INFO: `/v3/users/9950cfb0f136480cacdf53f93d988bd8` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:13.458789 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd71434-00b2-46e0-b019-824ee67bc50b admin admin] RBAC: Authorizing `identity:delete_user(user_id=9950cfb0f136480cacdf53f93d988bd8)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:17:13.460754 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd71434-00b2-46e0-b019-824ee67bc50b admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:17:13.508589 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-2cd71434-00b2-46e0-b019-824ee67bc50b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9950cfb0f136480cacdf53f93d988bd8'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:17:13.524207 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-2cd71434-00b2-46e0-b019-824ee67bc50b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9950cfb0f136480cacdf53f93d988bd8'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:17:13.531415 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-2cd71434-00b2-46e0-b019-824ee67bc50b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9950cfb0f136480cacdf53f93d988bd8'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:17:13.538961 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-2cd71434-00b2-46e0-b019-824ee67bc50b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9950cfb0f136480cacdf53f93d988bd8'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:17:13.539637 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-2cd71434-00b2-46e0-b019-824ee67bc50b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9950cfb0f136480cacdf53f93d988bd8'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:17:13.545577 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 989/1973] 10.222.0.43 () {58 vars in 1223 bytes} [Wed Jun 22 10:17:13 2022] DELETE /identity/v3/users/9950cfb0f136480cacdf53f93d988bd8 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:17:13.550470 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d29f9ba-3c1d-4262-b88e-e83c708a2122 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:13.550970 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d29f9ba-3c1d-4262-b88e-e83c708a2122 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:13.551086 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d29f9ba-3c1d-4262-b88e-e83c708a2122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:13.568861 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-4d29f9ba-3c1d-4262-b88e-e83c708a2122 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:17:13.570093 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-4d29f9ba-3c1d-4262-b88e-e83c708a2122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:17:13.628707 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 985/1974] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:17:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:17:13.638803 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd71434-00b2-46e0-b019-824ee67bc50b admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:17:13.640209 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-2cd71434-00b2-46e0-b019-824ee67bc50b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:17:13.698183 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd71434-00b2-46e0-b019-824ee67bc50b admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:17:13.701879 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65d86a7-60ac-4945-93e5-0e3e8b49219c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe93d4c0737249fd8623bb5ce188e34e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:17:13.702539 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65d86a7-60ac-4945-93e5-0e3e8b49219c service neutron] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:13.702820 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65d86a7-60ac-4945-93e5-0e3e8b49219c service neutron] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:13.703095 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65d86a7-60ac-4945-93e5-0e3e8b49219c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:13.712775 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65d86a7-60ac-4945-93e5-0e3e8b49219c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:17:13.714242 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65d86a7-60ac-4945-93e5-0e3e8b49219c service neutron] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:17:13.724179 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 990/1975] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:17:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:17:14.115579 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d29f9ba-3c1d-4262-b88e-e83c708a2122 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:17:14.117433 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-4d29f9ba-3c1d-4262-b88e-e83c708a2122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:17:14.134406 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d29f9ba-3c1d-4262-b88e-e83c708a2122 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:17:14.139812 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d8bb75-6aaf-4ab5-becc-1ed702bc261b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:17:14.141055 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d8bb75-6aaf-4ab5-becc-1ed702bc261b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:14.141407 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d8bb75-6aaf-4ab5-becc-1ed702bc261b admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:14.141793 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d8bb75-6aaf-4ab5-becc-1ed702bc261b admin admin] PATH_INFO: `/v3/projects/0d651176f9b74f8d9ac26d0004d73e08` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:14.143179 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d8bb75-6aaf-4ab5-becc-1ed702bc261b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d651176f9b74f8d9ac26d0004d73e08)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:17:14.146161 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d8bb75-6aaf-4ab5-becc-1ed702bc261b admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:17:14.202166 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-63d8bb75-6aaf-4ab5-becc-1ed702bc261b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d651176f9b74f8d9ac26d0004d73e08', 'request_id': 'req-63d8bb75-6aaf-4ab5-becc-1ed702bc261b'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:17:14.207847 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-63d8bb75-6aaf-4ab5-becc-1ed702bc261b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d651176f9b74f8d9ac26d0004d73e08', 'request_id': 'req-63d8bb75-6aaf-4ab5-becc-1ed702bc261b'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:17:14.216805 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-63d8bb75-6aaf-4ab5-becc-1ed702bc261b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d651176f9b74f8d9ac26d0004d73e08', 'request_id': 'req-63d8bb75-6aaf-4ab5-becc-1ed702bc261b'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:17:14.231502 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-63d8bb75-6aaf-4ab5-becc-1ed702bc261b admin admin] The token cache is being invalidate because project 0d651176f9b74f8d9ac26d0004d73e08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:17:14.231817 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-63d8bb75-6aaf-4ab5-becc-1ed702bc261b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:17:14.232495 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-63d8bb75-6aaf-4ab5-becc-1ed702bc261b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:17:14.234097 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 986/1976] 10.222.0.43 () {58 vars in 1232 bytes} [Wed Jun 22 10:17:14 2022] DELETE /identity/v3/projects/0d651176f9b74f8d9ac26d0004d73e08 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:17:14.239757 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae6eb80-64e4-4af9-936a-e730a4bee0b6 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:14.240070 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae6eb80-64e4-4af9-936a-e730a4bee0b6 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:14.240346 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae6eb80-64e4-4af9-936a-e730a4bee0b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:14.258352 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-5ae6eb80-64e4-4af9-936a-e730a4bee0b6 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:17:14.259558 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-5ae6eb80-64e4-4af9-936a-e730a4bee0b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:17:14.312230 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:17:14.323083 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 991/1977] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:17:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:17:14.332706 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afb61cd-c95c-4de8-8b87-8e72ec41eafb None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:14.333005 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afb61cd-c95c-4de8-8b87-8e72ec41eafb None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:14.333295 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afb61cd-c95c-4de8-8b87-8e72ec41eafb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:14.352406 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-6afb61cd-c95c-4de8-8b87-8e72ec41eafb None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:17:14.353599 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-6afb61cd-c95c-4de8-8b87-8e72ec41eafb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:17:14.362853 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 987/1978] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:17:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:17:14.367090 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae6eb80-64e4-4af9-936a-e730a4bee0b6 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:17:14.376914 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae6eb80-64e4-4af9-936a-e730a4bee0b6 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:17:14.384027 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4aa8fc0-f68f-45f0-afb7-fcf671189670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:17:14.384872 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aa8fc0-f68f-45f0-afb7-fcf671189670 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:14.385247 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aa8fc0-f68f-45f0-afb7-fcf671189670 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:14.385613 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aa8fc0-f68f-45f0-afb7-fcf671189670 admin admin] PATH_INFO: `/v3/domains` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:14.386521 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4aa8fc0-f68f-45f0-afb7-fcf671189670 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:17:14.387007 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4aa8fc0-f68f-45f0-afb7-fcf671189670 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:17:14.388676 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4aa8fc0-f68f-45f0-afb7-fcf671189670 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:17:14.401048 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 992/1979] 10.222.0.43 () {58 vars in 1152 bytes} [Wed Jun 22 10:17:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:17:14.405943 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afb61cd-c95c-4de8-8b87-8e72ec41eafb None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:17:14.417469 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afb61cd-c95c-4de8-8b87-8e72ec41eafb None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:17:14.422697 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87778d3a-147b-4709-bd1d-ff08c3653532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:17:14.423435 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87778d3a-147b-4709-bd1d-ff08c3653532 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:14.423728 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87778d3a-147b-4709-bd1d-ff08c3653532 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:14.425282 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87778d3a-147b-4709-bd1d-ff08c3653532 admin admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:14.425282 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87778d3a-147b-4709-bd1d-ff08c3653532 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:17:14.427531 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87778d3a-147b-4709-bd1d-ff08c3653532 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:17:14.458669 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 988/1980] 10.222.0.43 () {60 vars in 1152 bytes} [Wed Jun 22 10:17:14 2022] POST /identity/v3/projects => generated 377 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:17:14.459851 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4aa8fc0-f68f-45f0-afb7-fcf671189670 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:17:14.470321 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4aa8fc0-f68f-45f0-afb7-fcf671189670 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:17:14.528490 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf89055-6b6b-423a-a7fc-dd3796483cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:17:14.529196 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf89055-6b6b-423a-a7fc-dd3796483cab admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:14.529484 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf89055-6b6b-423a-a7fc-dd3796483cab admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:14.529797 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf89055-6b6b-423a-a7fc-dd3796483cab admin admin] PATH_INFO: `/v3/users` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:14.530502 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf89055-6b6b-423a-a7fc-dd3796483cab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:17:14.532439 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf89055-6b6b-423a-a7fc-dd3796483cab admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:17:14.553105 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 993/1981] 10.222.0.43 () {60 vars in 1143 bytes} [Wed Jun 22 10:17:14 2022] POST /identity/v3/users => generated 289 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:17:14.557296 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87778d3a-147b-4709-bd1d-ff08c3653532 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:17:14.567769 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87778d3a-147b-4709-bd1d-ff08c3653532 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:17:14.572520 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bf3d1b-ba00-4363-b944-f2b02feb907e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:17:14.573195 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bf3d1b-ba00-4363-b944-f2b02feb907e admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:14.573498 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bf3d1b-ba00-4363-b944-f2b02feb907e admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:14.573795 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bf3d1b-ba00-4363-b944-f2b02feb907e admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:14.574550 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bf3d1b-ba00-4363-b944-f2b02feb907e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:17:14.576202 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bf3d1b-ba00-4363-b944-f2b02feb907e admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:17:14.588038 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 989/1982] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:17:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:17:14.592289 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf89055-6b6b-423a-a7fc-dd3796483cab admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:17:14.602253 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf89055-6b6b-423a-a7fc-dd3796483cab admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:17:14.607852 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd33abb-500b-4b48-93e0-3f9c534a2905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:17:14.608505 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd33abb-500b-4b48-93e0-3f9c534a2905 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:14.608788 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd33abb-500b-4b48-93e0-3f9c534a2905 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:14.609064 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd33abb-500b-4b48-93e0-3f9c534a2905 admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:14.609819 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd33abb-500b-4b48-93e0-3f9c534a2905 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:17:14.611545 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd33abb-500b-4b48-93e0-3f9c534a2905 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:17:14.624280 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 994/1983] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:17:14 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:17:14.629042 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bf3d1b-ba00-4363-b944-f2b02feb907e admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:17:14.639236 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bf3d1b-ba00-4363-b944-f2b02feb907e admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:17:14.644143 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cb5957-5f49-4554-9a2a-2f907c08f78c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:17:14.645087 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cb5957-5f49-4554-9a2a-2f907c08f78c admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:14.645358 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cb5957-5f49-4554-9a2a-2f907c08f78c admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:14.645638 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cb5957-5f49-4554-9a2a-2f907c08f78c admin admin] PATH_INFO: `/v3/projects/b449c78f478c4f9197697009d40790df/users/3ccdba6fa3d34874aa2e16c6dc52b0c3/roles/9f88c83743f745a9a785a2f454753f06` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:14.648004 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:17:14.662815 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cb5957-5f49-4554-9a2a-2f907c08f78c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b449c78f478c4f9197697009d40790df, user_id=3ccdba6fa3d34874aa2e16c6dc52b0c3, role_id=9f88c83743f745a9a785a2f454753f06)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:17:14.665470 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cb5957-5f49-4554-9a2a-2f907c08f78c admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:17:14.679191 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 990/1984] 10.222.0.43 () {60 vars in 1482 bytes} [Wed Jun 22 10:17:14 2022] PUT /identity/v3/projects/b449c78f478c4f9197697009d40790df/users/3ccdba6fa3d34874aa2e16c6dc52b0c3/roles/9f88c83743f745a9a785a2f454753f06 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:17:14.690172 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68f7a25-65b5-4504-8247-266faefc2d32 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:14.691520 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68f7a25-65b5-4504-8247-266faefc2d32 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:14.691520 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68f7a25-65b5-4504-8247-266faefc2d32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:14.719519 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-d68f7a25-65b5-4504-8247-266faefc2d32 None None] MFA Rules not processed for user `3ccdba6fa3d34874aa2e16c6dc52b0c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:17:14.720843 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-d68f7a25-65b5-4504-8247-266faefc2d32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:17:14.794649 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 995/1985] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:17:14 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:17:14.800673 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cb5957-5f49-4554-9a2a-2f907c08f78c admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:17:14.872007 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cb5957-5f49-4554-9a2a-2f907c08f78c admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:17:14.880429 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b1ccfb-ba81-4c59-8b3c-6df539da0ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:17:14.881378 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b1ccfb-ba81-4c59-8b3c-6df539da0ea2 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:14.882093 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b1ccfb-ba81-4c59-8b3c-6df539da0ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:14.882527 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b1ccfb-ba81-4c59-8b3c-6df539da0ea2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:14.883432 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b1ccfb-ba81-4c59-8b3c-6df539da0ea2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:17:14.885959 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b1ccfb-ba81-4c59-8b3c-6df539da0ea2 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:17:14.918098 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 991/1986] 10.222.0.43 () {60 vars in 1152 bytes} [Wed Jun 22 10:17:14 2022] POST /identity/v3/projects => generated 375 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 10:17:14.922192 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68f7a25-65b5-4504-8247-266faefc2d32 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:17:14.936562 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68f7a25-65b5-4504-8247-266faefc2d32 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:17:14.994301 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:17:15.004763 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cf1c7f-3311-43da-9877-c4978ef011ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:17:15.005348 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cf1c7f-3311-43da-9877-c4978ef011ea admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:15.005635 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cf1c7f-3311-43da-9877-c4978ef011ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:15.005951 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cf1c7f-3311-43da-9877-c4978ef011ea admin admin] PATH_INFO: `/v3/users` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:15.006665 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cf1c7f-3311-43da-9877-c4978ef011ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:17:15.008607 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cf1c7f-3311-43da-9877-c4978ef011ea admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:17:15.029262 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 996/1987] 10.222.0.43 () {60 vars in 1143 bytes} [Wed Jun 22 10:17:14 2022] POST /identity/v3/users => generated 294 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:17:15.034082 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b1ccfb-ba81-4c59-8b3c-6df539da0ea2 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:17:15.044750 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b1ccfb-ba81-4c59-8b3c-6df539da0ea2 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:17:15.049468 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ff9ef2-42e0-4cc0-be61-d04bdb021763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:17:15.050363 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ff9ef2-42e0-4cc0-be61-d04bdb021763 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:15.050733 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ff9ef2-42e0-4cc0-be61-d04bdb021763 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:15.051576 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ff9ef2-42e0-4cc0-be61-d04bdb021763 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:15.051752 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ff9ef2-42e0-4cc0-be61-d04bdb021763 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:17:15.053369 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ff9ef2-42e0-4cc0-be61-d04bdb021763 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:17:15.067353 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 992/1988] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:17:15 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:17:15.071810 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cf1c7f-3311-43da-9877-c4978ef011ea admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:17:15.084185 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cf1c7f-3311-43da-9877-c4978ef011ea admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:17:15.091510 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11318c82-5c7b-46fc-8454-3c9f150faa3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:17:15.092590 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11318c82-5c7b-46fc-8454-3c9f150faa3a admin admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:15.092980 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11318c82-5c7b-46fc-8454-3c9f150faa3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:15.093154 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11318c82-5c7b-46fc-8454-3c9f150faa3a admin admin] PATH_INFO: `/v3/projects/ce7015957dda4c61bb5fe32b0ebe3b4d/users/e64138e4dd9e4d889fa4029a5d4ee1cc/roles/26d9c2ab5dfc4e6d9ca80c6014123906` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:15.113484 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11318c82-5c7b-46fc-8454-3c9f150faa3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce7015957dda4c61bb5fe32b0ebe3b4d, user_id=e64138e4dd9e4d889fa4029a5d4ee1cc, role_id=26d9c2ab5dfc4e6d9ca80c6014123906)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:17:15.116389 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11318c82-5c7b-46fc-8454-3c9f150faa3a admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:17:15.130957 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 997/1989] 10.222.0.43 () {60 vars in 1482 bytes} [Wed Jun 22 10:17:15 2022] PUT /identity/v3/projects/ce7015957dda4c61bb5fe32b0ebe3b4d/users/e64138e4dd9e4d889fa4029a5d4ee1cc/roles/26d9c2ab5dfc4e6d9ca80c6014123906 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:17:15.135017 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ff9ef2-42e0-4cc0-be61-d04bdb021763 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:17:15.146319 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ff9ef2-42e0-4cc0-be61-d04bdb021763 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:17:15.204222 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670d1844-32f1-4f2e-a060-75d32831ab85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:17:15.204859 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670d1844-32f1-4f2e-a060-75d32831ab85 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:15.205144 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670d1844-32f1-4f2e-a060-75d32831ab85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:15.205425 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670d1844-32f1-4f2e-a060-75d32831ab85 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:15.207442 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670d1844-32f1-4f2e-a060-75d32831ab85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:17:15.208458 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670d1844-32f1-4f2e-a060-75d32831ab85 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:17:15.220115 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 993/1990] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:17:15 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:17:15.224831 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11318c82-5c7b-46fc-8454-3c9f150faa3a admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:17:15.236018 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11318c82-5c7b-46fc-8454-3c9f150faa3a admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:17:15.241853 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64a8677-9ab8-4abc-bb17-d1895960ee02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:17:15.242747 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64a8677-9ab8-4abc-bb17-d1895960ee02 admin admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:15.243028 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64a8677-9ab8-4abc-bb17-d1895960ee02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:15.243301 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64a8677-9ab8-4abc-bb17-d1895960ee02 admin admin] PATH_INFO: `/v3/projects/ce7015957dda4c61bb5fe32b0ebe3b4d/users/e64138e4dd9e4d889fa4029a5d4ee1cc/roles/26d9c2ab5dfc4e6d9ca80c6014123906` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:15.245273 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64a8677-9ab8-4abc-bb17-d1895960ee02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce7015957dda4c61bb5fe32b0ebe3b4d, user_id=e64138e4dd9e4d889fa4029a5d4ee1cc, role_id=26d9c2ab5dfc4e6d9ca80c6014123906)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:17:15.248157 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64a8677-9ab8-4abc-bb17-d1895960ee02 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:17:15.260073 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 998/1991] 10.222.0.43 () {60 vars in 1482 bytes} [Wed Jun 22 10:17:15 2022] PUT /identity/v3/projects/ce7015957dda4c61bb5fe32b0ebe3b4d/users/e64138e4dd9e4d889fa4029a5d4ee1cc/roles/26d9c2ab5dfc4e6d9ca80c6014123906 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:17:15.271928 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c22c98-96de-4f6c-a070-cd784ec51f54 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:15.272336 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c22c98-96de-4f6c-a070-cd784ec51f54 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:15.272794 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c22c98-96de-4f6c-a070-cd784ec51f54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:15.298910 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-54c22c98-96de-4f6c-a070-cd784ec51f54 None None] MFA Rules not processed for user `e64138e4dd9e4d889fa4029a5d4ee1cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:17:15.300626 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-54c22c98-96de-4f6c-a070-cd784ec51f54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:17:15.343645 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:17:15.372566 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 994/1992] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:17:15 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:17:15.384002 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64a8677-9ab8-4abc-bb17-d1895960ee02 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:17:15.385763 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-c64a8677-9ab8-4abc-bb17-d1895960ee02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:17:15.442813 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64a8677-9ab8-4abc-bb17-d1895960ee02 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:17:15.446451 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba3bbab-9f0a-4ba9-be9e-f6a639cf07e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bbcb3d4dc704dfdb0097abc594ca855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:17:15.447098 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba3bbab-9f0a-4ba9-be9e-f6a639cf07e6 service cinder] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:15.447383 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba3bbab-9f0a-4ba9-be9e-f6a639cf07e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:15.447663 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba3bbab-9f0a-4ba9-be9e-f6a639cf07e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:15.505932 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba3bbab-9f0a-4ba9-be9e-f6a639cf07e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:17:15.507441 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba3bbab-9f0a-4ba9-be9e-f6a639cf07e6 service cinder] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:17:15.516747 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 999/1993] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:17:15 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:17:21.176880 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c22c98-96de-4f6c-a070-cd784ec51f54 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:17:21.186401 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c22c98-96de-4f6c-a070-cd784ec51f54 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:17:21.190477 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23da0c5-33df-4250-b148-593d1cb7f91e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bbcb3d4dc704dfdb0097abc594ca855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:17:21.191179 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23da0c5-33df-4250-b148-593d1cb7f91e service cinder] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:21.191485 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23da0c5-33df-4250-b148-593d1cb7f91e service cinder] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:21.191763 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23da0c5-33df-4250-b148-593d1cb7f91e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:21.201916 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23da0c5-33df-4250-b148-593d1cb7f91e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:17:21.203339 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23da0c5-33df-4250-b148-593d1cb7f91e service cinder] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:17:21.212973 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 995/1994] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:17:21 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:17:25.512992 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=67,keystone:INSERT=5 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:17:29.885069 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba3bbab-9f0a-4ba9-be9e-f6a639cf07e6 service cinder] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:17:29.886517 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-9ba3bbab-9f0a-4ba9-be9e-f6a639cf07e6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:17:29.950717 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba3bbab-9f0a-4ba9-be9e-f6a639cf07e6 service cinder] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:17:29.955224 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583b1d16-bc8f-4857-8991-664b7fbb096d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:17:29.956341 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583b1d16-bc8f-4857-8991-664b7fbb096d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:29.956628 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583b1d16-bc8f-4857-8991-664b7fbb096d admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:29.956908 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583b1d16-bc8f-4857-8991-664b7fbb096d admin admin] PATH_INFO: `/v3/users/5ae75662e9924df1b9376815043566a1` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:29.958123 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583b1d16-bc8f-4857-8991-664b7fbb096d admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ae75662e9924df1b9376815043566a1)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:17:29.960044 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583b1d16-bc8f-4857-8991-664b7fbb096d admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:17:30.005894 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-583b1d16-bc8f-4857-8991-664b7fbb096d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ae75662e9924df1b9376815043566a1'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:17:30.018717 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-583b1d16-bc8f-4857-8991-664b7fbb096d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ae75662e9924df1b9376815043566a1'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:17:30.026888 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-583b1d16-bc8f-4857-8991-664b7fbb096d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ae75662e9924df1b9376815043566a1'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:17:30.034636 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-583b1d16-bc8f-4857-8991-664b7fbb096d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ae75662e9924df1b9376815043566a1'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:17:30.035324 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-583b1d16-bc8f-4857-8991-664b7fbb096d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ae75662e9924df1b9376815043566a1'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:17:30.041682 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1000/1995] 10.222.0.43 () {58 vars in 1223 bytes} [Wed Jun 22 10:17:29 2022] DELETE /identity/v3/users/5ae75662e9924df1b9376815043566a1 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:17:30.046191 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98de240-f0c3-49a6-8d3c-d74e6a21cca9 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:30.046645 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98de240-f0c3-49a6-8d3c-d74e6a21cca9 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:30.046735 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98de240-f0c3-49a6-8d3c-d74e6a21cca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:30.064491 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-c98de240-f0c3-49a6-8d3c-d74e6a21cca9 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:17:30.065981 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-c98de240-f0c3-49a6-8d3c-d74e6a21cca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:17:30.125869 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 996/1996] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:17:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:17:30.135501 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583b1d16-bc8f-4857-8991-664b7fbb096d admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:17:30.136884 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-583b1d16-bc8f-4857-8991-664b7fbb096d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:17:30.193491 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583b1d16-bc8f-4857-8991-664b7fbb096d admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:17:30.197386 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ffeef9-863a-4a84-81d7-1973360d952a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe93d4c0737249fd8623bb5ce188e34e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:17:30.198070 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ffeef9-863a-4a84-81d7-1973360d952a service neutron] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:30.198359 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ffeef9-863a-4a84-81d7-1973360d952a service neutron] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:30.198637 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ffeef9-863a-4a84-81d7-1973360d952a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:30.207758 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ffeef9-863a-4a84-81d7-1973360d952a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:17:30.209181 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ffeef9-863a-4a84-81d7-1973360d952a service neutron] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:17:30.218382 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1001/1997] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:17:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:17:30.508817 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98de240-f0c3-49a6-8d3c-d74e6a21cca9 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:17:30.510284 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-c98de240-f0c3-49a6-8d3c-d74e6a21cca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:17:30.522741 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98de240-f0c3-49a6-8d3c-d74e6a21cca9 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:17:30.527436 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6442594e-4ee3-428d-9e40-4ed98bd0d89a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:17:30.528308 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6442594e-4ee3-428d-9e40-4ed98bd0d89a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:30.528587 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6442594e-4ee3-428d-9e40-4ed98bd0d89a admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:30.528987 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6442594e-4ee3-428d-9e40-4ed98bd0d89a admin admin] PATH_INFO: `/v3/projects/0de3b18b0f4b414da5a10ee0e3ffd9b0` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:30.530205 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6442594e-4ee3-428d-9e40-4ed98bd0d89a admin admin] RBAC: Authorizing `identity:delete_project(project_id=0de3b18b0f4b414da5a10ee0e3ffd9b0)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:17:30.532102 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6442594e-4ee3-428d-9e40-4ed98bd0d89a admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:17:30.588812 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-6442594e-4ee3-428d-9e40-4ed98bd0d89a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0de3b18b0f4b414da5a10ee0e3ffd9b0', 'request_id': 'req-6442594e-4ee3-428d-9e40-4ed98bd0d89a'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:17:30.595192 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-6442594e-4ee3-428d-9e40-4ed98bd0d89a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0de3b18b0f4b414da5a10ee0e3ffd9b0', 'request_id': 'req-6442594e-4ee3-428d-9e40-4ed98bd0d89a'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:17:30.603201 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-6442594e-4ee3-428d-9e40-4ed98bd0d89a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0de3b18b0f4b414da5a10ee0e3ffd9b0', 'request_id': 'req-6442594e-4ee3-428d-9e40-4ed98bd0d89a'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:17:30.615054 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-6442594e-4ee3-428d-9e40-4ed98bd0d89a admin admin] The token cache is being invalidate because project 0de3b18b0f4b414da5a10ee0e3ffd9b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:17:30.615340 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-6442594e-4ee3-428d-9e40-4ed98bd0d89a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:17:30.615961 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-6442594e-4ee3-428d-9e40-4ed98bd0d89a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:17:30.617492 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 997/1998] 10.222.0.43 () {58 vars in 1232 bytes} [Wed Jun 22 10:17:30 2022] DELETE /identity/v3/projects/0de3b18b0f4b414da5a10ee0e3ffd9b0 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:17:30.621402 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ffeef9-863a-4a84-81d7-1973360d952a service neutron] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:17:30.631753 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ffeef9-863a-4a84-81d7-1973360d952a service neutron] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:17:30.650428 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:17:30.696253 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d197f1-b10d-49f2-b26c-1c337c2edacd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:17:30.697138 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d197f1-b10d-49f2-b26c-1c337c2edacd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:30.697427 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d197f1-b10d-49f2-b26c-1c337c2edacd admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:30.697732 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d197f1-b10d-49f2-b26c-1c337c2edacd admin admin] PATH_INFO: `/v3/users/44f7bb6bf7424bb185a4ff1f67dcdc57` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:30.699133 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d197f1-b10d-49f2-b26c-1c337c2edacd admin admin] RBAC: Authorizing `identity:delete_user(user_id=44f7bb6bf7424bb185a4ff1f67dcdc57)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:17:30.701054 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d197f1-b10d-49f2-b26c-1c337c2edacd admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:17:30.750312 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-73d197f1-b10d-49f2-b26c-1c337c2edacd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44f7bb6bf7424bb185a4ff1f67dcdc57'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:17:30.763182 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-73d197f1-b10d-49f2-b26c-1c337c2edacd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44f7bb6bf7424bb185a4ff1f67dcdc57'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:17:30.771979 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-73d197f1-b10d-49f2-b26c-1c337c2edacd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44f7bb6bf7424bb185a4ff1f67dcdc57'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:17:30.778929 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-73d197f1-b10d-49f2-b26c-1c337c2edacd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44f7bb6bf7424bb185a4ff1f67dcdc57'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:17:30.779562 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-73d197f1-b10d-49f2-b26c-1c337c2edacd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44f7bb6bf7424bb185a4ff1f67dcdc57'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:17:30.785404 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1002/1999] 10.222.0.43 () {58 vars in 1223 bytes} [Wed Jun 22 10:17:30 2022] DELETE /identity/v3/users/44f7bb6bf7424bb185a4ff1f67dcdc57 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:17:31.062123 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6442594e-4ee3-428d-9e40-4ed98bd0d89a admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:17:31.063657 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-6442594e-4ee3-428d-9e40-4ed98bd0d89a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:17:31.080156 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6442594e-4ee3-428d-9e40-4ed98bd0d89a admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:17:31.135208 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:17:31.149499 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d0751c-55a6-4683-b9a7-ef08592e1ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:17:31.150334 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d0751c-55a6-4683-b9a7-ef08592e1ebf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:31.150618 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d0751c-55a6-4683-b9a7-ef08592e1ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:31.150895 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d0751c-55a6-4683-b9a7-ef08592e1ebf admin admin] PATH_INFO: `/v3/projects/8e86aeb2d9e94f31a07d648692cfd87c` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:31.152065 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d0751c-55a6-4683-b9a7-ef08592e1ebf admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e86aeb2d9e94f31a07d648692cfd87c)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:17:31.154006 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d0751c-55a6-4683-b9a7-ef08592e1ebf admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:17:31.199072 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-d0d0751c-55a6-4683-b9a7-ef08592e1ebf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e86aeb2d9e94f31a07d648692cfd87c', 'request_id': 'req-d0d0751c-55a6-4683-b9a7-ef08592e1ebf'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:17:31.204785 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-d0d0751c-55a6-4683-b9a7-ef08592e1ebf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e86aeb2d9e94f31a07d648692cfd87c', 'request_id': 'req-d0d0751c-55a6-4683-b9a7-ef08592e1ebf'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:17:31.212130 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-d0d0751c-55a6-4683-b9a7-ef08592e1ebf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e86aeb2d9e94f31a07d648692cfd87c', 'request_id': 'req-d0d0751c-55a6-4683-b9a7-ef08592e1ebf'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:17:31.223371 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-d0d0751c-55a6-4683-b9a7-ef08592e1ebf admin admin] The token cache is being invalidate because project 8e86aeb2d9e94f31a07d648692cfd87c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:17:31.223659 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-d0d0751c-55a6-4683-b9a7-ef08592e1ebf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:17:31.224281 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-d0d0751c-55a6-4683-b9a7-ef08592e1ebf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:17:31.225828 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 998/2000] 10.222.0.43 () {58 vars in 1232 bytes} [Wed Jun 22 10:17:31 2022] DELETE /identity/v3/projects/8e86aeb2d9e94f31a07d648692cfd87c => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:17:31.231079 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7e3cf3-40f9-4e78-b7b3-5836738d324b None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:31.231539 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7e3cf3-40f9-4e78-b7b3-5836738d324b None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:31.231631 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7e3cf3-40f9-4e78-b7b3-5836738d324b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:31.250149 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-ef7e3cf3-40f9-4e78-b7b3-5836738d324b None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:17:31.251336 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-ef7e3cf3-40f9-4e78-b7b3-5836738d324b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:17:31.309628 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1003/2001] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:17:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:17:31.319586 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d953ac-21ee-4dd9-b7f1-a0821cd4d0b9 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:31.319878 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d953ac-21ee-4dd9-b7f1-a0821cd4d0b9 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:31.320163 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d953ac-21ee-4dd9-b7f1-a0821cd4d0b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:31.339182 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-d8d953ac-21ee-4dd9-b7f1-a0821cd4d0b9 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:17:31.340399 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-d8d953ac-21ee-4dd9-b7f1-a0821cd4d0b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:17:31.364397 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 999/2002] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:17:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:17:31.365594 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7e3cf3-40f9-4e78-b7b3-5836738d324b None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:17:31.375655 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7e3cf3-40f9-4e78-b7b3-5836738d324b None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:17:31.382294 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547e8d0a-dc52-4b87-b7db-9e65dd7b2599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:17:31.382957 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547e8d0a-dc52-4b87-b7db-9e65dd7b2599 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:31.383242 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547e8d0a-dc52-4b87-b7db-9e65dd7b2599 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:31.383522 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547e8d0a-dc52-4b87-b7db-9e65dd7b2599 admin admin] PATH_INFO: `/v3/domains` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:31.384248 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547e8d0a-dc52-4b87-b7db-9e65dd7b2599 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:17:31.384553 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547e8d0a-dc52-4b87-b7db-9e65dd7b2599 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:17:31.386213 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547e8d0a-dc52-4b87-b7db-9e65dd7b2599 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:17:31.398401 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1004/2003] 10.222.0.43 () {58 vars in 1152 bytes} [Wed Jun 22 10:17:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:17:31.402859 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d953ac-21ee-4dd9-b7f1-a0821cd4d0b9 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:17:31.412763 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d953ac-21ee-4dd9-b7f1-a0821cd4d0b9 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:17:31.417419 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f74053d-7797-4eec-8751-8d406fda1ac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:17:31.418101 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f74053d-7797-4eec-8751-8d406fda1ac6 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:31.418391 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f74053d-7797-4eec-8751-8d406fda1ac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:31.418673 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f74053d-7797-4eec-8751-8d406fda1ac6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:31.419369 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f74053d-7797-4eec-8751-8d406fda1ac6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:17:31.421306 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f74053d-7797-4eec-8751-8d406fda1ac6 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:17:31.449294 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1000/2004] 10.222.0.43 () {60 vars in 1152 bytes} [Wed Jun 22 10:17:31 2022] POST /identity/v3/projects => generated 363 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:17:31.452070 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547e8d0a-dc52-4b87-b7db-9e65dd7b2599 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:17:31.462957 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547e8d0a-dc52-4b87-b7db-9e65dd7b2599 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:17:31.490328 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:17:31.522290 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dadea3-ca25-42d4-9fe0-0cf4ef57fcae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:17:31.522965 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dadea3-ca25-42d4-9fe0-0cf4ef57fcae admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:31.523254 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dadea3-ca25-42d4-9fe0-0cf4ef57fcae admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:31.523539 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dadea3-ca25-42d4-9fe0-0cf4ef57fcae admin admin] PATH_INFO: `/v3/users` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:31.524231 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dadea3-ca25-42d4-9fe0-0cf4ef57fcae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:17:31.526193 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dadea3-ca25-42d4-9fe0-0cf4ef57fcae admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:17:31.547528 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1005/2005] 10.222.0.43 () {60 vars in 1143 bytes} [Wed Jun 22 10:17:31 2022] POST /identity/v3/users => generated 282 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:17:31.552257 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f74053d-7797-4eec-8751-8d406fda1ac6 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:17:31.562346 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f74053d-7797-4eec-8751-8d406fda1ac6 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:17:31.567294 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c76644d-bad3-4363-90c6-512db5990b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:17:31.567955 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c76644d-bad3-4363-90c6-512db5990b33 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:31.568242 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c76644d-bad3-4363-90c6-512db5990b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:31.568520 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c76644d-bad3-4363-90c6-512db5990b33 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:31.569238 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c76644d-bad3-4363-90c6-512db5990b33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:17:31.570852 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c76644d-bad3-4363-90c6-512db5990b33 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:17:31.581134 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1001/2006] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:17:31 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:17:31.584899 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dadea3-ca25-42d4-9fe0-0cf4ef57fcae admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:17:31.594675 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dadea3-ca25-42d4-9fe0-0cf4ef57fcae admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:17:31.599921 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a797d4-5537-4c13-b290-fab5a6fc128c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:17:31.600577 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a797d4-5537-4c13-b290-fab5a6fc128c admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:31.600864 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a797d4-5537-4c13-b290-fab5a6fc128c admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:31.601144 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a797d4-5537-4c13-b290-fab5a6fc128c admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:31.602156 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a797d4-5537-4c13-b290-fab5a6fc128c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:17:31.603796 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a797d4-5537-4c13-b290-fab5a6fc128c admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:17:31.618039 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1006/2007] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:17:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:17:31.619243 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c76644d-bad3-4363-90c6-512db5990b33 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:17:31.629225 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c76644d-bad3-4363-90c6-512db5990b33 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:17:31.634153 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2327066-47d6-497f-806e-42c1fd5f75b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:17:31.635222 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2327066-47d6-497f-806e-42c1fd5f75b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:31.635507 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2327066-47d6-497f-806e-42c1fd5f75b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:31.635817 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2327066-47d6-497f-806e-42c1fd5f75b0 admin admin] PATH_INFO: `/v3/projects/adfcef6a2ab14b2da6a83c6a3978fe0b/users/9c4c3795b49047d4a7bed9197e7024b4/roles/9f88c83743f745a9a785a2f454753f06` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:31.651026 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2327066-47d6-497f-806e-42c1fd5f75b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=adfcef6a2ab14b2da6a83c6a3978fe0b, user_id=9c4c3795b49047d4a7bed9197e7024b4, role_id=9f88c83743f745a9a785a2f454753f06)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:17:31.653756 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2327066-47d6-497f-806e-42c1fd5f75b0 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:17:31.669025 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1002/2008] 10.222.0.43 () {60 vars in 1482 bytes} [Wed Jun 22 10:17:31 2022] PUT /identity/v3/projects/adfcef6a2ab14b2da6a83c6a3978fe0b/users/9c4c3795b49047d4a7bed9197e7024b4/roles/9f88c83743f745a9a785a2f454753f06 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:17:31.679787 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79259bf-aa0e-4461-a011-b5e612d1031d None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:31.680087 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79259bf-aa0e-4461-a011-b5e612d1031d None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:31.680372 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79259bf-aa0e-4461-a011-b5e612d1031d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:31.707250 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-c79259bf-aa0e-4461-a011-b5e612d1031d None None] MFA Rules not processed for user `9c4c3795b49047d4a7bed9197e7024b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:17:31.708463 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-c79259bf-aa0e-4461-a011-b5e612d1031d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:17:31.776694 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1007/2009] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:17:31 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:17:31.781237 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2327066-47d6-497f-806e-42c1fd5f75b0 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:17:31.843987 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2327066-47d6-497f-806e-42c1fd5f75b0 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:17:31.849525 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568d2a13-83f9-4fbd-9695-f6947e91942a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:17:31.850352 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568d2a13-83f9-4fbd-9695-f6947e91942a admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:31.850640 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568d2a13-83f9-4fbd-9695-f6947e91942a admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:31.850924 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568d2a13-83f9-4fbd-9695-f6947e91942a admin admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:31.851634 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568d2a13-83f9-4fbd-9695-f6947e91942a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:17:31.853616 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568d2a13-83f9-4fbd-9695-f6947e91942a admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:17:31.876851 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:17:31.886804 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1003/2010] 10.222.0.43 () {60 vars in 1152 bytes} [Wed Jun 22 10:17:31 2022] POST /identity/v3/projects => generated 361 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:17:31.890517 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79259bf-aa0e-4461-a011-b5e612d1031d None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:17:31.901158 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79259bf-aa0e-4461-a011-b5e612d1031d None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:17:31.957618 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d80999-e830-4210-9585-504bbc9e0545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:17:31.958315 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d80999-e830-4210-9585-504bbc9e0545 admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:31.958599 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d80999-e830-4210-9585-504bbc9e0545 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:31.958876 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d80999-e830-4210-9585-504bbc9e0545 admin admin] PATH_INFO: `/v3/users` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:31.959571 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d80999-e830-4210-9585-504bbc9e0545 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:17:31.961531 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d80999-e830-4210-9585-504bbc9e0545 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:17:31.982010 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1008/2011] 10.222.0.43 () {60 vars in 1143 bytes} [Wed Jun 22 10:17:31 2022] POST /identity/v3/users => generated 287 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:17:31.986168 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568d2a13-83f9-4fbd-9695-f6947e91942a admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:17:31.997597 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568d2a13-83f9-4fbd-9695-f6947e91942a admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:17:32.002926 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e977b9-3611-41eb-84b5-167d6c2c5143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:17:32.003566 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e977b9-3611-41eb-84b5-167d6c2c5143 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:32.003851 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e977b9-3611-41eb-84b5-167d6c2c5143 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:32.004128 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e977b9-3611-41eb-84b5-167d6c2c5143 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:32.004864 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e977b9-3611-41eb-84b5-167d6c2c5143 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:17:32.006503 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e977b9-3611-41eb-84b5-167d6c2c5143 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:17:32.017543 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1004/2012] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:17:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 10:17:32.022346 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d80999-e830-4210-9585-504bbc9e0545 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:17:32.032296 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d80999-e830-4210-9585-504bbc9e0545 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:17:32.037417 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecee2dfb-9ef8-49ab-b460-77deffca7864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:17:32.038333 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecee2dfb-9ef8-49ab-b460-77deffca7864 admin admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:32.038618 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecee2dfb-9ef8-49ab-b460-77deffca7864 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:32.038895 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecee2dfb-9ef8-49ab-b460-77deffca7864 admin admin] PATH_INFO: `/v3/projects/3b6c378b31664597bf348d60975e073e/users/f6d858e3aae6450cab51369ac7e6dfa7/roles/26d9c2ab5dfc4e6d9ca80c6014123906` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:32.054310 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecee2dfb-9ef8-49ab-b460-77deffca7864 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b6c378b31664597bf348d60975e073e, user_id=f6d858e3aae6450cab51369ac7e6dfa7, role_id=26d9c2ab5dfc4e6d9ca80c6014123906)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:17:32.057009 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecee2dfb-9ef8-49ab-b460-77deffca7864 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:17:32.072231 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1009/2013] 10.222.0.43 () {60 vars in 1482 bytes} [Wed Jun 22 10:17:32 2022] PUT /identity/v3/projects/3b6c378b31664597bf348d60975e073e/users/f6d858e3aae6450cab51369ac7e6dfa7/roles/26d9c2ab5dfc4e6d9ca80c6014123906 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:17:32.076274 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e977b9-3611-41eb-84b5-167d6c2c5143 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:17:32.086864 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e977b9-3611-41eb-84b5-167d6c2c5143 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:17:32.145798 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a26dc82-44c7-467f-ae94-46e557579da8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:17:32.146463 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a26dc82-44c7-467f-ae94-46e557579da8 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:32.146747 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a26dc82-44c7-467f-ae94-46e557579da8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:32.147025 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a26dc82-44c7-467f-ae94-46e557579da8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:32.147746 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a26dc82-44c7-467f-ae94-46e557579da8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:17:32.149346 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a26dc82-44c7-467f-ae94-46e557579da8 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:17:32.159208 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1005/2014] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:17:32 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:17:32.163363 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecee2dfb-9ef8-49ab-b460-77deffca7864 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:17:32.168936 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:17:32.175311 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecee2dfb-9ef8-49ab-b460-77deffca7864 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:17:32.180167 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb60ad2a-ccc1-411a-ad06-664994f65bf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:17:32.181052 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb60ad2a-ccc1-411a-ad06-664994f65bf7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:32.181340 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb60ad2a-ccc1-411a-ad06-664994f65bf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:32.181621 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb60ad2a-ccc1-411a-ad06-664994f65bf7 admin admin] PATH_INFO: `/v3/projects/3b6c378b31664597bf348d60975e073e/users/f6d858e3aae6450cab51369ac7e6dfa7/roles/26d9c2ab5dfc4e6d9ca80c6014123906` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:32.183597 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb60ad2a-ccc1-411a-ad06-664994f65bf7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b6c378b31664597bf348d60975e073e, user_id=f6d858e3aae6450cab51369ac7e6dfa7, role_id=26d9c2ab5dfc4e6d9ca80c6014123906)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:17:32.186402 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb60ad2a-ccc1-411a-ad06-664994f65bf7 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:17:32.198229 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1010/2015] 10.222.0.43 () {60 vars in 1482 bytes} [Wed Jun 22 10:17:32 2022] PUT /identity/v3/projects/3b6c378b31664597bf348d60975e073e/users/f6d858e3aae6450cab51369ac7e6dfa7/roles/26d9c2ab5dfc4e6d9ca80c6014123906 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:17:32.209233 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f0d049-29b4-4001-971b-80932a852f92 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:32.209464 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f0d049-29b4-4001-971b-80932a852f92 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:32.209805 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f0d049-29b4-4001-971b-80932a852f92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:32.235327 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-b0f0d049-29b4-4001-971b-80932a852f92 None None] MFA Rules not processed for user `f6d858e3aae6450cab51369ac7e6dfa7`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:17:32.236529 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-b0f0d049-29b4-4001-971b-80932a852f92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:17:32.303561 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1006/2016] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:17:32 2022] POST /identity/v3/auth/tokens => generated 3295 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:17:32.315086 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb60ad2a-ccc1-411a-ad06-664994f65bf7 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:17:32.317249 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-fb60ad2a-ccc1-411a-ad06-664994f65bf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:17:32.380085 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb60ad2a-ccc1-411a-ad06-664994f65bf7 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:17:32.384975 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98df723-5482-47dd-8541-4198a8449b8a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bbcb3d4dc704dfdb0097abc594ca855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:17:32.385722 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98df723-5482-47dd-8541-4198a8449b8a service cinder] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:32.386004 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98df723-5482-47dd-8541-4198a8449b8a service cinder] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:32.386289 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98df723-5482-47dd-8541-4198a8449b8a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:32.398168 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98df723-5482-47dd-8541-4198a8449b8a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:17:32.399622 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98df723-5482-47dd-8541-4198a8449b8a service cinder] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:17:32.409188 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1011/2017] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:17:32 2022] GET /identity/v3/auth/tokens => generated 3295 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:17:32.833943 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f0d049-29b4-4001-971b-80932a852f92 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:17:32.905515 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f0d049-29b4-4001-971b-80932a852f92 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:17:32.911814 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d07737-07d5-4971-986d-e86a0d7c0ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:17:32.912879 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d07737-07d5-4971-986d-e86a0d7c0ff1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:32.913276 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d07737-07d5-4971-986d-e86a0d7c0ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:32.913680 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d07737-07d5-4971-986d-e86a0d7c0ff1 admin admin] PATH_INFO: `/v3/users/9c4c3795b49047d4a7bed9197e7024b4` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:32.915420 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d07737-07d5-4971-986d-e86a0d7c0ff1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c4c3795b49047d4a7bed9197e7024b4)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:17:32.917713 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d07737-07d5-4971-986d-e86a0d7c0ff1 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:17:32.932200 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:17:32.974868 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-59d07737-07d5-4971-986d-e86a0d7c0ff1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c4c3795b49047d4a7bed9197e7024b4'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:17:32.989292 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-59d07737-07d5-4971-986d-e86a0d7c0ff1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c4c3795b49047d4a7bed9197e7024b4'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:17:32.997832 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-59d07737-07d5-4971-986d-e86a0d7c0ff1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c4c3795b49047d4a7bed9197e7024b4'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:17:32.998459 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-59d07737-07d5-4971-986d-e86a0d7c0ff1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c4c3795b49047d4a7bed9197e7024b4'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:17:33.005510 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-59d07737-07d5-4971-986d-e86a0d7c0ff1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c4c3795b49047d4a7bed9197e7024b4'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:17:33.011578 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1007/2018] 10.222.0.43 () {58 vars in 1223 bytes} [Wed Jun 22 10:17:32 2022] DELETE /identity/v3/users/9c4c3795b49047d4a7bed9197e7024b4 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:17:33.016446 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c98c678-40fa-4d2d-885d-414054964ff0 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:33.016746 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c98c678-40fa-4d2d-885d-414054964ff0 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:33.017028 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c98c678-40fa-4d2d-885d-414054964ff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:33.036634 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-5c98c678-40fa-4d2d-885d-414054964ff0 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:17:33.037866 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-5c98c678-40fa-4d2d-885d-414054964ff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:17:33.108583 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1012/2019] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:17:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:17:33.118934 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d07737-07d5-4971-986d-e86a0d7c0ff1 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:17:33.120474 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-59d07737-07d5-4971-986d-e86a0d7c0ff1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:17:33.190960 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d07737-07d5-4971-986d-e86a0d7c0ff1 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:17:33.194813 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d24ab71-31cb-4f25-8fde-19c15d831aaa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe93d4c0737249fd8623bb5ce188e34e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:17:33.195473 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d24ab71-31cb-4f25-8fde-19c15d831aaa service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:33.195760 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d24ab71-31cb-4f25-8fde-19c15d831aaa service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:33.196041 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d24ab71-31cb-4f25-8fde-19c15d831aaa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:33.207696 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d24ab71-31cb-4f25-8fde-19c15d831aaa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:17:33.209410 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d24ab71-31cb-4f25-8fde-19c15d831aaa service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:17:33.222122 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1008/2020] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:17:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:17:33.505078 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c98c678-40fa-4d2d-885d-414054964ff0 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:17:33.506587 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-5c98c678-40fa-4d2d-885d-414054964ff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:17:33.528156 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c98c678-40fa-4d2d-885d-414054964ff0 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:17:33.534646 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb01cb47-9d1a-49a9-9100-003f700edf29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:17:33.535519 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb01cb47-9d1a-49a9-9100-003f700edf29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:33.535782 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb01cb47-9d1a-49a9-9100-003f700edf29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:33.536200 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb01cb47-9d1a-49a9-9100-003f700edf29 admin admin] PATH_INFO: `/v3/projects/adfcef6a2ab14b2da6a83c6a3978fe0b` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:33.537515 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb01cb47-9d1a-49a9-9100-003f700edf29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=adfcef6a2ab14b2da6a83c6a3978fe0b)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:17:33.539627 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb01cb47-9d1a-49a9-9100-003f700edf29 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:17:33.591829 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-fb01cb47-9d1a-49a9-9100-003f700edf29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'adfcef6a2ab14b2da6a83c6a3978fe0b', 'request_id': 'req-fb01cb47-9d1a-49a9-9100-003f700edf29'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:17:33.598989 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-fb01cb47-9d1a-49a9-9100-003f700edf29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'adfcef6a2ab14b2da6a83c6a3978fe0b', 'request_id': 'req-fb01cb47-9d1a-49a9-9100-003f700edf29'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:17:33.604761 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-fb01cb47-9d1a-49a9-9100-003f700edf29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'adfcef6a2ab14b2da6a83c6a3978fe0b', 'request_id': 'req-fb01cb47-9d1a-49a9-9100-003f700edf29'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:17:33.617929 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-fb01cb47-9d1a-49a9-9100-003f700edf29 admin admin] The token cache is being invalidate because project adfcef6a2ab14b2da6a83c6a3978fe0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:17:33.618219 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-fb01cb47-9d1a-49a9-9100-003f700edf29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:17:33.618840 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-fb01cb47-9d1a-49a9-9100-003f700edf29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:17:33.620381 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1013/2021] 10.222.0.43 () {58 vars in 1232 bytes} [Wed Jun 22 10:17:33 2022] DELETE /identity/v3/projects/adfcef6a2ab14b2da6a83c6a3978fe0b => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:17:33.624476 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d24ab71-31cb-4f25-8fde-19c15d831aaa service neutron] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:17:33.634494 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d24ab71-31cb-4f25-8fde-19c15d831aaa service neutron] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:17:33.691240 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4097601e-457a-4240-9cb3-40bb51ed8589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:17:33.692111 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4097601e-457a-4240-9cb3-40bb51ed8589 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:33.692388 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4097601e-457a-4240-9cb3-40bb51ed8589 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:33.692660 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4097601e-457a-4240-9cb3-40bb51ed8589 admin admin] PATH_INFO: `/v3/users/f6d858e3aae6450cab51369ac7e6dfa7` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:33.694067 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4097601e-457a-4240-9cb3-40bb51ed8589 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6d858e3aae6450cab51369ac7e6dfa7)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:17:33.696326 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4097601e-457a-4240-9cb3-40bb51ed8589 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:17:33.732573 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:17:33.743764 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-4097601e-457a-4240-9cb3-40bb51ed8589 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6d858e3aae6450cab51369ac7e6dfa7'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:17:33.757248 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-4097601e-457a-4240-9cb3-40bb51ed8589 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6d858e3aae6450cab51369ac7e6dfa7'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:17:33.763979 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-4097601e-457a-4240-9cb3-40bb51ed8589 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6d858e3aae6450cab51369ac7e6dfa7'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:17:33.764735 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-4097601e-457a-4240-9cb3-40bb51ed8589 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6d858e3aae6450cab51369ac7e6dfa7'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:17:33.772516 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-4097601e-457a-4240-9cb3-40bb51ed8589 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6d858e3aae6450cab51369ac7e6dfa7'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:17:33.778545 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1009/2022] 10.222.0.43 () {58 vars in 1223 bytes} [Wed Jun 22 10:17:33 2022] DELETE /identity/v3/users/f6d858e3aae6450cab51369ac7e6dfa7 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:17:34.066968 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb01cb47-9d1a-49a9-9100-003f700edf29 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:17:34.069757 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-fb01cb47-9d1a-49a9-9100-003f700edf29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:17:34.127600 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb01cb47-9d1a-49a9-9100-003f700edf29 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:17:34.141715 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:17:34.176961 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40a2b9e-7dad-407a-8ef3-45a4a61cc46a None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:34.177474 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40a2b9e-7dad-407a-8ef3-45a4a61cc46a None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:34.177659 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40a2b9e-7dad-407a-8ef3-45a4a61cc46a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:34.200410 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-e40a2b9e-7dad-407a-8ef3-45a4a61cc46a None None] MFA Rules not processed for user `317e7e7dd5c741d49d34a1fd949a7c07`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:17:34.203043 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a91fa9d-1b60-4d16-8cf8-d8c49296dcb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:17:34.204002 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a91fa9d-1b60-4d16-8cf8-d8c49296dcb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:34.204152 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-e40a2b9e-7dad-407a-8ef3-45a4a61cc46a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:17:34.204515 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a91fa9d-1b60-4d16-8cf8-d8c49296dcb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:34.204895 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a91fa9d-1b60-4d16-8cf8-d8c49296dcb0 admin admin] PATH_INFO: `/v3/projects/3b6c378b31664597bf348d60975e073e` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:34.206880 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a91fa9d-1b60-4d16-8cf8-d8c49296dcb0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b6c378b31664597bf348d60975e073e)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:17:34.208870 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a91fa9d-1b60-4d16-8cf8-d8c49296dcb0 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:17:34.262504 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-4a91fa9d-1b60-4d16-8cf8-d8c49296dcb0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b6c378b31664597bf348d60975e073e', 'request_id': 'req-4a91fa9d-1b60-4d16-8cf8-d8c49296dcb0'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:17:34.269858 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-4a91fa9d-1b60-4d16-8cf8-d8c49296dcb0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b6c378b31664597bf348d60975e073e', 'request_id': 'req-4a91fa9d-1b60-4d16-8cf8-d8c49296dcb0'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:17:34.276338 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-4a91fa9d-1b60-4d16-8cf8-d8c49296dcb0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b6c378b31664597bf348d60975e073e', 'request_id': 'req-4a91fa9d-1b60-4d16-8cf8-d8c49296dcb0'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:17:34.276997 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1010/2023] 10.222.0.43 () {58 vars in 1009 bytes} [Wed Jun 22 10:17:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:17:34.295202 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-4a91fa9d-1b60-4d16-8cf8-d8c49296dcb0 admin admin] The token cache is being invalidate because project 3b6c378b31664597bf348d60975e073e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:17:34.295597 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-4a91fa9d-1b60-4d16-8cf8-d8c49296dcb0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:17:34.296654 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-4a91fa9d-1b60-4d16-8cf8-d8c49296dcb0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:17:34.298517 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1014/2024] 10.222.0.43 () {58 vars in 1232 bytes} [Wed Jun 22 10:17:34 2022] DELETE /identity/v3/projects/3b6c378b31664597bf348d60975e073e => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:17:34.303907 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01486f62-1907-456a-a0a6-fddbc431d83b None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:34.304074 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01486f62-1907-456a-a0a6-fddbc431d83b None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:34.304347 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01486f62-1907-456a-a0a6-fddbc431d83b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:34.327503 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a91fa9d-1b60-4d16-8cf8-d8c49296dcb0 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:17:34.328798 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-4a91fa9d-1b60-4d16-8cf8-d8c49296dcb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:17:34.331951 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-01486f62-1907-456a-a0a6-fddbc431d83b None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:17:34.333269 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-01486f62-1907-456a-a0a6-fddbc431d83b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:17:34.404754 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1011/2025] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:17:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:17:34.412717 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e567fc-177b-4c2c-b260-36af1026dca8 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:34.413133 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e567fc-177b-4c2c-b260-36af1026dca8 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:34.413494 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e567fc-177b-4c2c-b260-36af1026dca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:34.413625 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a91fa9d-1b60-4d16-8cf8-d8c49296dcb0 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:17:34.419950 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200f5223-4ebc-4a1a-8c7d-6a9d891480f8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9566f8cca2574f4cb5edcbf384f368a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:17:34.420611 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200f5223-4ebc-4a1a-8c7d-6a9d891480f8 service swift] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:34.420905 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200f5223-4ebc-4a1a-8c7d-6a9d891480f8 service swift] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:34.421186 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200f5223-4ebc-4a1a-8c7d-6a9d891480f8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:34.423043 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-200f5223-4ebc-4a1a-8c7d-6a9d891480f8 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:17:34.432818 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-c9e567fc-177b-4c2c-b260-36af1026dca8 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:17:34.434157 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-c9e567fc-177b-4c2c-b260-36af1026dca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:17:34.446525 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1012/2026] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:17:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:17:34.447643 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e567fc-177b-4c2c-b260-36af1026dca8 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:17:34.459835 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e567fc-177b-4c2c-b260-36af1026dca8 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:17:34.465087 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ae2307-cffa-47c2-b793-1831c424b30c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:17:34.465928 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ae2307-cffa-47c2-b793-1831c424b30c admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:34.466210 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ae2307-cffa-47c2-b793-1831c424b30c admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:34.466586 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ae2307-cffa-47c2-b793-1831c424b30c admin admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:34.467380 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ae2307-cffa-47c2-b793-1831c424b30c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:17:34.467754 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ae2307-cffa-47c2-b793-1831c424b30c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:17:34.469478 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ae2307-cffa-47c2-b793-1831c424b30c admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:17:34.478004 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:17:34.484829 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1013/2027] 10.222.0.43 () {58 vars in 1152 bytes} [Wed Jun 22 10:17:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:17:34.489744 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ae2307-cffa-47c2-b793-1831c424b30c admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:17:34.499454 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200f5223-4ebc-4a1a-8c7d-6a9d891480f8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:17:34.501257 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200f5223-4ebc-4a1a-8c7d-6a9d891480f8 service swift] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:17:34.506875 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ae2307-cffa-47c2-b793-1831c424b30c admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:17:34.511208 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1015/2028] 10.222.0.43 () {60 vars in 1384 bytes} [Wed Jun 22 10:17:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 22 10:17:34.515768 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f80412-5c16-4c0c-bf28-4677ad8d3681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:17:34.516438 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f80412-5c16-4c0c-bf28-4677ad8d3681 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:34.516739 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f80412-5c16-4c0c-bf28-4677ad8d3681 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:34.517023 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f80412-5c16-4c0c-bf28-4677ad8d3681 admin admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:34.517811 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f80412-5c16-4c0c-bf28-4677ad8d3681 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:17:34.520107 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f80412-5c16-4c0c-bf28-4677ad8d3681 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:17:34.553817 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1014/2029] 10.222.0.43 () {60 vars in 1152 bytes} [Wed Jun 22 10:17:34 2022] POST /identity/v3/projects => generated 369 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 10:17:34.558389 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200f5223-4ebc-4a1a-8c7d-6a9d891480f8 service swift] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:17:34.570474 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200f5223-4ebc-4a1a-8c7d-6a9d891480f8 service swift] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:17:34.690803 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf897ed-2e34-4acb-9d83-617074b49b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:17:34.692923 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf897ed-2e34-4acb-9d83-617074b49b86 admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:34.693419 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf897ed-2e34-4acb-9d83-617074b49b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:34.693887 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf897ed-2e34-4acb-9d83-617074b49b86 admin admin] PATH_INFO: `/v3/users` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:34.694784 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf897ed-2e34-4acb-9d83-617074b49b86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:17:34.696943 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf897ed-2e34-4acb-9d83-617074b49b86 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:17:34.733736 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1016/2030] 10.222.0.43 () {60 vars in 1143 bytes} [Wed Jun 22 10:17:34 2022] POST /identity/v3/users => generated 285 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:17:34.737170 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f80412-5c16-4c0c-bf28-4677ad8d3681 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:17:34.755729 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f80412-5c16-4c0c-bf28-4677ad8d3681 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:17:34.760884 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6fcafb-726d-4283-af06-2697a3fd4726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:17:34.761582 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6fcafb-726d-4283-af06-2697a3fd4726 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:34.761905 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6fcafb-726d-4283-af06-2697a3fd4726 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:34.762244 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6fcafb-726d-4283-af06-2697a3fd4726 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:34.762987 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6fcafb-726d-4283-af06-2697a3fd4726 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:17:34.764661 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6fcafb-726d-4283-af06-2697a3fd4726 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:17:34.777779 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1015/2031] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:17:34 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:17:34.781636 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf897ed-2e34-4acb-9d83-617074b49b86 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:17:34.792441 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf897ed-2e34-4acb-9d83-617074b49b86 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:17:34.798555 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05eae3d4-0b58-452d-80ae-e1b7b1996b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:17:34.799689 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eae3d4-0b58-452d-80ae-e1b7b1996b8d admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:34.799974 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eae3d4-0b58-452d-80ae-e1b7b1996b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:34.800347 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eae3d4-0b58-452d-80ae-e1b7b1996b8d admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:34.801159 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05eae3d4-0b58-452d-80ae-e1b7b1996b8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:17:34.803021 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05eae3d4-0b58-452d-80ae-e1b7b1996b8d admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:17:34.820486 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1017/2032] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:17:34 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:17:34.825024 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6fcafb-726d-4283-af06-2697a3fd4726 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:17:34.832782 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:17:34.837445 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6fcafb-726d-4283-af06-2697a3fd4726 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:17:34.843604 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09a53a0-883a-4aae-ba9e-b1e25c3cb485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:17:34.844534 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09a53a0-883a-4aae-ba9e-b1e25c3cb485 admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:34.845296 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09a53a0-883a-4aae-ba9e-b1e25c3cb485 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:34.845611 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09a53a0-883a-4aae-ba9e-b1e25c3cb485 admin admin] PATH_INFO: `/v3/projects/fd46b49bf4bf405685ebf40da0d6d540/users/f80436634a304accb152553e6d3fc449/roles/9f88c83743f745a9a785a2f454753f06` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:34.868748 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09a53a0-883a-4aae-ba9e-b1e25c3cb485 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd46b49bf4bf405685ebf40da0d6d540, user_id=f80436634a304accb152553e6d3fc449, role_id=9f88c83743f745a9a785a2f454753f06)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:17:34.871497 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09a53a0-883a-4aae-ba9e-b1e25c3cb485 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:17:34.894103 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1016/2033] 10.222.0.43 () {60 vars in 1482 bytes} [Wed Jun 22 10:17:34 2022] PUT /identity/v3/projects/fd46b49bf4bf405685ebf40da0d6d540/users/f80436634a304accb152553e6d3fc449/roles/9f88c83743f745a9a785a2f454753f06 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:17:34.904678 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81321bec-ad64-4188-a8ff-295024d45698 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:34.904896 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81321bec-ad64-4188-a8ff-295024d45698 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:34.905241 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81321bec-ad64-4188-a8ff-295024d45698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:34.939869 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-81321bec-ad64-4188-a8ff-295024d45698 None None] MFA Rules not processed for user `f80436634a304accb152553e6d3fc449`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:17:34.941322 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-81321bec-ad64-4188-a8ff-295024d45698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:17:35.021068 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1018/2034] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:17:34 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:17:35.025618 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09a53a0-883a-4aae-ba9e-b1e25c3cb485 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:17:35.096872 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09a53a0-883a-4aae-ba9e-b1e25c3cb485 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:17:35.107543 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d6e15c-dbe5-476c-a828-f92df411ea5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:17:35.107958 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d6e15c-dbe5-476c-a828-f92df411ea5d admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:35.108245 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d6e15c-dbe5-476c-a828-f92df411ea5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:35.109024 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d6e15c-dbe5-476c-a828-f92df411ea5d admin admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:35.109264 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d6e15c-dbe5-476c-a828-f92df411ea5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:17:35.111207 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d6e15c-dbe5-476c-a828-f92df411ea5d admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:17:35.140787 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1017/2035] 10.222.0.43 () {60 vars in 1152 bytes} [Wed Jun 22 10:17:35 2022] POST /identity/v3/projects => generated 369 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:17:35.145363 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81321bec-ad64-4188-a8ff-295024d45698 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:17:35.158830 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81321bec-ad64-4188-a8ff-295024d45698 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:17:35.187664 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a85d86f-e990-4257-8019-3d2090691ed7 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:35.188139 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a85d86f-e990-4257-8019-3d2090691ed7 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:35.188668 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a85d86f-e990-4257-8019-3d2090691ed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:35.208513 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-2a85d86f-e990-4257-8019-3d2090691ed7 None None] MFA Rules not processed for user `317e7e7dd5c741d49d34a1fd949a7c07`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:17:35.209768 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-2a85d86f-e990-4257-8019-3d2090691ed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:17:35.212467 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:17:35.220281 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40ac502-03c1-4dbb-8e58-131ff0b8e619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:17:35.221100 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40ac502-03c1-4dbb-8e58-131ff0b8e619 admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:35.221441 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40ac502-03c1-4dbb-8e58-131ff0b8e619 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:35.221743 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40ac502-03c1-4dbb-8e58-131ff0b8e619 admin admin] PATH_INFO: `/v3/users` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:35.222438 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40ac502-03c1-4dbb-8e58-131ff0b8e619 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:17:35.224362 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40ac502-03c1-4dbb-8e58-131ff0b8e619 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:17:35.246504 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1019/2036] 10.222.0.43 () {60 vars in 1143 bytes} [Wed Jun 22 10:17:35 2022] POST /identity/v3/users => generated 291 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:17:35.250099 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40ac502-03c1-4dbb-8e58-131ff0b8e619 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:17:35.260584 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40ac502-03c1-4dbb-8e58-131ff0b8e619 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:17:35.265221 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6f23ef-8550-4540-a5a5-bf2d04878118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:17:35.265908 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6f23ef-8550-4540-a5a5-bf2d04878118 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:35.266192 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6f23ef-8550-4540-a5a5-bf2d04878118 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:35.266473 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6f23ef-8550-4540-a5a5-bf2d04878118 admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:35.267274 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6f23ef-8550-4540-a5a5-bf2d04878118 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:17:35.269352 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6f23ef-8550-4540-a5a5-bf2d04878118 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:17:35.270963 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1018/2037] 10.222.0.43 () {58 vars in 967 bytes} [Wed Jun 22 10:17:35 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:17:35.282520 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1020/2038] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:17:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 10:17:35.283894 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a85d86f-e990-4257-8019-3d2090691ed7 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:17:35.284905 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6f23ef-8550-4540-a5a5-bf2d04878118 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:17:35.294916 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6f23ef-8550-4540-a5a5-bf2d04878118 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:17:35.300201 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ebcc9d-a6e4-43c3-a16c-447e854a0af9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:17:35.301224 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ebcc9d-a6e4-43c3-a16c-447e854a0af9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:35.301517 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ebcc9d-a6e4-43c3-a16c-447e854a0af9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:35.301834 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ebcc9d-a6e4-43c3-a16c-447e854a0af9 admin admin] PATH_INFO: `/v3/projects/e35b01b5470d4821a1fff6e703c623d0/users/493afbc2e12c4a33ab0ff67795420664/roles/26d9c2ab5dfc4e6d9ca80c6014123906` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:35.317217 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ebcc9d-a6e4-43c3-a16c-447e854a0af9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e35b01b5470d4821a1fff6e703c623d0, user_id=493afbc2e12c4a33ab0ff67795420664, role_id=26d9c2ab5dfc4e6d9ca80c6014123906)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:17:35.319935 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ebcc9d-a6e4-43c3-a16c-447e854a0af9 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:17:35.335751 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1021/2039] 10.222.0.43 () {60 vars in 1482 bytes} [Wed Jun 22 10:17:35 2022] PUT /identity/v3/projects/e35b01b5470d4821a1fff6e703c623d0/users/493afbc2e12c4a33ab0ff67795420664/roles/26d9c2ab5dfc4e6d9ca80c6014123906 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:17:35.339606 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ebcc9d-a6e4-43c3-a16c-447e854a0af9 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:17:35.358983 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a85d86f-e990-4257-8019-3d2090691ed7 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:17:35.372144 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:17:35.404823 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ebcc9d-a6e4-43c3-a16c-447e854a0af9 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:17:35.409854 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd09a71-fbd4-4e52-abd5-78520d251803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:17:35.410457 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd09a71-fbd4-4e52-abd5-78520d251803 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:35.410741 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd09a71-fbd4-4e52-abd5-78520d251803 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:35.411015 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd09a71-fbd4-4e52-abd5-78520d251803 admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:35.411740 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd09a71-fbd4-4e52-abd5-78520d251803 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:17:35.413337 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd09a71-fbd4-4e52-abd5-78520d251803 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:17:35.423049 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1022/2040] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:17:35 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:17:35.427556 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6dc301-85ed-4743-9cab-dfb305cfd5e7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9566f8cca2574f4cb5edcbf384f368a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:17:35.427733 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd09a71-fbd4-4e52-abd5-78520d251803 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:17:35.428247 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6dc301-85ed-4743-9cab-dfb305cfd5e7 service swift] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:35.428532 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6dc301-85ed-4743-9cab-dfb305cfd5e7 service swift] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:35.428810 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6dc301-85ed-4743-9cab-dfb305cfd5e7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:35.437448 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd09a71-fbd4-4e52-abd5-78520d251803 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:17:35.443249 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0df7628-e825-4369-8c93-3d6392f27aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:17:35.444112 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0df7628-e825-4369-8c93-3d6392f27aff admin admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:35.444392 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0df7628-e825-4369-8c93-3d6392f27aff admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:35.444667 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0df7628-e825-4369-8c93-3d6392f27aff admin admin] PATH_INFO: `/v3/projects/e35b01b5470d4821a1fff6e703c623d0/users/493afbc2e12c4a33ab0ff67795420664/roles/26d9c2ab5dfc4e6d9ca80c6014123906` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:35.446630 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0df7628-e825-4369-8c93-3d6392f27aff admin admin] RBAC: Authorizing `identity:create_grant(project_id=e35b01b5470d4821a1fff6e703c623d0, user_id=493afbc2e12c4a33ab0ff67795420664, role_id=26d9c2ab5dfc4e6d9ca80c6014123906)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:17:35.449257 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0df7628-e825-4369-8c93-3d6392f27aff admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:17:35.459447 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1023/2041] 10.222.0.43 () {60 vars in 1482 bytes} [Wed Jun 22 10:17:35 2022] PUT /identity/v3/projects/e35b01b5470d4821a1fff6e703c623d0/users/493afbc2e12c4a33ab0ff67795420664/roles/26d9c2ab5dfc4e6d9ca80c6014123906 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:17:35.470301 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0551d343-30b1-4076-a199-f5812af8da29 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:35.470591 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0551d343-30b1-4076-a199-f5812af8da29 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:35.471122 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0551d343-30b1-4076-a199-f5812af8da29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:35.486182 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6dc301-85ed-4743-9cab-dfb305cfd5e7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:17:35.488636 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6dc301-85ed-4743-9cab-dfb305cfd5e7 service swift] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:17:35.497052 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1019/2042] 10.222.0.43 () {60 vars in 1384 bytes} [Wed Jun 22 10:17:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 22 10:17:35.498856 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-0551d343-30b1-4076-a199-f5812af8da29 None None] MFA Rules not processed for user `493afbc2e12c4a33ab0ff67795420664`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:17:35.499768 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-0551d343-30b1-4076-a199-f5812af8da29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:17:35.572101 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1024/2043] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:17:35 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:17:35.583382 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6dc301-85ed-4743-9cab-dfb305cfd5e7 service swift] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:17:35.585220 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-ad6dc301-85ed-4743-9cab-dfb305cfd5e7 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:17:35.647019 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6dc301-85ed-4743-9cab-dfb305cfd5e7 service swift] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:17:35.711527 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b8a52d-c40b-453c-b94c-c52680891177 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bbcb3d4dc704dfdb0097abc594ca855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:17:35.712316 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b8a52d-c40b-453c-b94c-c52680891177 service cinder] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:35.712604 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b8a52d-c40b-453c-b94c-c52680891177 service cinder] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:35.713009 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b8a52d-c40b-453c-b94c-c52680891177 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:35.724836 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b8a52d-c40b-453c-b94c-c52680891177 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:17:35.727030 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b8a52d-c40b-453c-b94c-c52680891177 service cinder] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:17:35.738981 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1020/2044] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:17:35 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:17:35.780106 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6dd8e2-f94f-4895-ae87-7479bcafe5d6 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:35.780457 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6dd8e2-f94f-4895-ae87-7479bcafe5d6 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:35.780816 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6dd8e2-f94f-4895-ae87-7479bcafe5d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:35.790589 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b8a52d-c40b-453c-b94c-c52680891177 service cinder] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:17:35.792096 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-d6b8a52d-c40b-453c-b94c-c52680891177 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:17:35.802496 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-1c6dd8e2-f94f-4895-ae87-7479bcafe5d6 None None] MFA Rules not processed for user `317e7e7dd5c741d49d34a1fd949a7c07`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:17:35.803680 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-1c6dd8e2-f94f-4895-ae87-7479bcafe5d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:17:35.804880 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b8a52d-c40b-453c-b94c-c52680891177 service cinder] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:17:35.809346 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2153231-33a9-407c-aeb9-5d8b4f812429 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bbcb3d4dc704dfdb0097abc594ca855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:17:35.809750 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2153231-33a9-407c-aeb9-5d8b4f812429 service cinder] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:35.810038 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2153231-33a9-407c-aeb9-5d8b4f812429 service cinder] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:35.810468 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2153231-33a9-407c-aeb9-5d8b4f812429 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:35.816827 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:17:35.825503 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:17:35.872291 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1025/2045] 10.222.0.43 () {58 vars in 1009 bytes} [Wed Jun 22 10:17:35 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:17:35.885784 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6dd8e2-f94f-4895-ae87-7479bcafe5d6 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:17:35.886505 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2153231-33a9-407c-aeb9-5d8b4f812429 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:17:35.889953 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2153231-33a9-407c-aeb9-5d8b4f812429 service cinder] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:17:35.903833 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1021/2046] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:17:35 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 10:17:35.996460 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6dd8e2-f94f-4895-ae87-7479bcafe5d6 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:17:36.004189 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0216451c-13c4-4ecd-a22b-e2b4f49a0e94 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9566f8cca2574f4cb5edcbf384f368a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:17:36.004820 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0216451c-13c4-4ecd-a22b-e2b4f49a0e94 service swift] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:36.005140 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0216451c-13c4-4ecd-a22b-e2b4f49a0e94 service swift] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:36.005421 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0216451c-13c4-4ecd-a22b-e2b4f49a0e94 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:36.014721 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0216451c-13c4-4ecd-a22b-e2b4f49a0e94 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:17:36.016472 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0216451c-13c4-4ecd-a22b-e2b4f49a0e94 service swift] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:17:36.025831 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1026/2047] 10.222.0.43 () {60 vars in 1384 bytes} [Wed Jun 22 10:17:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 22 10:17:36.421738 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09555c5-46bf-4804-b04e-12bc9d6acdeb None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:36.422213 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09555c5-46bf-4804-b04e-12bc9d6acdeb None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:36.422302 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09555c5-46bf-4804-b04e-12bc9d6acdeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:36.440562 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-f09555c5-46bf-4804-b04e-12bc9d6acdeb None None] MFA Rules not processed for user `317e7e7dd5c741d49d34a1fd949a7c07`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:17:36.441670 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-f09555c5-46bf-4804-b04e-12bc9d6acdeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:17:36.448751 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1022/2048] 10.222.0.43 () {58 vars in 967 bytes} [Wed Jun 22 10:17:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:17:36.462243 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0216451c-13c4-4ecd-a22b-e2b4f49a0e94 service swift] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:17:36.473081 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0216451c-13c4-4ecd-a22b-e2b4f49a0e94 service swift] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:17:36.478208 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c89ba5-3c48-4772-8558-bc5407cb120b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9566f8cca2574f4cb5edcbf384f368a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:17:36.479088 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c89ba5-3c48-4772-8558-bc5407cb120b service swift] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:36.479380 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c89ba5-3c48-4772-8558-bc5407cb120b service swift] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:36.479655 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c89ba5-3c48-4772-8558-bc5407cb120b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:36.487815 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c89ba5-3c48-4772-8558-bc5407cb120b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:17:36.489385 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c89ba5-3c48-4772-8558-bc5407cb120b service swift] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:17:36.497232 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1027/2049] 10.222.0.43 () {60 vars in 1384 bytes} [Wed Jun 22 10:17:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 22 10:17:38.578129 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09555c5-46bf-4804-b04e-12bc9d6acdeb None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:17:38.579849 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-f09555c5-46bf-4804-b04e-12bc9d6acdeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:17:38.648231 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09555c5-46bf-4804-b04e-12bc9d6acdeb None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:17:38.652864 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cd0550-245e-476b-b077-f800919d6413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:17:38.653842 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cd0550-245e-476b-b077-f800919d6413 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:38.654117 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cd0550-245e-476b-b077-f800919d6413 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:38.654349 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cd0550-245e-476b-b077-f800919d6413 admin admin] PATH_INFO: `/v3/users/7b4ef2f1a6dd45ccaea982213e051ee8` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:38.655746 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cd0550-245e-476b-b077-f800919d6413 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b4ef2f1a6dd45ccaea982213e051ee8)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:17:38.657671 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cd0550-245e-476b-b077-f800919d6413 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:17:38.704006 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-56cd0550-245e-476b-b077-f800919d6413 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b4ef2f1a6dd45ccaea982213e051ee8'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:17:38.717017 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-56cd0550-245e-476b-b077-f800919d6413 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b4ef2f1a6dd45ccaea982213e051ee8'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:17:38.727854 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-56cd0550-245e-476b-b077-f800919d6413 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b4ef2f1a6dd45ccaea982213e051ee8'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:17:38.728618 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-56cd0550-245e-476b-b077-f800919d6413 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b4ef2f1a6dd45ccaea982213e051ee8'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:17:38.735904 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-56cd0550-245e-476b-b077-f800919d6413 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b4ef2f1a6dd45ccaea982213e051ee8'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:17:38.742573 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1023/2050] 10.222.0.43 () {58 vars in 1223 bytes} [Wed Jun 22 10:17:38 2022] DELETE /identity/v3/users/7b4ef2f1a6dd45ccaea982213e051ee8 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:17:38.747115 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c634e4f7-84df-4bce-a472-72008640b417 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:38.747578 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c634e4f7-84df-4bce-a472-72008640b417 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:38.747680 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c634e4f7-84df-4bce-a472-72008640b417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:38.766682 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-c634e4f7-84df-4bce-a472-72008640b417 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:17:38.768413 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-c634e4f7-84df-4bce-a472-72008640b417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:17:38.832750 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1028/2051] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:17:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:17:38.840733 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cd0550-245e-476b-b077-f800919d6413 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:17:38.842077 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-56cd0550-245e-476b-b077-f800919d6413 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:17:38.873730 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:17:38.907597 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cd0550-245e-476b-b077-f800919d6413 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:17:38.911506 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b48676-6157-427e-8a95-138a5007d611 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe93d4c0737249fd8623bb5ce188e34e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:17:38.912173 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b48676-6157-427e-8a95-138a5007d611 service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:38.913072 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b48676-6157-427e-8a95-138a5007d611 service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:38.913363 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b48676-6157-427e-8a95-138a5007d611 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:38.924219 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b48676-6157-427e-8a95-138a5007d611 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:17:38.925805 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b48676-6157-427e-8a95-138a5007d611 service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:17:38.936571 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1024/2052] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:17:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:17:39.138910 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c634e4f7-84df-4bce-a472-72008640b417 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:17:39.140457 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-c634e4f7-84df-4bce-a472-72008640b417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:17:39.156364 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c634e4f7-84df-4bce-a472-72008640b417 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:17:39.164921 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ac17a3-adf3-476b-844c-03ae4883e7c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:17:39.165968 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ac17a3-adf3-476b-844c-03ae4883e7c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:39.166348 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ac17a3-adf3-476b-844c-03ae4883e7c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:39.166721 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ac17a3-adf3-476b-844c-03ae4883e7c5 admin admin] PATH_INFO: `/v3/projects/b97e48bc75b74b49aec21b8a8b2810d5` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:39.168741 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ac17a3-adf3-476b-844c-03ae4883e7c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b97e48bc75b74b49aec21b8a8b2810d5)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:17:39.171460 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ac17a3-adf3-476b-844c-03ae4883e7c5 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:17:39.218731 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:17:39.236068 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-b5ac17a3-adf3-476b-844c-03ae4883e7c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b97e48bc75b74b49aec21b8a8b2810d5', 'request_id': 'req-b5ac17a3-adf3-476b-844c-03ae4883e7c5'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:17:39.244653 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-b5ac17a3-adf3-476b-844c-03ae4883e7c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b97e48bc75b74b49aec21b8a8b2810d5', 'request_id': 'req-b5ac17a3-adf3-476b-844c-03ae4883e7c5'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:17:39.255508 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-b5ac17a3-adf3-476b-844c-03ae4883e7c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b97e48bc75b74b49aec21b8a8b2810d5', 'request_id': 'req-b5ac17a3-adf3-476b-844c-03ae4883e7c5'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:17:39.270237 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-b5ac17a3-adf3-476b-844c-03ae4883e7c5 admin admin] The token cache is being invalidate because project b97e48bc75b74b49aec21b8a8b2810d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:17:39.270530 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-b5ac17a3-adf3-476b-844c-03ae4883e7c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:17:39.271169 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-b5ac17a3-adf3-476b-844c-03ae4883e7c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:17:39.272795 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1029/2053] 10.222.0.43 () {58 vars in 1232 bytes} [Wed Jun 22 10:17:39 2022] DELETE /identity/v3/projects/b97e48bc75b74b49aec21b8a8b2810d5 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:17:39.277471 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe49422a-7161-4306-8a84-75bf7ff008dd None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:39.278047 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe49422a-7161-4306-8a84-75bf7ff008dd None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:39.278335 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe49422a-7161-4306-8a84-75bf7ff008dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:39.303307 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-fe49422a-7161-4306-8a84-75bf7ff008dd None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:17:39.304629 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-fe49422a-7161-4306-8a84-75bf7ff008dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:17:39.349296 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ac17a3-adf3-476b-844c-03ae4883e7c5 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:17:39.350732 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-b5ac17a3-adf3-476b-844c-03ae4883e7c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:17:39.369503 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1025/2054] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:17:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:17:39.379652 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa81dfc-242f-4627-8083-8f58fda26371 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:39.380038 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa81dfc-242f-4627-8083-8f58fda26371 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:39.380537 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa81dfc-242f-4627-8083-8f58fda26371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:39.399877 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-5aa81dfc-242f-4627-8083-8f58fda26371 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:17:39.401221 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-5aa81dfc-242f-4627-8083-8f58fda26371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:17:39.410349 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1026/2055] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:17:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:17:39.414618 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa81dfc-242f-4627-8083-8f58fda26371 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:17:39.418523 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ac17a3-adf3-476b-844c-03ae4883e7c5 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:17:39.423405 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668f8809-4293-4536-b47e-74c8918490b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:17:39.424824 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa81dfc-242f-4627-8083-8f58fda26371 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:17:39.425564 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668f8809-4293-4536-b47e-74c8918490b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:39.425893 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668f8809-4293-4536-b47e-74c8918490b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:39.426174 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668f8809-4293-4536-b47e-74c8918490b1 admin admin] PATH_INFO: `/v3/users/f80436634a304accb152553e6d3fc449` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:39.427439 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668f8809-4293-4536-b47e-74c8918490b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f80436634a304accb152553e6d3fc449)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:17:39.429383 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668f8809-4293-4536-b47e-74c8918490b1 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:17:39.429809 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc75c822-e29c-490a-8b52-a200cda7e86c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:17:39.430552 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc75c822-e29c-490a-8b52-a200cda7e86c admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:39.430949 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc75c822-e29c-490a-8b52-a200cda7e86c admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:39.431411 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc75c822-e29c-490a-8b52-a200cda7e86c admin admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:39.432208 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc75c822-e29c-490a-8b52-a200cda7e86c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:17:39.432586 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc75c822-e29c-490a-8b52-a200cda7e86c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:17:39.434363 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc75c822-e29c-490a-8b52-a200cda7e86c admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:17:39.451025 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1027/2056] 10.222.0.43 () {58 vars in 1152 bytes} [Wed Jun 22 10:17:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:17:39.452116 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc75c822-e29c-490a-8b52-a200cda7e86c admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:17:39.463487 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc75c822-e29c-490a-8b52-a200cda7e86c admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:17:39.468938 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520ac8ac-7ef0-4638-8d05-b7eeb90d10b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:17:39.469792 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520ac8ac-7ef0-4638-8d05-b7eeb90d10b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:39.470082 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520ac8ac-7ef0-4638-8d05-b7eeb90d10b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:39.470464 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520ac8ac-7ef0-4638-8d05-b7eeb90d10b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:39.471370 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520ac8ac-7ef0-4638-8d05-b7eeb90d10b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:17:39.473428 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520ac8ac-7ef0-4638-8d05-b7eeb90d10b7 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:17:39.486954 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-668f8809-4293-4536-b47e-74c8918490b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f80436634a304accb152553e6d3fc449'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:17:39.500508 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-668f8809-4293-4536-b47e-74c8918490b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f80436634a304accb152553e6d3fc449'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:17:39.510645 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-668f8809-4293-4536-b47e-74c8918490b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f80436634a304accb152553e6d3fc449'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:17:39.513533 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1028/2057] 10.222.0.43 () {60 vars in 1152 bytes} [Wed Jun 22 10:17:39 2022] POST /identity/v3/projects => generated 391 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:17:39.517306 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520ac8ac-7ef0-4638-8d05-b7eeb90d10b7 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:17:39.523933 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-668f8809-4293-4536-b47e-74c8918490b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f80436634a304accb152553e6d3fc449'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:17:39.524639 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-668f8809-4293-4536-b47e-74c8918490b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f80436634a304accb152553e6d3fc449'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:17:39.531147 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1030/2058] 10.222.0.43 () {58 vars in 1223 bytes} [Wed Jun 22 10:17:39 2022] DELETE /identity/v3/users/f80436634a304accb152553e6d3fc449 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:17:39.535996 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7523f18d-b2aa-43a3-9ecd-24cdeea9028f None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:39.536293 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7523f18d-b2aa-43a3-9ecd-24cdeea9028f None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:39.536575 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7523f18d-b2aa-43a3-9ecd-24cdeea9028f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:39.554737 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-7523f18d-b2aa-43a3-9ecd-24cdeea9028f None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:17:39.555954 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-7523f18d-b2aa-43a3-9ecd-24cdeea9028f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:17:39.592454 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520ac8ac-7ef0-4638-8d05-b7eeb90d10b7 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:17:39.598129 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:17:39.625141 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1031/2059] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:17:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:17:39.632313 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:17:39.636536 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7523f18d-b2aa-43a3-9ecd-24cdeea9028f None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:17:39.638168 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-7523f18d-b2aa-43a3-9ecd-24cdeea9028f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:17:39.662765 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216f8e1d-df57-4dc7-88d8-3d8d0bcfb202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:17:39.663302 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216f8e1d-df57-4dc7-88d8-3d8d0bcfb202 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:39.663589 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216f8e1d-df57-4dc7-88d8-3d8d0bcfb202 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:39.663868 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216f8e1d-df57-4dc7-88d8-3d8d0bcfb202 admin admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:39.664563 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216f8e1d-df57-4dc7-88d8-3d8d0bcfb202 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:17:39.666506 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216f8e1d-df57-4dc7-88d8-3d8d0bcfb202 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:17:39.690896 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1029/2060] 10.222.0.43 () {60 vars in 1143 bytes} [Wed Jun 22 10:17:39 2022] POST /identity/v3/users => generated 296 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:17:39.691963 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216f8e1d-df57-4dc7-88d8-3d8d0bcfb202 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:17:39.694175 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-216f8e1d-df57-4dc7-88d8-3d8d0bcfb202 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:17:39.701658 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7523f18d-b2aa-43a3-9ecd-24cdeea9028f None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:17:39.706473 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216f8e1d-df57-4dc7-88d8-3d8d0bcfb202 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:17:39.706845 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829a709c-a5fa-4ce5-bce9-9b329e971692 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe93d4c0737249fd8623bb5ce188e34e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:17:39.707491 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829a709c-a5fa-4ce5-bce9-9b329e971692 service neutron] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:39.707773 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829a709c-a5fa-4ce5-bce9-9b329e971692 service neutron] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:39.708045 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829a709c-a5fa-4ce5-bce9-9b329e971692 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:39.711075 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cfeb7b-d1ea-4124-8e7d-79c79545b6ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:17:39.711727 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cfeb7b-d1ea-4124-8e7d-79c79545b6ca admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:39.712011 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cfeb7b-d1ea-4124-8e7d-79c79545b6ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:39.712289 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cfeb7b-d1ea-4124-8e7d-79c79545b6ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:39.713126 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cfeb7b-d1ea-4124-8e7d-79c79545b6ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:17:39.714835 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cfeb7b-d1ea-4124-8e7d-79c79545b6ca admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:17:39.717290 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829a709c-a5fa-4ce5-bce9-9b329e971692 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:17:39.718745 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829a709c-a5fa-4ce5-bce9-9b329e971692 service neutron] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:17:39.728374 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1030/2061] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:17:39 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 10:17:39.728808 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1032/2062] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:17:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 10:17:39.729719 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cfeb7b-d1ea-4124-8e7d-79c79545b6ca admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:17:39.739301 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cfeb7b-d1ea-4124-8e7d-79c79545b6ca admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:17:39.743926 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45dcf38-65e2-4cc1-951a-acb028615673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:17:39.744574 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45dcf38-65e2-4cc1-951a-acb028615673 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:39.744865 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45dcf38-65e2-4cc1-951a-acb028615673 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:39.745144 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45dcf38-65e2-4cc1-951a-acb028615673 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:39.745896 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45dcf38-65e2-4cc1-951a-acb028615673 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:17:39.747487 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45dcf38-65e2-4cc1-951a-acb028615673 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:17:39.758137 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1031/2063] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:17:39 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 10:17:39.762305 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829a709c-a5fa-4ce5-bce9-9b329e971692 service neutron] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:17:39.772771 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829a709c-a5fa-4ce5-bce9-9b329e971692 service neutron] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:17:39.777584 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f0a74a-4676-4b32-b3c9-9c00c71a3077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:17:39.778528 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f0a74a-4676-4b32-b3c9-9c00c71a3077 admin admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:39.778817 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f0a74a-4676-4b32-b3c9-9c00c71a3077 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:39.779092 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f0a74a-4676-4b32-b3c9-9c00c71a3077 admin admin] PATH_INFO: `/v3/projects/52ba0b45e7ee4c72a169d191115ec929/users/e8c7e278a8e94797a258ad0b7034ef82/roles/9f88c83743f745a9a785a2f454753f06` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:39.795119 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f0a74a-4676-4b32-b3c9-9c00c71a3077 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52ba0b45e7ee4c72a169d191115ec929, user_id=e8c7e278a8e94797a258ad0b7034ef82, role_id=9f88c83743f745a9a785a2f454753f06)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:17:39.798364 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f0a74a-4676-4b32-b3c9-9c00c71a3077 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:17:39.813954 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1033/2064] 10.222.0.43 () {60 vars in 1482 bytes} [Wed Jun 22 10:17:39 2022] PUT /identity/v3/projects/52ba0b45e7ee4c72a169d191115ec929/users/e8c7e278a8e94797a258ad0b7034ef82/roles/9f88c83743f745a9a785a2f454753f06 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:17:39.824674 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee6a43c-cc49-4b03-9b2a-f3107ee53d2d None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:39.824965 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee6a43c-cc49-4b03-9b2a-f3107ee53d2d None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:39.825265 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee6a43c-cc49-4b03-9b2a-f3107ee53d2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:39.854864 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-0ee6a43c-cc49-4b03-9b2a-f3107ee53d2d None None] MFA Rules not processed for user `e8c7e278a8e94797a258ad0b7034ef82`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:17:39.856039 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-0ee6a43c-cc49-4b03-9b2a-f3107ee53d2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:17:39.935626 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1032/2065] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:17:39 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:17:39.947590 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f0a74a-4676-4b32-b3c9-9c00c71a3077 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:17:39.949436 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-93f0a74a-4676-4b32-b3c9-9c00c71a3077 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:17:40.024103 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f0a74a-4676-4b32-b3c9-9c00c71a3077 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:17:40.030945 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee6a43c-cc49-4b03-9b2a-f3107ee53d2d None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:17:40.031420 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45a62cd-ab02-44d1-98c2-9647f2ed6e01 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bbcb3d4dc704dfdb0097abc594ca855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:17:40.032090 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45a62cd-ab02-44d1-98c2-9647f2ed6e01 service cinder] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:40.032374 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45a62cd-ab02-44d1-98c2-9647f2ed6e01 service cinder] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:40.032650 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45a62cd-ab02-44d1-98c2-9647f2ed6e01 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:40.032858 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-0ee6a43c-cc49-4b03-9b2a-f3107ee53d2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:17:40.053932 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45a62cd-ab02-44d1-98c2-9647f2ed6e01 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:17:40.055409 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45a62cd-ab02-44d1-98c2-9647f2ed6e01 service cinder] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:17:40.065216 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1034/2066] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:17:39 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 10:17:40.131415 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee6a43c-cc49-4b03-9b2a-f3107ee53d2d None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:17:40.136245 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ad4016-2842-43a6-b280-30d56f21fd54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:17:40.137129 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ad4016-2842-43a6-b280-30d56f21fd54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:40.137416 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ad4016-2842-43a6-b280-30d56f21fd54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:40.137731 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ad4016-2842-43a6-b280-30d56f21fd54 admin admin] PATH_INFO: `/v3/projects/fd46b49bf4bf405685ebf40da0d6d540` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:40.138955 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ad4016-2842-43a6-b280-30d56f21fd54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd46b49bf4bf405685ebf40da0d6d540)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:17:40.140892 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ad4016-2842-43a6-b280-30d56f21fd54 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:17:40.207253 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:17:40.222326 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-d5ad4016-2842-43a6-b280-30d56f21fd54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd46b49bf4bf405685ebf40da0d6d540', 'request_id': 'req-d5ad4016-2842-43a6-b280-30d56f21fd54'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:17:40.230325 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-d5ad4016-2842-43a6-b280-30d56f21fd54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd46b49bf4bf405685ebf40da0d6d540', 'request_id': 'req-d5ad4016-2842-43a6-b280-30d56f21fd54'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:17:40.243358 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-d5ad4016-2842-43a6-b280-30d56f21fd54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd46b49bf4bf405685ebf40da0d6d540', 'request_id': 'req-d5ad4016-2842-43a6-b280-30d56f21fd54'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:17:40.258791 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-d5ad4016-2842-43a6-b280-30d56f21fd54 admin admin] The token cache is being invalidate because project fd46b49bf4bf405685ebf40da0d6d540 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:17:40.259089 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-d5ad4016-2842-43a6-b280-30d56f21fd54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:17:40.259875 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-d5ad4016-2842-43a6-b280-30d56f21fd54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:17:40.261568 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1033/2067] 10.222.0.43 () {58 vars in 1232 bytes} [Wed Jun 22 10:17:40 2022] DELETE /identity/v3/projects/fd46b49bf4bf405685ebf40da0d6d540 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:17:40.265626 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45a62cd-ab02-44d1-98c2-9647f2ed6e01 service cinder] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:17:40.283692 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45a62cd-ab02-44d1-98c2-9647f2ed6e01 service cinder] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:17:40.363382 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88693da1-19ed-4a87-908e-1bfe0f373514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:17:40.364247 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88693da1-19ed-4a87-908e-1bfe0f373514 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:40.364534 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88693da1-19ed-4a87-908e-1bfe0f373514 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:40.364842 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88693da1-19ed-4a87-908e-1bfe0f373514 admin admin] PATH_INFO: `/v3/users/493afbc2e12c4a33ab0ff67795420664` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:40.366381 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88693da1-19ed-4a87-908e-1bfe0f373514 admin admin] RBAC: Authorizing `identity:delete_user(user_id=493afbc2e12c4a33ab0ff67795420664)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:17:40.368409 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88693da1-19ed-4a87-908e-1bfe0f373514 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:17:40.378241 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:17:40.457480 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-88693da1-19ed-4a87-908e-1bfe0f373514 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '493afbc2e12c4a33ab0ff67795420664'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:17:40.481212 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-88693da1-19ed-4a87-908e-1bfe0f373514 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '493afbc2e12c4a33ab0ff67795420664'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:17:40.493034 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-88693da1-19ed-4a87-908e-1bfe0f373514 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '493afbc2e12c4a33ab0ff67795420664'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:17:40.503380 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-88693da1-19ed-4a87-908e-1bfe0f373514 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '493afbc2e12c4a33ab0ff67795420664'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:17:40.504356 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-88693da1-19ed-4a87-908e-1bfe0f373514 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '493afbc2e12c4a33ab0ff67795420664'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:17:40.512495 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1035/2068] 10.222.0.43 () {58 vars in 1223 bytes} [Wed Jun 22 10:17:40 2022] DELETE /identity/v3/users/493afbc2e12c4a33ab0ff67795420664 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:17:40.928335 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ad4016-2842-43a6-b280-30d56f21fd54 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:17:40.928335 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-d5ad4016-2842-43a6-b280-30d56f21fd54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:17:40.945925 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ad4016-2842-43a6-b280-30d56f21fd54 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:17:41.034419 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d54839-fa39-42fc-a319-de111c582a89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:17:41.035301 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d54839-fa39-42fc-a319-de111c582a89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:41.035598 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d54839-fa39-42fc-a319-de111c582a89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:41.035861 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d54839-fa39-42fc-a319-de111c582a89 admin admin] PATH_INFO: `/v3/projects/e35b01b5470d4821a1fff6e703c623d0` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:41.037926 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d54839-fa39-42fc-a319-de111c582a89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e35b01b5470d4821a1fff6e703c623d0)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:17:41.040174 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d54839-fa39-42fc-a319-de111c582a89 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:17:41.105064 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-e1d54839-fa39-42fc-a319-de111c582a89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e35b01b5470d4821a1fff6e703c623d0', 'request_id': 'req-e1d54839-fa39-42fc-a319-de111c582a89'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:17:41.111719 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-e1d54839-fa39-42fc-a319-de111c582a89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e35b01b5470d4821a1fff6e703c623d0', 'request_id': 'req-e1d54839-fa39-42fc-a319-de111c582a89'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:17:41.119717 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-e1d54839-fa39-42fc-a319-de111c582a89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e35b01b5470d4821a1fff6e703c623d0', 'request_id': 'req-e1d54839-fa39-42fc-a319-de111c582a89'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:17:41.133925 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-e1d54839-fa39-42fc-a319-de111c582a89 admin admin] The token cache is being invalidate because project e35b01b5470d4821a1fff6e703c623d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:17:41.134130 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-e1d54839-fa39-42fc-a319-de111c582a89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:17:41.134858 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-e1d54839-fa39-42fc-a319-de111c582a89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:17:41.136572 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1034/2069] 10.222.0.43 () {58 vars in 1232 bytes} [Wed Jun 22 10:17:40 2022] DELETE /identity/v3/projects/e35b01b5470d4821a1fff6e703c623d0 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:17:41.143872 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a740772-5928-488f-8a9f-7d083607bb99 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:41.144578 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a740772-5928-488f-8a9f-7d083607bb99 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:41.144932 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a740772-5928-488f-8a9f-7d083607bb99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:41.167027 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-2a740772-5928-488f-8a9f-7d083607bb99 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:17:41.168285 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-2a740772-5928-488f-8a9f-7d083607bb99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:17:41.260587 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1036/2070] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:17:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:17:41.269871 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e82a480-9bdf-4ffb-8ab2-a5c1c13454b2 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:41.270375 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e82a480-9bdf-4ffb-8ab2-a5c1c13454b2 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:41.270821 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e82a480-9bdf-4ffb-8ab2-a5c1c13454b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:41.292799 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-9e82a480-9bdf-4ffb-8ab2-a5c1c13454b2 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:17:41.294060 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-9e82a480-9bdf-4ffb-8ab2-a5c1c13454b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:17:41.304538 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1035/2071] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:17:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:17:41.308915 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a740772-5928-488f-8a9f-7d083607bb99 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:17:41.319705 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a740772-5928-488f-8a9f-7d083607bb99 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:17:41.324440 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187fc5da-abfc-49fd-bd2f-d1a1eeb1628b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:17:41.325110 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187fc5da-abfc-49fd-bd2f-d1a1eeb1628b admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:41.325395 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187fc5da-abfc-49fd-bd2f-d1a1eeb1628b admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:41.325676 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187fc5da-abfc-49fd-bd2f-d1a1eeb1628b admin admin] PATH_INFO: `/v3/domains` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:41.326450 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187fc5da-abfc-49fd-bd2f-d1a1eeb1628b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:17:41.326757 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187fc5da-abfc-49fd-bd2f-d1a1eeb1628b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:17:41.328408 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187fc5da-abfc-49fd-bd2f-d1a1eeb1628b admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:17:41.345334 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1037/2072] 10.222.0.43 () {58 vars in 1152 bytes} [Wed Jun 22 10:17:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:17:41.350106 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e82a480-9bdf-4ffb-8ab2-a5c1c13454b2 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:17:41.360148 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e82a480-9bdf-4ffb-8ab2-a5c1c13454b2 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:17:41.365421 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8809508-2241-4d74-9f89-d1c9b31a6e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:17:41.366148 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8809508-2241-4d74-9f89-d1c9b31a6e83 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:41.366430 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8809508-2241-4d74-9f89-d1c9b31a6e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:41.366705 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8809508-2241-4d74-9f89-d1c9b31a6e83 admin admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:41.367407 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8809508-2241-4d74-9f89-d1c9b31a6e83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:17:41.369312 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8809508-2241-4d74-9f89-d1c9b31a6e83 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:17:41.399767 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1036/2073] 10.222.0.43 () {60 vars in 1152 bytes} [Wed Jun 22 10:17:41 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 10:17:41.402445 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187fc5da-abfc-49fd-bd2f-d1a1eeb1628b admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:17:41.413065 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187fc5da-abfc-49fd-bd2f-d1a1eeb1628b admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:17:41.476878 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67629a7-b31e-4043-a19f-05064ee7d07c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:17:41.477565 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67629a7-b31e-4043-a19f-05064ee7d07c admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:41.477882 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67629a7-b31e-4043-a19f-05064ee7d07c admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:41.478160 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67629a7-b31e-4043-a19f-05064ee7d07c admin admin] PATH_INFO: `/v3/users` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:41.479122 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67629a7-b31e-4043-a19f-05064ee7d07c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:17:41.481067 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67629a7-b31e-4043-a19f-05064ee7d07c admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:17:41.498045 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:17:41.509287 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1038/2074] 10.222.0.43 () {60 vars in 1143 bytes} [Wed Jun 22 10:17:41 2022] POST /identity/v3/users => generated 293 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:17:41.511442 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8809508-2241-4d74-9f89-d1c9b31a6e83 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:17:41.522418 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8809508-2241-4d74-9f89-d1c9b31a6e83 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:17:41.527127 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10be03eb-f0ed-4809-bb6b-b2f67fe4a31a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:17:41.527793 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10be03eb-f0ed-4809-bb6b-b2f67fe4a31a admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:41.528077 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10be03eb-f0ed-4809-bb6b-b2f67fe4a31a admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:41.528350 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10be03eb-f0ed-4809-bb6b-b2f67fe4a31a admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:41.529071 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10be03eb-f0ed-4809-bb6b-b2f67fe4a31a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:17:41.530720 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10be03eb-f0ed-4809-bb6b-b2f67fe4a31a admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:17:41.543208 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1037/2075] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:17:41 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:17:41.547391 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67629a7-b31e-4043-a19f-05064ee7d07c admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:17:41.561162 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67629a7-b31e-4043-a19f-05064ee7d07c admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:17:41.567303 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1478b8b4-d2c0-4a45-b94e-4a2976419450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:17:41.568083 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1478b8b4-d2c0-4a45-b94e-4a2976419450 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:41.568439 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1478b8b4-d2c0-4a45-b94e-4a2976419450 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:41.568722 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1478b8b4-d2c0-4a45-b94e-4a2976419450 admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:41.569595 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1478b8b4-d2c0-4a45-b94e-4a2976419450 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:17:41.571549 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1478b8b4-d2c0-4a45-b94e-4a2976419450 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:17:41.593902 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1039/2076] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:17:41 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:17:41.598445 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10be03eb-f0ed-4809-bb6b-b2f67fe4a31a admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:17:41.609054 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10be03eb-f0ed-4809-bb6b-b2f67fe4a31a admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:17:41.617898 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416f2643-27ae-4ea1-ab06-5054f060d655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:17:41.618807 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416f2643-27ae-4ea1-ab06-5054f060d655 admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:41.619092 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416f2643-27ae-4ea1-ab06-5054f060d655 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:41.619522 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416f2643-27ae-4ea1-ab06-5054f060d655 admin admin] PATH_INFO: `/v3/projects/2b819c960da9410c942cf0562c067750/users/161166e5341b45dcaabcb6b4909dbb94/roles/9f88c83743f745a9a785a2f454753f06` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:41.630267 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:17:41.639195 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416f2643-27ae-4ea1-ab06-5054f060d655 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b819c960da9410c942cf0562c067750, user_id=161166e5341b45dcaabcb6b4909dbb94, role_id=9f88c83743f745a9a785a2f454753f06)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:17:41.644016 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416f2643-27ae-4ea1-ab06-5054f060d655 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:17:41.662573 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1038/2077] 10.222.0.43 () {60 vars in 1482 bytes} [Wed Jun 22 10:17:41 2022] PUT /identity/v3/projects/2b819c960da9410c942cf0562c067750/users/161166e5341b45dcaabcb6b4909dbb94/roles/9f88c83743f745a9a785a2f454753f06 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:17:41.672978 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc88d0d-2f05-4a52-8bae-6d70b3a571c9 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:41.673890 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc88d0d-2f05-4a52-8bae-6d70b3a571c9 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:41.675373 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc88d0d-2f05-4a52-8bae-6d70b3a571c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:41.710404 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-bcc88d0d-2f05-4a52-8bae-6d70b3a571c9 None None] MFA Rules not processed for user `161166e5341b45dcaabcb6b4909dbb94`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:17:41.711788 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-bcc88d0d-2f05-4a52-8bae-6d70b3a571c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:17:41.783621 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1040/2078] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:17:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:17:41.788251 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416f2643-27ae-4ea1-ab06-5054f060d655 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:17:41.849259 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416f2643-27ae-4ea1-ab06-5054f060d655 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:17:41.854370 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6091039e-1ff6-42ec-9916-6e208f60f98a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:17:41.855022 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6091039e-1ff6-42ec-9916-6e208f60f98a admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:41.855306 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6091039e-1ff6-42ec-9916-6e208f60f98a admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:41.855674 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6091039e-1ff6-42ec-9916-6e208f60f98a admin admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:41.856521 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6091039e-1ff6-42ec-9916-6e208f60f98a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:17:41.858441 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6091039e-1ff6-42ec-9916-6e208f60f98a admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:17:41.884427 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1039/2079] 10.222.0.43 () {60 vars in 1152 bytes} [Wed Jun 22 10:17:41 2022] POST /identity/v3/projects => generated 383 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:17:41.888851 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc88d0d-2f05-4a52-8bae-6d70b3a571c9 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:17:41.900823 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc88d0d-2f05-4a52-8bae-6d70b3a571c9 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:17:41.968580 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6737b0-f080-4318-a9a2-2d4a72ce2d8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:17:41.969268 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6737b0-f080-4318-a9a2-2d4a72ce2d8a admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:41.969559 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6737b0-f080-4318-a9a2-2d4a72ce2d8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:41.971008 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6737b0-f080-4318-a9a2-2d4a72ce2d8a admin admin] PATH_INFO: `/v3/users` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:41.971008 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6737b0-f080-4318-a9a2-2d4a72ce2d8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:17:41.973065 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6737b0-f080-4318-a9a2-2d4a72ce2d8a admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:17:41.994723 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1041/2080] 10.222.0.43 () {60 vars in 1143 bytes} [Wed Jun 22 10:17:41 2022] POST /identity/v3/users => generated 292 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:17:41.998711 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6091039e-1ff6-42ec-9916-6e208f60f98a admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:17:42.010679 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6091039e-1ff6-42ec-9916-6e208f60f98a admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:17:42.017283 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c2b7e8-a2f9-42d7-8070-3663a900b1af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:17:42.018183 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c2b7e8-a2f9-42d7-8070-3663a900b1af admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:42.018482 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c2b7e8-a2f9-42d7-8070-3663a900b1af admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:42.018769 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c2b7e8-a2f9-42d7-8070-3663a900b1af admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:42.019514 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c2b7e8-a2f9-42d7-8070-3663a900b1af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:17:42.021122 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c2b7e8-a2f9-42d7-8070-3663a900b1af admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:17:42.032403 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1040/2081] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:17:41 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:17:42.036815 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6737b0-f080-4318-a9a2-2d4a72ce2d8a admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:17:42.046652 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6737b0-f080-4318-a9a2-2d4a72ce2d8a admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:17:42.052047 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d141d72-f774-4647-980d-eda3638c2777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:17:42.052800 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d141d72-f774-4647-980d-eda3638c2777 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:42.053085 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d141d72-f774-4647-980d-eda3638c2777 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:42.053359 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d141d72-f774-4647-980d-eda3638c2777 admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:42.054118 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d141d72-f774-4647-980d-eda3638c2777 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:17:42.055727 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d141d72-f774-4647-980d-eda3638c2777 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:17:42.069713 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1042/2082] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:17:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 10:17:42.074542 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c2b7e8-a2f9-42d7-8070-3663a900b1af admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:17:42.085876 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c2b7e8-a2f9-42d7-8070-3663a900b1af admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:17:42.090531 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6224bf4-1727-43d2-bc33-26cdce4eb27a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:17:42.091440 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6224bf4-1727-43d2-bc33-26cdce4eb27a admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:42.091722 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6224bf4-1727-43d2-bc33-26cdce4eb27a admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:42.091999 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6224bf4-1727-43d2-bc33-26cdce4eb27a admin admin] PATH_INFO: `/v3/projects/b5f802d381f34e99aa62d0db77c7efc9/users/ab0526eaef994522962244944a33e8f8/roles/9f88c83743f745a9a785a2f454753f06` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:42.108101 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6224bf4-1727-43d2-bc33-26cdce4eb27a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5f802d381f34e99aa62d0db77c7efc9, user_id=ab0526eaef994522962244944a33e8f8, role_id=9f88c83743f745a9a785a2f454753f06)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:17:42.110812 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6224bf4-1727-43d2-bc33-26cdce4eb27a admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:17:42.123685 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1041/2083] 10.222.0.43 () {60 vars in 1482 bytes} [Wed Jun 22 10:17:42 2022] PUT /identity/v3/projects/b5f802d381f34e99aa62d0db77c7efc9/users/ab0526eaef994522962244944a33e8f8/roles/9f88c83743f745a9a785a2f454753f06 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:17:42.134913 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a08efa-97ab-4699-b079-907bcc1eb47c None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:42.135209 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a08efa-97ab-4699-b079-907bcc1eb47c None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:42.135493 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a08efa-97ab-4699-b079-907bcc1eb47c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:42.163195 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-30a08efa-97ab-4699-b079-907bcc1eb47c None None] MFA Rules not processed for user `ab0526eaef994522962244944a33e8f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:17:42.164418 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-30a08efa-97ab-4699-b079-907bcc1eb47c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:17:42.208792 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:17:42.231845 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1043/2084] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:17:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:17:42.236315 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6224bf4-1727-43d2-bc33-26cdce4eb27a admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:17:42.305605 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6224bf4-1727-43d2-bc33-26cdce4eb27a admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:17:42.310307 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3610953d-e7ef-4c81-af2a-9a8abb93c6ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:17:42.310939 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3610953d-e7ef-4c81-af2a-9a8abb93c6ba admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:42.311223 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3610953d-e7ef-4c81-af2a-9a8abb93c6ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:42.312014 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3610953d-e7ef-4c81-af2a-9a8abb93c6ba admin admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:42.312196 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3610953d-e7ef-4c81-af2a-9a8abb93c6ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:17:42.315186 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3610953d-e7ef-4c81-af2a-9a8abb93c6ba admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:17:42.345505 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1042/2085] 10.222.0.43 () {60 vars in 1152 bytes} [Wed Jun 22 10:17:42 2022] POST /identity/v3/projects => generated 385 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 10:17:42.347250 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a08efa-97ab-4699-b079-907bcc1eb47c None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:17:42.358668 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a08efa-97ab-4699-b079-907bcc1eb47c None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:17:42.421544 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73138f2-4f90-4f84-8ca5-6017c92a542e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:17:42.422244 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73138f2-4f90-4f84-8ca5-6017c92a542e admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:42.422528 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73138f2-4f90-4f84-8ca5-6017c92a542e admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:42.422807 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73138f2-4f90-4f84-8ca5-6017c92a542e admin admin] PATH_INFO: `/v3/users` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:42.423531 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73138f2-4f90-4f84-8ca5-6017c92a542e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:17:42.425501 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73138f2-4f90-4f84-8ca5-6017c92a542e admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:17:42.446296 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1044/2086] 10.222.0.43 () {60 vars in 1143 bytes} [Wed Jun 22 10:17:42 2022] POST /identity/v3/users => generated 299 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:17:42.450265 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3610953d-e7ef-4c81-af2a-9a8abb93c6ba admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:17:42.461566 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3610953d-e7ef-4c81-af2a-9a8abb93c6ba admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:17:42.466597 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fb8014-bde3-43e6-91fa-888d75388422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:17:42.467378 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fb8014-bde3-43e6-91fa-888d75388422 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:42.467725 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fb8014-bde3-43e6-91fa-888d75388422 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:42.468048 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fb8014-bde3-43e6-91fa-888d75388422 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:42.468888 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fb8014-bde3-43e6-91fa-888d75388422 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:17:42.471286 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fb8014-bde3-43e6-91fa-888d75388422 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:17:42.483200 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1043/2087] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:17:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 10:17:42.487461 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73138f2-4f90-4f84-8ca5-6017c92a542e admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:17:42.497773 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73138f2-4f90-4f84-8ca5-6017c92a542e admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:17:42.511145 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d67154-15dd-4a98-b86b-a685fcc23f9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:17:42.512215 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d67154-15dd-4a98-b86b-a685fcc23f9d admin admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:42.512685 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d67154-15dd-4a98-b86b-a685fcc23f9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:42.512902 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d67154-15dd-4a98-b86b-a685fcc23f9d admin admin] PATH_INFO: `/v3/projects/0303ceb50a9945229456041e62b888a1/users/55aa0f195fcc4bb4bf2c5192cddd2257/roles/26d9c2ab5dfc4e6d9ca80c6014123906` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:42.530309 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d67154-15dd-4a98-b86b-a685fcc23f9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0303ceb50a9945229456041e62b888a1, user_id=55aa0f195fcc4bb4bf2c5192cddd2257, role_id=26d9c2ab5dfc4e6d9ca80c6014123906)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:17:42.533554 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d67154-15dd-4a98-b86b-a685fcc23f9d admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:17:42.550968 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1045/2088] 10.222.0.43 () {60 vars in 1482 bytes} [Wed Jun 22 10:17:42 2022] PUT /identity/v3/projects/0303ceb50a9945229456041e62b888a1/users/55aa0f195fcc4bb4bf2c5192cddd2257/roles/26d9c2ab5dfc4e6d9ca80c6014123906 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:17:42.554996 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fb8014-bde3-43e6-91fa-888d75388422 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:17:42.570279 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fb8014-bde3-43e6-91fa-888d75388422 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:17:42.578508 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:17:42.630318 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fb40b5-0578-47fe-9093-a4aa0e19c083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:17:42.630992 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fb40b5-0578-47fe-9093-a4aa0e19c083 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:42.631272 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fb40b5-0578-47fe-9093-a4aa0e19c083 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:42.631550 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fb40b5-0578-47fe-9093-a4aa0e19c083 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:42.632270 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fb40b5-0578-47fe-9093-a4aa0e19c083 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:17:42.633902 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fb40b5-0578-47fe-9093-a4aa0e19c083 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:17:42.644154 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1044/2089] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:17:42 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:17:42.648231 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d67154-15dd-4a98-b86b-a685fcc23f9d admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:17:42.659629 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d67154-15dd-4a98-b86b-a685fcc23f9d admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:17:42.664469 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10ec139-f71c-4d1a-bb54-ac4728c0f795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:17:42.665352 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10ec139-f71c-4d1a-bb54-ac4728c0f795 admin admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:42.665659 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10ec139-f71c-4d1a-bb54-ac4728c0f795 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:42.665968 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10ec139-f71c-4d1a-bb54-ac4728c0f795 admin admin] PATH_INFO: `/v3/projects/0303ceb50a9945229456041e62b888a1/users/55aa0f195fcc4bb4bf2c5192cddd2257/roles/26d9c2ab5dfc4e6d9ca80c6014123906` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:42.667929 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10ec139-f71c-4d1a-bb54-ac4728c0f795 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0303ceb50a9945229456041e62b888a1, user_id=55aa0f195fcc4bb4bf2c5192cddd2257, role_id=26d9c2ab5dfc4e6d9ca80c6014123906)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:17:42.670668 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10ec139-f71c-4d1a-bb54-ac4728c0f795 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:17:42.681161 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1046/2090] 10.222.0.43 () {60 vars in 1482 bytes} [Wed Jun 22 10:17:42 2022] PUT /identity/v3/projects/0303ceb50a9945229456041e62b888a1/users/55aa0f195fcc4bb4bf2c5192cddd2257/roles/26d9c2ab5dfc4e6d9ca80c6014123906 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:17:42.691779 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e317d3-1031-40d6-9ebe-b58335139a6a None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:42.692189 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e317d3-1031-40d6-9ebe-b58335139a6a None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:42.692488 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e317d3-1031-40d6-9ebe-b58335139a6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:42.721239 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-59e317d3-1031-40d6-9ebe-b58335139a6a None None] MFA Rules not processed for user `55aa0f195fcc4bb4bf2c5192cddd2257`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:17:42.722610 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-59e317d3-1031-40d6-9ebe-b58335139a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:17:42.804322 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1045/2091] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:17:42 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:17:42.816572 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10ec139-f71c-4d1a-bb54-ac4728c0f795 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:17:42.818361 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-f10ec139-f71c-4d1a-bb54-ac4728c0f795 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:17:42.879003 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10ec139-f71c-4d1a-bb54-ac4728c0f795 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:17:42.883549 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84b46d5-357f-4397-a7b6-102ca71bf4cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bbcb3d4dc704dfdb0097abc594ca855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:17:42.884216 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84b46d5-357f-4397-a7b6-102ca71bf4cc service cinder] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:42.884563 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84b46d5-357f-4397-a7b6-102ca71bf4cc service cinder] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:42.886407 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84b46d5-357f-4397-a7b6-102ca71bf4cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:42.961193 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:17:42.966081 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84b46d5-357f-4397-a7b6-102ca71bf4cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:17:42.968029 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84b46d5-357f-4397-a7b6-102ca71bf4cc service cinder] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:17:42.981799 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1047/2092] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:17:42 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:17:48.756943 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e317d3-1031-40d6-9ebe-b58335139a6a None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:17:48.766546 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e317d3-1031-40d6-9ebe-b58335139a6a None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:17:48.770670 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248bd2b8-fc71-4f01-af60-e9a589c4bab0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bbcb3d4dc704dfdb0097abc594ca855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:17:48.771309 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248bd2b8-fc71-4f01-af60-e9a589c4bab0 service cinder] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:48.771593 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248bd2b8-fc71-4f01-af60-e9a589c4bab0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:48.771898 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248bd2b8-fc71-4f01-af60-e9a589c4bab0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:48.830577 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248bd2b8-fc71-4f01-af60-e9a589c4bab0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:17:48.831549 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248bd2b8-fc71-4f01-af60-e9a589c4bab0 service cinder] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:17:48.840421 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1046/2093] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:17:48 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:17:51.526410 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84b46d5-357f-4397-a7b6-102ca71bf4cc service cinder] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:17:51.535163 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84b46d5-357f-4397-a7b6-102ca71bf4cc service cinder] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:17:51.538734 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba19edc-5b3a-44a8-8edd-096561538eae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bbcb3d4dc704dfdb0097abc594ca855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:17:51.539371 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba19edc-5b3a-44a8-8edd-096561538eae service cinder] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:51.539658 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba19edc-5b3a-44a8-8edd-096561538eae service cinder] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:51.539938 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba19edc-5b3a-44a8-8edd-096561538eae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:51.548790 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba19edc-5b3a-44a8-8edd-096561538eae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:17:51.550316 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba19edc-5b3a-44a8-8edd-096561538eae service cinder] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:17:51.559792 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1048/2094] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:17:51 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:17:56.752546 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248bd2b8-fc71-4f01-af60-e9a589c4bab0 service cinder] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:17:56.754309 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-248bd2b8-fc71-4f01-af60-e9a589c4bab0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:17:56.799743 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:17:56.849474 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248bd2b8-fc71-4f01-af60-e9a589c4bab0 service cinder] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:17:56.856989 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a8cbfc-d75e-41a8-a16f-7e1ba5f9b070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:17:56.858479 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a8cbfc-d75e-41a8-a16f-7e1ba5f9b070 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:56.858961 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a8cbfc-d75e-41a8-a16f-7e1ba5f9b070 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:56.859438 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a8cbfc-d75e-41a8-a16f-7e1ba5f9b070 admin admin] PATH_INFO: `/v3/users/3ccdba6fa3d34874aa2e16c6dc52b0c3` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:56.861908 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a8cbfc-d75e-41a8-a16f-7e1ba5f9b070 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ccdba6fa3d34874aa2e16c6dc52b0c3)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:17:56.865606 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a8cbfc-d75e-41a8-a16f-7e1ba5f9b070 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:17:56.921829 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-10a8cbfc-d75e-41a8-a16f-7e1ba5f9b070 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ccdba6fa3d34874aa2e16c6dc52b0c3'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:17:56.930652 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-10a8cbfc-d75e-41a8-a16f-7e1ba5f9b070 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ccdba6fa3d34874aa2e16c6dc52b0c3'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:17:56.938397 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-10a8cbfc-d75e-41a8-a16f-7e1ba5f9b070 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ccdba6fa3d34874aa2e16c6dc52b0c3'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:17:56.939190 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-10a8cbfc-d75e-41a8-a16f-7e1ba5f9b070 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ccdba6fa3d34874aa2e16c6dc52b0c3'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:17:56.947794 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-10a8cbfc-d75e-41a8-a16f-7e1ba5f9b070 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ccdba6fa3d34874aa2e16c6dc52b0c3'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:17:56.954043 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1047/2095] 10.222.0.43 () {58 vars in 1223 bytes} [Wed Jun 22 10:17:56 2022] DELETE /identity/v3/users/3ccdba6fa3d34874aa2e16c6dc52b0c3 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:17:56.958464 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35ff8b2-81f3-4bc7-8e67-c0a25cb3bb54 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:56.958928 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35ff8b2-81f3-4bc7-8e67-c0a25cb3bb54 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:56.959109 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35ff8b2-81f3-4bc7-8e67-c0a25cb3bb54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:56.976111 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-e35ff8b2-81f3-4bc7-8e67-c0a25cb3bb54 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:17:56.977482 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-e35ff8b2-81f3-4bc7-8e67-c0a25cb3bb54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:17:57.039824 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1049/2096] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:17:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:17:57.049830 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a8cbfc-d75e-41a8-a16f-7e1ba5f9b070 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:17:57.051222 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-10a8cbfc-d75e-41a8-a16f-7e1ba5f9b070 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:17:57.123920 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a8cbfc-d75e-41a8-a16f-7e1ba5f9b070 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:17:57.127681 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29336a0-81bd-4133-9d30-c5639b7fc9a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe93d4c0737249fd8623bb5ce188e34e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:17:57.128325 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29336a0-81bd-4133-9d30-c5639b7fc9a1 service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:57.128608 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29336a0-81bd-4133-9d30-c5639b7fc9a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:57.128885 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29336a0-81bd-4133-9d30-c5639b7fc9a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:57.138146 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29336a0-81bd-4133-9d30-c5639b7fc9a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:17:57.139602 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29336a0-81bd-4133-9d30-c5639b7fc9a1 service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:17:57.150613 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1048/2097] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:17:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 10:17:57.427982 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35ff8b2-81f3-4bc7-8e67-c0a25cb3bb54 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:17:57.429394 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-e35ff8b2-81f3-4bc7-8e67-c0a25cb3bb54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:17:57.441950 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35ff8b2-81f3-4bc7-8e67-c0a25cb3bb54 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:17:57.446769 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bac655-a2fd-4230-9f41-b2464c7dd6df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:17:57.447631 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bac655-a2fd-4230-9f41-b2464c7dd6df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:57.447910 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bac655-a2fd-4230-9f41-b2464c7dd6df admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:57.448330 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bac655-a2fd-4230-9f41-b2464c7dd6df admin admin] PATH_INFO: `/v3/projects/b449c78f478c4f9197697009d40790df` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:57.449655 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bac655-a2fd-4230-9f41-b2464c7dd6df admin admin] RBAC: Authorizing `identity:delete_project(project_id=b449c78f478c4f9197697009d40790df)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:17:57.451601 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bac655-a2fd-4230-9f41-b2464c7dd6df admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:17:57.528661 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-b1bac655-a2fd-4230-9f41-b2464c7dd6df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b449c78f478c4f9197697009d40790df', 'request_id': 'req-b1bac655-a2fd-4230-9f41-b2464c7dd6df'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:17:57.538471 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-b1bac655-a2fd-4230-9f41-b2464c7dd6df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b449c78f478c4f9197697009d40790df', 'request_id': 'req-b1bac655-a2fd-4230-9f41-b2464c7dd6df'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:17:57.545244 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-b1bac655-a2fd-4230-9f41-b2464c7dd6df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b449c78f478c4f9197697009d40790df', 'request_id': 'req-b1bac655-a2fd-4230-9f41-b2464c7dd6df'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:17:57.560175 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-b1bac655-a2fd-4230-9f41-b2464c7dd6df admin admin] The token cache is being invalidate because project b449c78f478c4f9197697009d40790df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:17:57.560454 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-b1bac655-a2fd-4230-9f41-b2464c7dd6df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:17:57.561102 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-b1bac655-a2fd-4230-9f41-b2464c7dd6df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:17:57.562852 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1050/2098] 10.222.0.43 () {58 vars in 1232 bytes} [Wed Jun 22 10:17:57 2022] DELETE /identity/v3/projects/b449c78f478c4f9197697009d40790df => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:17:57.567370 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29336a0-81bd-4133-9d30-c5639b7fc9a1 service neutron] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:17:57.582305 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29336a0-81bd-4133-9d30-c5639b7fc9a1 service neutron] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:17:57.583460 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bac655-a2fd-4230-9f41-b2464c7dd6df admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:17:57.585013 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-b1bac655-a2fd-4230-9f41-b2464c7dd6df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:17:57.649639 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:17:57.666101 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f836bc-720c-48a9-a400-3c93f4de1b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:17:57.667486 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f836bc-720c-48a9-a400-3c93f4de1b54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:57.667869 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f836bc-720c-48a9-a400-3c93f4de1b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:57.668226 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f836bc-720c-48a9-a400-3c93f4de1b54 admin admin] PATH_INFO: `/v3/users/e64138e4dd9e4d889fa4029a5d4ee1cc` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:57.671136 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f836bc-720c-48a9-a400-3c93f4de1b54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e64138e4dd9e4d889fa4029a5d4ee1cc)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:17:57.673255 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f836bc-720c-48a9-a400-3c93f4de1b54 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:17:57.682079 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bac655-a2fd-4230-9f41-b2464c7dd6df admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:17:57.691178 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbd4af9-2825-44b5-a5d9-e414a8dba4c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:17:57.692292 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbd4af9-2825-44b5-a5d9-e414a8dba4c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:57.692630 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbd4af9-2825-44b5-a5d9-e414a8dba4c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:57.692991 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbd4af9-2825-44b5-a5d9-e414a8dba4c5 admin admin] PATH_INFO: `/v3/users/161166e5341b45dcaabcb6b4909dbb94` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:57.694527 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbd4af9-2825-44b5-a5d9-e414a8dba4c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=161166e5341b45dcaabcb6b4909dbb94)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:17:57.696883 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbd4af9-2825-44b5-a5d9-e414a8dba4c5 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:17:57.702551 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:17:57.747491 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-f8f836bc-720c-48a9-a400-3c93f4de1b54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e64138e4dd9e4d889fa4029a5d4ee1cc'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:17:57.764354 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-f8f836bc-720c-48a9-a400-3c93f4de1b54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e64138e4dd9e4d889fa4029a5d4ee1cc'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:17:57.769764 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-5fbd4af9-2825-44b5-a5d9-e414a8dba4c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '161166e5341b45dcaabcb6b4909dbb94'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:17:57.772753 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-f8f836bc-720c-48a9-a400-3c93f4de1b54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e64138e4dd9e4d889fa4029a5d4ee1cc'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:17:57.773478 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-f8f836bc-720c-48a9-a400-3c93f4de1b54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e64138e4dd9e4d889fa4029a5d4ee1cc'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:17:57.782307 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-f8f836bc-720c-48a9-a400-3c93f4de1b54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e64138e4dd9e4d889fa4029a5d4ee1cc'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:17:57.786014 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-5fbd4af9-2825-44b5-a5d9-e414a8dba4c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '161166e5341b45dcaabcb6b4909dbb94'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:17:57.790349 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1049/2099] 10.222.0.43 () {58 vars in 1223 bytes} [Wed Jun 22 10:17:57 2022] DELETE /identity/v3/users/e64138e4dd9e4d889fa4029a5d4ee1cc => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:17:57.795651 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-5fbd4af9-2825-44b5-a5d9-e414a8dba4c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '161166e5341b45dcaabcb6b4909dbb94'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:17:57.804132 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-5fbd4af9-2825-44b5-a5d9-e414a8dba4c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '161166e5341b45dcaabcb6b4909dbb94'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:17:57.804943 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-5fbd4af9-2825-44b5-a5d9-e414a8dba4c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '161166e5341b45dcaabcb6b4909dbb94'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:17:57.811612 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1051/2100] 10.222.0.43 () {58 vars in 1223 bytes} [Wed Jun 22 10:17:57 2022] DELETE /identity/v3/users/161166e5341b45dcaabcb6b4909dbb94 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:17:57.816845 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf09971c-e820-48be-bd6f-a2c694649e2e None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:57.817136 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf09971c-e820-48be-bd6f-a2c694649e2e None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:57.817413 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf09971c-e820-48be-bd6f-a2c694649e2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:57.835211 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-bf09971c-e820-48be-bd6f-a2c694649e2e None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:17:57.836418 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-bf09971c-e820-48be-bd6f-a2c694649e2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:17:57.904521 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1050/2101] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:17:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:17:57.914430 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbd4af9-2825-44b5-a5d9-e414a8dba4c5 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:17:57.915945 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-5fbd4af9-2825-44b5-a5d9-e414a8dba4c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:17:57.988964 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbd4af9-2825-44b5-a5d9-e414a8dba4c5 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:17:57.993086 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea64236-fa4b-41bd-85dd-c67816a00ce4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe93d4c0737249fd8623bb5ce188e34e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:17:57.993899 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea64236-fa4b-41bd-85dd-c67816a00ce4 service neutron] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:57.994244 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea64236-fa4b-41bd-85dd-c67816a00ce4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:57.994588 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea64236-fa4b-41bd-85dd-c67816a00ce4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:58.005232 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea64236-fa4b-41bd-85dd-c67816a00ce4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:17:58.006745 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea64236-fa4b-41bd-85dd-c67816a00ce4 service neutron] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:17:58.018037 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1052/2102] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:17:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:17:58.127722 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf09971c-e820-48be-bd6f-a2c694649e2e None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:17:58.129433 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-bf09971c-e820-48be-bd6f-a2c694649e2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:17:58.148581 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf09971c-e820-48be-bd6f-a2c694649e2e None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:17:58.155175 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7b3cb5-38df-4558-a44c-cd899e9ab7d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:17:58.156382 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7b3cb5-38df-4558-a44c-cd899e9ab7d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:58.156825 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7b3cb5-38df-4558-a44c-cd899e9ab7d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:58.157265 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7b3cb5-38df-4558-a44c-cd899e9ab7d6 admin admin] PATH_INFO: `/v3/projects/ce7015957dda4c61bb5fe32b0ebe3b4d` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:58.159236 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7b3cb5-38df-4558-a44c-cd899e9ab7d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce7015957dda4c61bb5fe32b0ebe3b4d)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:17:58.161623 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7b3cb5-38df-4558-a44c-cd899e9ab7d6 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:17:58.225087 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-ee7b3cb5-38df-4558-a44c-cd899e9ab7d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce7015957dda4c61bb5fe32b0ebe3b4d', 'request_id': 'req-ee7b3cb5-38df-4558-a44c-cd899e9ab7d6'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:17:58.231367 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-ee7b3cb5-38df-4558-a44c-cd899e9ab7d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce7015957dda4c61bb5fe32b0ebe3b4d', 'request_id': 'req-ee7b3cb5-38df-4558-a44c-cd899e9ab7d6'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:17:58.240693 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-ee7b3cb5-38df-4558-a44c-cd899e9ab7d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce7015957dda4c61bb5fe32b0ebe3b4d', 'request_id': 'req-ee7b3cb5-38df-4558-a44c-cd899e9ab7d6'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:17:58.244182 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:17:58.257953 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-ee7b3cb5-38df-4558-a44c-cd899e9ab7d6 admin admin] The token cache is being invalidate because project ce7015957dda4c61bb5fe32b0ebe3b4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:17:58.258386 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-ee7b3cb5-38df-4558-a44c-cd899e9ab7d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:17:58.259155 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-ee7b3cb5-38df-4558-a44c-cd899e9ab7d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:17:58.261207 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1051/2103] 10.222.0.43 () {58 vars in 1232 bytes} [Wed Jun 22 10:17:58 2022] DELETE /identity/v3/projects/ce7015957dda4c61bb5fe32b0ebe3b4d => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:17:58.266745 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4b15b5-fb2b-4998-801b-a8dfefef21bb None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:58.267160 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4b15b5-fb2b-4998-801b-a8dfefef21bb None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:58.267548 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4b15b5-fb2b-4998-801b-a8dfefef21bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:58.287823 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-3e4b15b5-fb2b-4998-801b-a8dfefef21bb None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:17:58.289041 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-3e4b15b5-fb2b-4998-801b-a8dfefef21bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:17:58.352477 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1053/2104] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:17:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:17:58.357953 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7b3cb5-38df-4558-a44c-cd899e9ab7d6 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:17:58.359499 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-ee7b3cb5-38df-4558-a44c-cd899e9ab7d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:17:58.361130 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f98092-7137-4492-aa8f-b06b65c1d36a None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:58.361541 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f98092-7137-4492-aa8f-b06b65c1d36a None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:58.361902 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f98092-7137-4492-aa8f-b06b65c1d36a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:58.379687 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7b3cb5-38df-4558-a44c-cd899e9ab7d6 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:17:58.382402 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-a8f98092-7137-4492-aa8f-b06b65c1d36a None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:17:58.383720 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-a8f98092-7137-4492-aa8f-b06b65c1d36a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:17:58.385410 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2665bab5-d442-45bc-8ab0-91f2279d5ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:17:58.386443 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2665bab5-d442-45bc-8ab0-91f2279d5ab9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:58.391652 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1054/2105] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:17:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:17:58.396445 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2665bab5-d442-45bc-8ab0-91f2279d5ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:58.396815 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2665bab5-d442-45bc-8ab0-91f2279d5ab9 admin admin] PATH_INFO: `/v3/projects/2b819c960da9410c942cf0562c067750` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:58.397922 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f98092-7137-4492-aa8f-b06b65c1d36a None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:17:58.398158 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2665bab5-d442-45bc-8ab0-91f2279d5ab9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b819c960da9410c942cf0562c067750)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:17:58.400132 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2665bab5-d442-45bc-8ab0-91f2279d5ab9 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:17:58.406982 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f98092-7137-4492-aa8f-b06b65c1d36a None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:17:58.412330 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c4d511-28ef-4b86-993c-14a03a796a05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:17:58.412983 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c4d511-28ef-4b86-993c-14a03a796a05 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:58.413275 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c4d511-28ef-4b86-993c-14a03a796a05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:58.413548 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c4d511-28ef-4b86-993c-14a03a796a05 admin admin] PATH_INFO: `/v3/domains` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:58.414322 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c4d511-28ef-4b86-993c-14a03a796a05 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:17:58.414626 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c4d511-28ef-4b86-993c-14a03a796a05 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:17:58.416228 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c4d511-28ef-4b86-993c-14a03a796a05 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:17:58.430184 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1055/2106] 10.222.0.43 () {58 vars in 1152 bytes} [Wed Jun 22 10:17:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:17:58.435292 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c4d511-28ef-4b86-993c-14a03a796a05 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:17:58.448127 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c4d511-28ef-4b86-993c-14a03a796a05 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:17:58.450645 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-2665bab5-d442-45bc-8ab0-91f2279d5ab9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b819c960da9410c942cf0562c067750', 'request_id': 'req-2665bab5-d442-45bc-8ab0-91f2279d5ab9'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:17:58.452650 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:17:58.460799 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-2665bab5-d442-45bc-8ab0-91f2279d5ab9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b819c960da9410c942cf0562c067750', 'request_id': 'req-2665bab5-d442-45bc-8ab0-91f2279d5ab9'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:17:58.469915 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-2665bab5-d442-45bc-8ab0-91f2279d5ab9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b819c960da9410c942cf0562c067750', 'request_id': 'req-2665bab5-d442-45bc-8ab0-91f2279d5ab9'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:17:58.487414 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-2665bab5-d442-45bc-8ab0-91f2279d5ab9 admin admin] The token cache is being invalidate because project 2b819c960da9410c942cf0562c067750 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:17:58.488021 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-2665bab5-d442-45bc-8ab0-91f2279d5ab9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:17:58.489198 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-2665bab5-d442-45bc-8ab0-91f2279d5ab9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:17:58.491025 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1052/2107] 10.222.0.43 () {58 vars in 1232 bytes} [Wed Jun 22 10:17:58 2022] DELETE /identity/v3/projects/2b819c960da9410c942cf0562c067750 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:17:58.495561 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2665bab5-d442-45bc-8ab0-91f2279d5ab9 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:17:58.497168 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-2665bab5-d442-45bc-8ab0-91f2279d5ab9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:17:58.527502 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf623dce-045e-4b5e-a62e-aba464950d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:17:58.528175 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf623dce-045e-4b5e-a62e-aba464950d93 admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:58.528471 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf623dce-045e-4b5e-a62e-aba464950d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:58.528746 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf623dce-045e-4b5e-a62e-aba464950d93 admin admin] PATH_INFO: `/v3/projects` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:58.529448 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf623dce-045e-4b5e-a62e-aba464950d93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:17:58.531584 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf623dce-045e-4b5e-a62e-aba464950d93 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:17:58.567361 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1056/2108] 10.222.0.43 () {60 vars in 1152 bytes} [Wed Jun 22 10:17:58 2022] POST /identity/v3/projects => generated 365 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 10:17:58.568399 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf623dce-045e-4b5e-a62e-aba464950d93 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:17:58.570760 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-bf623dce-045e-4b5e-a62e-aba464950d93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:17:58.573149 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2665bab5-d442-45bc-8ab0-91f2279d5ab9 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:17:58.642895 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd708a7-1db9-4594-8d1a-02d2715b2d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:17:58.643853 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd708a7-1db9-4594-8d1a-02d2715b2d38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:58.644140 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd708a7-1db9-4594-8d1a-02d2715b2d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:58.644425 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd708a7-1db9-4594-8d1a-02d2715b2d38 admin admin] PATH_INFO: `/v3/users/ab0526eaef994522962244944a33e8f8` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:58.645668 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd708a7-1db9-4594-8d1a-02d2715b2d38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab0526eaef994522962244944a33e8f8)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:17:58.647757 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd708a7-1db9-4594-8d1a-02d2715b2d38 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:17:58.659948 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf623dce-045e-4b5e-a62e-aba464950d93 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:17:58.665849 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c01853d-d0c2-43ac-9572-5540565eb743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:17:58.666540 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c01853d-d0c2-43ac-9572-5540565eb743 admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:58.666771 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c01853d-d0c2-43ac-9572-5540565eb743 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:58.667053 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c01853d-d0c2-43ac-9572-5540565eb743 admin admin] PATH_INFO: `/v3/users` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:58.667961 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c01853d-d0c2-43ac-9572-5540565eb743 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:17:58.669891 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c01853d-d0c2-43ac-9572-5540565eb743 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:17:58.688943 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:17:58.701733 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1057/2109] 10.222.0.43 () {60 vars in 1143 bytes} [Wed Jun 22 10:17:58 2022] POST /identity/v3/users => generated 283 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:17:58.706028 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c01853d-d0c2-43ac-9572-5540565eb743 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:17:58.717424 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-0fd708a7-1db9-4594-8d1a-02d2715b2d38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab0526eaef994522962244944a33e8f8'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:17:58.717939 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c01853d-d0c2-43ac-9572-5540565eb743 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:17:58.723711 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22608d3-a7ec-4871-90d6-0461e33c891e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:17:58.724589 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22608d3-a7ec-4871-90d6-0461e33c891e admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:58.725055 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22608d3-a7ec-4871-90d6-0461e33c891e admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:58.725344 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22608d3-a7ec-4871-90d6-0461e33c891e admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:58.726317 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22608d3-a7ec-4871-90d6-0461e33c891e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:17:58.727953 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22608d3-a7ec-4871-90d6-0461e33c891e admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:17:58.734481 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-0fd708a7-1db9-4594-8d1a-02d2715b2d38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab0526eaef994522962244944a33e8f8'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:17:58.740244 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1058/2110] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:17:58 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:17:58.744192 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22608d3-a7ec-4871-90d6-0461e33c891e admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:17:58.744713 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-0fd708a7-1db9-4594-8d1a-02d2715b2d38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab0526eaef994522962244944a33e8f8'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:17:58.745912 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-0fd708a7-1db9-4594-8d1a-02d2715b2d38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab0526eaef994522962244944a33e8f8'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:17:58.754534 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-0fd708a7-1db9-4594-8d1a-02d2715b2d38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab0526eaef994522962244944a33e8f8'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:17:58.755131 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22608d3-a7ec-4871-90d6-0461e33c891e admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:17:58.760217 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dbb899-0eec-46c3-8667-d931df97a2d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:17:58.760881 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dbb899-0eec-46c3-8667-d931df97a2d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:58.761170 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dbb899-0eec-46c3-8667-d931df97a2d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:58.761452 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dbb899-0eec-46c3-8667-d931df97a2d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:58.762225 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dbb899-0eec-46c3-8667-d931df97a2d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:17:58.763145 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1053/2111] 10.222.0.43 () {58 vars in 1223 bytes} [Wed Jun 22 10:17:58 2022] DELETE /identity/v3/users/ab0526eaef994522962244944a33e8f8 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:17:58.763834 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dbb899-0eec-46c3-8667-d931df97a2d3 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:17:58.774496 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1059/2112] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:17:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 10:17:58.779156 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd708a7-1db9-4594-8d1a-02d2715b2d38 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:17:58.781004 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-0fd708a7-1db9-4594-8d1a-02d2715b2d38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:17:58.888009 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd708a7-1db9-4594-8d1a-02d2715b2d38 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:17:58.893617 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2769dcb7-bfb8-4472-a9e4-272bc871d7c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:17:58.894574 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2769dcb7-bfb8-4472-a9e4-272bc871d7c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:58.895161 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2769dcb7-bfb8-4472-a9e4-272bc871d7c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:58.895713 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2769dcb7-bfb8-4472-a9e4-272bc871d7c5 admin admin] PATH_INFO: `/v3/projects/3f5cbc2438bc4a6db7b0173bfc7b77d6/users/babe16661a5943ad9e5f84b5dbe64feb/roles/9f88c83743f745a9a785a2f454753f06` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:58.914722 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2769dcb7-bfb8-4472-a9e4-272bc871d7c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f5cbc2438bc4a6db7b0173bfc7b77d6, user_id=babe16661a5943ad9e5f84b5dbe64feb, role_id=9f88c83743f745a9a785a2f454753f06)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:17:58.917857 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2769dcb7-bfb8-4472-a9e4-272bc871d7c5 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:17:58.935621 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1054/2113] 10.222.0.43 () {60 vars in 1482 bytes} [Wed Jun 22 10:17:58 2022] PUT /identity/v3/projects/3f5cbc2438bc4a6db7b0173bfc7b77d6/users/babe16661a5943ad9e5f84b5dbe64feb/roles/9f88c83743f745a9a785a2f454753f06 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:17:58.946536 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a890dbb-827d-440a-8a0e-e812cf894f9d None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:58.947122 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a890dbb-827d-440a-8a0e-e812cf894f9d None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:58.947498 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a890dbb-827d-440a-8a0e-e812cf894f9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:58.980710 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-7a890dbb-827d-440a-8a0e-e812cf894f9d None None] MFA Rules not processed for user `babe16661a5943ad9e5f84b5dbe64feb`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:17:58.983018 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-7a890dbb-827d-440a-8a0e-e812cf894f9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:17:59.044070 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:17:59.075197 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1060/2114] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:17:58 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:17:59.080357 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2769dcb7-bfb8-4472-a9e4-272bc871d7c5 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:17:59.177918 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2769dcb7-bfb8-4472-a9e4-272bc871d7c5 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:17:59.185055 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e52459-93b9-4acc-a6b1-acdbfc65d578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:17:59.185599 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e52459-93b9-4acc-a6b1-acdbfc65d578 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:59.185929 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e52459-93b9-4acc-a6b1-acdbfc65d578 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:59.186290 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e52459-93b9-4acc-a6b1-acdbfc65d578 admin admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:59.187059 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e52459-93b9-4acc-a6b1-acdbfc65d578 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:17:59.189131 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e52459-93b9-4acc-a6b1-acdbfc65d578 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:17:59.219448 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1055/2115] 10.222.0.43 () {60 vars in 1152 bytes} [Wed Jun 22 10:17:59 2022] POST /identity/v3/projects => generated 365 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:17:59.223382 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a890dbb-827d-440a-8a0e-e812cf894f9d None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:17:59.226633 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e52459-93b9-4acc-a6b1-acdbfc65d578 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:17:59.228542 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-c0e52459-93b9-4acc-a6b1-acdbfc65d578 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:17:59.234723 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a890dbb-827d-440a-8a0e-e812cf894f9d None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:17:59.253234 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:17:59.308448 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba554aa-355b-46c2-acef-eeffd43f30ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:17:59.309140 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba554aa-355b-46c2-acef-eeffd43f30ed admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:59.309431 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba554aa-355b-46c2-acef-eeffd43f30ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:59.309739 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba554aa-355b-46c2-acef-eeffd43f30ed admin admin] PATH_INFO: `/v3/users` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:59.310591 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba554aa-355b-46c2-acef-eeffd43f30ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:17:59.312414 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba554aa-355b-46c2-acef-eeffd43f30ed admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:17:59.318659 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e52459-93b9-4acc-a6b1-acdbfc65d578 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:17:59.323649 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96f4e18-5fac-4838-bb96-4b795f991f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:17:59.324474 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96f4e18-5fac-4838-bb96-4b795f991f00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:59.324756 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96f4e18-5fac-4838-bb96-4b795f991f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:59.325034 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96f4e18-5fac-4838-bb96-4b795f991f00 admin admin] PATH_INFO: `/v3/projects/b5f802d381f34e99aa62d0db77c7efc9` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:59.326253 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96f4e18-5fac-4838-bb96-4b795f991f00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5f802d381f34e99aa62d0db77c7efc9)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:17:59.328298 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96f4e18-5fac-4838-bb96-4b795f991f00 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:17:59.341748 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1061/2116] 10.222.0.43 () {60 vars in 1143 bytes} [Wed Jun 22 10:17:59 2022] POST /identity/v3/users => generated 289 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:17:59.343970 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba554aa-355b-46c2-acef-eeffd43f30ed admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:17:59.356321 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba554aa-355b-46c2-acef-eeffd43f30ed admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:17:59.362483 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2b747f-5209-4cd8-b90a-3a24d3a0e7a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:17:59.363345 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2b747f-5209-4cd8-b90a-3a24d3a0e7a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:59.363639 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2b747f-5209-4cd8-b90a-3a24d3a0e7a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:59.363931 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2b747f-5209-4cd8-b90a-3a24d3a0e7a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:59.364918 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2b747f-5209-4cd8-b90a-3a24d3a0e7a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:17:59.366761 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2b747f-5209-4cd8-b90a-3a24d3a0e7a2 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:17:59.381817 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1062/2117] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:17:59 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 10:17:59.383623 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2b747f-5209-4cd8-b90a-3a24d3a0e7a2 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:17:59.389656 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-b96f4e18-5fac-4838-bb96-4b795f991f00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5f802d381f34e99aa62d0db77c7efc9', 'request_id': 'req-b96f4e18-5fac-4838-bb96-4b795f991f00'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:17:59.397365 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-b96f4e18-5fac-4838-bb96-4b795f991f00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5f802d381f34e99aa62d0db77c7efc9', 'request_id': 'req-b96f4e18-5fac-4838-bb96-4b795f991f00'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:17:59.399578 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2b747f-5209-4cd8-b90a-3a24d3a0e7a2 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:17:59.406477 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-b96f4e18-5fac-4838-bb96-4b795f991f00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5f802d381f34e99aa62d0db77c7efc9', 'request_id': 'req-b96f4e18-5fac-4838-bb96-4b795f991f00'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:17:59.421059 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-b96f4e18-5fac-4838-bb96-4b795f991f00 admin admin] The token cache is being invalidate because project b5f802d381f34e99aa62d0db77c7efc9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:17:59.421279 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-b96f4e18-5fac-4838-bb96-4b795f991f00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:17:59.422892 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-b96f4e18-5fac-4838-bb96-4b795f991f00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:17:59.424052 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1056/2118] 10.222.0.43 () {58 vars in 1232 bytes} [Wed Jun 22 10:17:59 2022] DELETE /identity/v3/projects/b5f802d381f34e99aa62d0db77c7efc9 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:17:59.429648 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96f4e18-5fac-4838-bb96-4b795f991f00 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:17:59.431099 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-b96f4e18-5fac-4838-bb96-4b795f991f00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:17:59.468901 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514ae343-8d31-4942-9965-6e36f0c67594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:17:59.469903 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514ae343-8d31-4942-9965-6e36f0c67594 admin admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:59.470126 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514ae343-8d31-4942-9965-6e36f0c67594 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:59.470438 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514ae343-8d31-4942-9965-6e36f0c67594 admin admin] PATH_INFO: `/v3/projects/58d6b7614e194b4e9553e17dd53cff11/users/cee5cfb48cc34c90bfbfd773a37a756a/roles/26d9c2ab5dfc4e6d9ca80c6014123906` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:59.491564 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514ae343-8d31-4942-9965-6e36f0c67594 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58d6b7614e194b4e9553e17dd53cff11, user_id=cee5cfb48cc34c90bfbfd773a37a756a, role_id=26d9c2ab5dfc4e6d9ca80c6014123906)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:17:59.494572 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514ae343-8d31-4942-9965-6e36f0c67594 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:17:59.514300 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1063/2119] 10.222.0.43 () {60 vars in 1482 bytes} [Wed Jun 22 10:17:59 2022] PUT /identity/v3/projects/58d6b7614e194b4e9553e17dd53cff11/users/cee5cfb48cc34c90bfbfd773a37a756a/roles/26d9c2ab5dfc4e6d9ca80c6014123906 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:17:59.514883 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96f4e18-5fac-4838-bb96-4b795f991f00 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:17:59.518750 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514ae343-8d31-4942-9965-6e36f0c67594 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:17:59.520722 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-514ae343-8d31-4942-9965-6e36f0c67594 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:17:59.581043 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:17:59.593887 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:17:59.594029 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3e5bfc-3bf8-401d-b54a-d30d59a5c16c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:17:59.594987 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3e5bfc-3bf8-401d-b54a-d30d59a5c16c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:59.595943 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3e5bfc-3bf8-401d-b54a-d30d59a5c16c admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:59.596653 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3e5bfc-3bf8-401d-b54a-d30d59a5c16c admin admin] PATH_INFO: `/v3/users/55aa0f195fcc4bb4bf2c5192cddd2257` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:59.598514 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3e5bfc-3bf8-401d-b54a-d30d59a5c16c admin admin] RBAC: Authorizing `identity:delete_user(user_id=55aa0f195fcc4bb4bf2c5192cddd2257)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:17:59.600616 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3e5bfc-3bf8-401d-b54a-d30d59a5c16c admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:17:59.614791 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514ae343-8d31-4942-9965-6e36f0c67594 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:17:59.623044 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b2fc11-377b-49fa-a6dd-6494b224aa0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:17:59.623727 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b2fc11-377b-49fa-a6dd-6494b224aa0a admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:59.624063 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b2fc11-377b-49fa-a6dd-6494b224aa0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:59.624342 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b2fc11-377b-49fa-a6dd-6494b224aa0a admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:59.625565 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b2fc11-377b-49fa-a6dd-6494b224aa0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:17:59.627730 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b2fc11-377b-49fa-a6dd-6494b224aa0a admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:17:59.646129 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1064/2120] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:17:59 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 10:17:59.647091 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b2fc11-377b-49fa-a6dd-6494b224aa0a admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:17:59.660590 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b2fc11-377b-49fa-a6dd-6494b224aa0a admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:17:59.666011 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2c0623-a594-454b-8400-68aa81ed0b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:17:59.666737 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2c0623-a594-454b-8400-68aa81ed0b53 admin admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:59.667050 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2c0623-a594-454b-8400-68aa81ed0b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:59.667380 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2c0623-a594-454b-8400-68aa81ed0b53 admin admin] PATH_INFO: `/v3/projects/58d6b7614e194b4e9553e17dd53cff11/users/cee5cfb48cc34c90bfbfd773a37a756a/roles/26d9c2ab5dfc4e6d9ca80c6014123906` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:59.669553 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2c0623-a594-454b-8400-68aa81ed0b53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58d6b7614e194b4e9553e17dd53cff11, user_id=cee5cfb48cc34c90bfbfd773a37a756a, role_id=26d9c2ab5dfc4e6d9ca80c6014123906)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:17:59.670948 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-2d3e5bfc-3bf8-401d-b54a-d30d59a5c16c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55aa0f195fcc4bb4bf2c5192cddd2257'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:17:59.672685 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2c0623-a594-454b-8400-68aa81ed0b53 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:17:59.685835 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-2d3e5bfc-3bf8-401d-b54a-d30d59a5c16c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55aa0f195fcc4bb4bf2c5192cddd2257'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:17:59.686314 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1065/2121] 10.222.0.43 () {60 vars in 1482 bytes} [Wed Jun 22 10:17:59 2022] PUT /identity/v3/projects/58d6b7614e194b4e9553e17dd53cff11/users/cee5cfb48cc34c90bfbfd773a37a756a/roles/26d9c2ab5dfc4e6d9ca80c6014123906 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:17:59.698804 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-2d3e5bfc-3bf8-401d-b54a-d30d59a5c16c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55aa0f195fcc4bb4bf2c5192cddd2257'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:17:59.698993 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0395d4-c9a9-4748-9bfc-c729f4266337 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:59.699282 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0395d4-c9a9-4748-9bfc-c729f4266337 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:59.699615 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0395d4-c9a9-4748-9bfc-c729f4266337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:59.700200 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-2d3e5bfc-3bf8-401d-b54a-d30d59a5c16c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55aa0f195fcc4bb4bf2c5192cddd2257'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:17:59.710988 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-2d3e5bfc-3bf8-401d-b54a-d30d59a5c16c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55aa0f195fcc4bb4bf2c5192cddd2257'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:17:59.719040 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1057/2122] 10.222.0.43 () {58 vars in 1223 bytes} [Wed Jun 22 10:17:59 2022] DELETE /identity/v3/users/55aa0f195fcc4bb4bf2c5192cddd2257 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:17:59.738256 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-6d0395d4-c9a9-4748-9bfc-c729f4266337 None None] MFA Rules not processed for user `cee5cfb48cc34c90bfbfd773a37a756a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:17:59.739995 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-6d0395d4-c9a9-4748-9bfc-c729f4266337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:17:59.846440 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1066/2123] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:17:59 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:17:59.859417 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3e5bfc-3bf8-401d-b54a-d30d59a5c16c admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:17:59.861559 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-2d3e5bfc-3bf8-401d-b54a-d30d59a5c16c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:17:59.950581 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3e5bfc-3bf8-401d-b54a-d30d59a5c16c admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:17:59.956722 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1755abcd-c32a-4118-8f64-3231ee84e682 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bbcb3d4dc704dfdb0097abc594ca855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:17:59.958085 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1755abcd-c32a-4118-8f64-3231ee84e682 service cinder] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:17:59.958515 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1755abcd-c32a-4118-8f64-3231ee84e682 service cinder] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:17:59.958934 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1755abcd-c32a-4118-8f64-3231ee84e682 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:17:59.974382 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1755abcd-c32a-4118-8f64-3231ee84e682 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:17:59.975904 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1755abcd-c32a-4118-8f64-3231ee84e682 service cinder] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:17:59.989140 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1058/2124] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:17:59 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:18:00.090365 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0395d4-c9a9-4748-9bfc-c729f4266337 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:00.110527 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0395d4-c9a9-4748-9bfc-c729f4266337 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:00.115299 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19a834e-9da9-4224-8112-02adb7c94af6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bbcb3d4dc704dfdb0097abc594ca855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:00.116036 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19a834e-9da9-4224-8112-02adb7c94af6 service cinder] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:00.116419 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19a834e-9da9-4224-8112-02adb7c94af6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:00.116749 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19a834e-9da9-4224-8112-02adb7c94af6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:00.118725 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-d19a834e-9da9-4224-8112-02adb7c94af6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:00.209953 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19a834e-9da9-4224-8112-02adb7c94af6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:00.211907 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19a834e-9da9-4224-8112-02adb7c94af6 service cinder] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:00.226779 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1067/2125] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:18:00 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:18:00.725325 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1755abcd-c32a-4118-8f64-3231ee84e682 service cinder] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:00.727278 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-1755abcd-c32a-4118-8f64-3231ee84e682 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:00.816735 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db42e1c4-81a6-46f3-b100-458795bf2874 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:00.817159 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db42e1c4-81a6-46f3-b100-458795bf2874 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:00.817301 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db42e1c4-81a6-46f3-b100-458795bf2874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:00.830607 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1755abcd-c32a-4118-8f64-3231ee84e682 service cinder] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:00.834707 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-db42e1c4-81a6-46f3-b100-458795bf2874 None None] MFA Rules not processed for user `7be3d844dcee4d19966fc7944463a0bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:18:00.835235 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73fa24f-58b0-4184-aafc-5b879ca53ac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:00.835912 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-db42e1c4-81a6-46f3-b100-458795bf2874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:00.836105 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73fa24f-58b0-4184-aafc-5b879ca53ac7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:00.836396 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73fa24f-58b0-4184-aafc-5b879ca53ac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:00.836677 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73fa24f-58b0-4184-aafc-5b879ca53ac7 admin admin] PATH_INFO: `/v3/projects/0303ceb50a9945229456041e62b888a1` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:00.837904 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73fa24f-58b0-4184-aafc-5b879ca53ac7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0303ceb50a9945229456041e62b888a1)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:00.839849 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73fa24f-58b0-4184-aafc-5b879ca53ac7 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:00.857371 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:18:00.897945 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-c73fa24f-58b0-4184-aafc-5b879ca53ac7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0303ceb50a9945229456041e62b888a1', 'request_id': 'req-c73fa24f-58b0-4184-aafc-5b879ca53ac7'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:18:00.900947 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1068/2126] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:18:00 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:18:00.905046 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-c73fa24f-58b0-4184-aafc-5b879ca53ac7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0303ceb50a9945229456041e62b888a1', 'request_id': 'req-c73fa24f-58b0-4184-aafc-5b879ca53ac7'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:18:00.913318 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-c73fa24f-58b0-4184-aafc-5b879ca53ac7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0303ceb50a9945229456041e62b888a1', 'request_id': 'req-c73fa24f-58b0-4184-aafc-5b879ca53ac7'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:18:00.926829 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-c73fa24f-58b0-4184-aafc-5b879ca53ac7 admin admin] The token cache is being invalidate because project 0303ceb50a9945229456041e62b888a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:18:00.927170 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-c73fa24f-58b0-4184-aafc-5b879ca53ac7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:18:00.927821 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-c73fa24f-58b0-4184-aafc-5b879ca53ac7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:18:00.929664 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1059/2127] 10.222.0.43 () {58 vars in 1232 bytes} [Wed Jun 22 10:18:00 2022] DELETE /identity/v3/projects/0303ceb50a9945229456041e62b888a1 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:18:00.934986 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8537cb-53c6-4176-a42a-78db1d3822ed None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:00.935360 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8537cb-53c6-4176-a42a-78db1d3822ed None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:00.935755 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8537cb-53c6-4176-a42a-78db1d3822ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:00.942267 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:18:00.958074 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-6d8537cb-53c6-4176-a42a-78db1d3822ed None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:18:00.959719 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-6d8537cb-53c6-4176-a42a-78db1d3822ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:01.031879 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1069/2128] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:18:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:18:01.041148 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552d17c6-afd0-4f06-889e-e1929f77ae39 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:01.041443 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552d17c6-afd0-4f06-889e-e1929f77ae39 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:01.041778 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552d17c6-afd0-4f06-889e-e1929f77ae39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:01.066051 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-552d17c6-afd0-4f06-889e-e1929f77ae39 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:18:01.067335 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-552d17c6-afd0-4f06-889e-e1929f77ae39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:01.076312 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1060/2129] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:18:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:18:01.081643 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8537cb-53c6-4176-a42a-78db1d3822ed None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:01.097995 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8537cb-53c6-4176-a42a-78db1d3822ed None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:01.103489 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c075ce3b-8a76-47fa-8b74-3a9f2c38a9c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:01.104375 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c075ce3b-8a76-47fa-8b74-3a9f2c38a9c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:01.104664 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c075ce3b-8a76-47fa-8b74-3a9f2c38a9c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:01.104940 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c075ce3b-8a76-47fa-8b74-3a9f2c38a9c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:01.105679 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c075ce3b-8a76-47fa-8b74-3a9f2c38a9c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:18:01.106014 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c075ce3b-8a76-47fa-8b74-3a9f2c38a9c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:01.107800 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c075ce3b-8a76-47fa-8b74-3a9f2c38a9c5 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:01.124748 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1070/2130] 10.222.0.43 () {58 vars in 1152 bytes} [Wed Jun 22 10:18:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:18:01.126237 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552d17c6-afd0-4f06-889e-e1929f77ae39 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:01.136375 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552d17c6-afd0-4f06-889e-e1929f77ae39 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:01.141765 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe2dff6-0c42-4c03-a66d-83e1dd2fd933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:01.142512 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe2dff6-0c42-4c03-a66d-83e1dd2fd933 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:01.143053 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe2dff6-0c42-4c03-a66d-83e1dd2fd933 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:01.143053 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe2dff6-0c42-4c03-a66d-83e1dd2fd933 admin admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:01.143658 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe2dff6-0c42-4c03-a66d-83e1dd2fd933 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:01.145572 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe2dff6-0c42-4c03-a66d-83e1dd2fd933 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:01.178222 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1061/2131] 10.222.0.43 () {60 vars in 1152 bytes} [Wed Jun 22 10:18:01 2022] POST /identity/v3/projects => generated 367 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 10:18:01.179377 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c075ce3b-8a76-47fa-8b74-3a9f2c38a9c5 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:01.189835 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c075ce3b-8a76-47fa-8b74-3a9f2c38a9c5 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:01.249401 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d09ff9-45eb-4b4e-bcc1-9b74efdb4e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:01.250224 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d09ff9-45eb-4b4e-bcc1-9b74efdb4e13 admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:01.250510 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d09ff9-45eb-4b4e-bcc1-9b74efdb4e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:01.250787 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d09ff9-45eb-4b4e-bcc1-9b74efdb4e13 admin admin] PATH_INFO: `/v3/users` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:01.251498 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d09ff9-45eb-4b4e-bcc1-9b74efdb4e13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:01.254053 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d09ff9-45eb-4b4e-bcc1-9b74efdb4e13 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:01.277143 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1071/2132] 10.222.0.43 () {60 vars in 1143 bytes} [Wed Jun 22 10:18:01 2022] POST /identity/v3/users => generated 284 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 10:18:01.278340 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe2dff6-0c42-4c03-a66d-83e1dd2fd933 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:01.289927 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe2dff6-0c42-4c03-a66d-83e1dd2fd933 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:01.294732 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61623df6-4b8c-46e7-94d8-e6cfab74c007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:01.295401 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61623df6-4b8c-46e7-94d8-e6cfab74c007 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:01.295686 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61623df6-4b8c-46e7-94d8-e6cfab74c007 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:01.295964 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61623df6-4b8c-46e7-94d8-e6cfab74c007 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:01.296701 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61623df6-4b8c-46e7-94d8-e6cfab74c007 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:01.298335 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61623df6-4b8c-46e7-94d8-e6cfab74c007 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:01.310625 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1062/2133] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:18:01 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:18:01.315120 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d09ff9-45eb-4b4e-bcc1-9b74efdb4e13 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:01.325508 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d09ff9-45eb-4b4e-bcc1-9b74efdb4e13 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:01.330833 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8fcc05-b2ac-41a8-89d0-12bbfc52bd82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:01.331492 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8fcc05-b2ac-41a8-89d0-12bbfc52bd82 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:01.331775 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8fcc05-b2ac-41a8-89d0-12bbfc52bd82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:01.332050 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8fcc05-b2ac-41a8-89d0-12bbfc52bd82 admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:01.332773 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8fcc05-b2ac-41a8-89d0-12bbfc52bd82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:01.334404 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8fcc05-b2ac-41a8-89d0-12bbfc52bd82 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:01.344595 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1072/2134] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:18:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:18:01.348866 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61623df6-4b8c-46e7-94d8-e6cfab74c007 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:01.371786 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61623df6-4b8c-46e7-94d8-e6cfab74c007 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:01.382269 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95a59a5-ed49-41b7-866e-357f8a15265d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:01.383996 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95a59a5-ed49-41b7-866e-357f8a15265d admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:01.383996 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95a59a5-ed49-41b7-866e-357f8a15265d admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:01.383996 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95a59a5-ed49-41b7-866e-357f8a15265d admin admin] PATH_INFO: `/v3/projects/44a481b53f8f48e6a0b38e3f1198e2ef/users/4bcc3e4afbde426d9c782d6ffa334f11/roles/9f88c83743f745a9a785a2f454753f06` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:01.400051 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95a59a5-ed49-41b7-866e-357f8a15265d admin admin] RBAC: Authorizing `identity:create_grant(project_id=44a481b53f8f48e6a0b38e3f1198e2ef, user_id=4bcc3e4afbde426d9c782d6ffa334f11, role_id=9f88c83743f745a9a785a2f454753f06)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:01.402874 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95a59a5-ed49-41b7-866e-357f8a15265d admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:01.420240 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1063/2135] 10.222.0.43 () {60 vars in 1482 bytes} [Wed Jun 22 10:18:01 2022] PUT /identity/v3/projects/44a481b53f8f48e6a0b38e3f1198e2ef/users/4bcc3e4afbde426d9c782d6ffa334f11/roles/9f88c83743f745a9a785a2f454753f06 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:18:01.431495 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0d51eb-2667-49be-9af7-4c96a8c3c384 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:01.431793 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0d51eb-2667-49be-9af7-4c96a8c3c384 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:01.432061 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0d51eb-2667-49be-9af7-4c96a8c3c384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:01.461581 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-aa0d51eb-2667-49be-9af7-4c96a8c3c384 None None] MFA Rules not processed for user `4bcc3e4afbde426d9c782d6ffa334f11`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:18:01.463024 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-aa0d51eb-2667-49be-9af7-4c96a8c3c384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:01.553095 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:18:01.563642 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1073/2136] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:18:01 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:18:01.576203 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95a59a5-ed49-41b7-866e-357f8a15265d admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:01.578695 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-b95a59a5-ed49-41b7-866e-357f8a15265d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:01.727227 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95a59a5-ed49-41b7-866e-357f8a15265d admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:01.737199 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebee068-d8d2-4182-b1e0-82314f189ae5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2418acec46b4db48346129004827853', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:01.738881 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebee068-d8d2-4182-b1e0-82314f189ae5 service glance] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:01.739176 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebee068-d8d2-4182-b1e0-82314f189ae5 service glance] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:01.740253 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebee068-d8d2-4182-b1e0-82314f189ae5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:01.763857 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebee068-d8d2-4182-b1e0-82314f189ae5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:01.766258 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebee068-d8d2-4182-b1e0-82314f189ae5 service glance] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:01.784479 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1064/2137] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:18:01 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:18:01.841799 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0d51eb-2667-49be-9af7-4c96a8c3c384 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:01.843410 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-aa0d51eb-2667-49be-9af7-4c96a8c3c384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:01.930846 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0d51eb-2667-49be-9af7-4c96a8c3c384 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:01.937190 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c446ef4-cb6f-414e-8d8b-0c4a73ec509a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:01.938379 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c446ef4-cb6f-414e-8d8b-0c4a73ec509a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:01.938738 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c446ef4-cb6f-414e-8d8b-0c4a73ec509a admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:01.939922 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c446ef4-cb6f-414e-8d8b-0c4a73ec509a admin admin] PATH_INFO: `/v3/users/e8c7e278a8e94797a258ad0b7034ef82` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:01.940965 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c446ef4-cb6f-414e-8d8b-0c4a73ec509a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8c7e278a8e94797a258ad0b7034ef82)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:01.943128 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c446ef4-cb6f-414e-8d8b-0c4a73ec509a admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:02.027367 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-9c446ef4-cb6f-414e-8d8b-0c4a73ec509a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8c7e278a8e94797a258ad0b7034ef82'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:18:02.053192 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-9c446ef4-cb6f-414e-8d8b-0c4a73ec509a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8c7e278a8e94797a258ad0b7034ef82'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:18:02.064874 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-9c446ef4-cb6f-414e-8d8b-0c4a73ec509a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8c7e278a8e94797a258ad0b7034ef82'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:18:02.075774 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-9c446ef4-cb6f-414e-8d8b-0c4a73ec509a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8c7e278a8e94797a258ad0b7034ef82'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:18:02.076806 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-9c446ef4-cb6f-414e-8d8b-0c4a73ec509a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8c7e278a8e94797a258ad0b7034ef82'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:18:02.086214 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1074/2138] 10.222.0.43 () {58 vars in 1223 bytes} [Wed Jun 22 10:18:01 2022] DELETE /identity/v3/users/e8c7e278a8e94797a258ad0b7034ef82 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:18:02.091836 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cc4306-ed86-4965-9c47-9c583710be19 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:02.092345 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cc4306-ed86-4965-9c47-9c583710be19 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:02.092707 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cc4306-ed86-4965-9c47-9c583710be19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:02.117191 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-66cc4306-ed86-4965-9c47-9c583710be19 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:18:02.118606 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-66cc4306-ed86-4965-9c47-9c583710be19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:02.166844 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:18:02.193388 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1065/2139] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:18:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:18:02.206670 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c446ef4-cb6f-414e-8d8b-0c4a73ec509a admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:02.208866 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-9c446ef4-cb6f-414e-8d8b-0c4a73ec509a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:02.274176 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c446ef4-cb6f-414e-8d8b-0c4a73ec509a admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:02.278619 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00d0325-6df9-4bd4-9fe8-95b6360426ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe93d4c0737249fd8623bb5ce188e34e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:02.279486 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00d0325-6df9-4bd4-9fe8-95b6360426ab service neutron] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:02.279772 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00d0325-6df9-4bd4-9fe8-95b6360426ab service neutron] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:02.280112 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00d0325-6df9-4bd4-9fe8-95b6360426ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:02.289853 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00d0325-6df9-4bd4-9fe8-95b6360426ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:02.291380 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00d0325-6df9-4bd4-9fe8-95b6360426ab service neutron] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:02.305114 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1075/2140] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:18:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:18:02.582325 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cc4306-ed86-4965-9c47-9c583710be19 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:02.584642 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-66cc4306-ed86-4965-9c47-9c583710be19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:02.606191 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cc4306-ed86-4965-9c47-9c583710be19 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:02.614421 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453ed2f1-56ac-4dc2-9d22-a3fc205b58f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:02.615394 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453ed2f1-56ac-4dc2-9d22-a3fc205b58f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:02.615713 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453ed2f1-56ac-4dc2-9d22-a3fc205b58f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:02.616105 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453ed2f1-56ac-4dc2-9d22-a3fc205b58f8 admin admin] PATH_INFO: `/v3/projects/52ba0b45e7ee4c72a169d191115ec929` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:02.617391 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453ed2f1-56ac-4dc2-9d22-a3fc205b58f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=52ba0b45e7ee4c72a169d191115ec929)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:02.620063 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453ed2f1-56ac-4dc2-9d22-a3fc205b58f8 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:02.683102 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-453ed2f1-56ac-4dc2-9d22-a3fc205b58f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52ba0b45e7ee4c72a169d191115ec929', 'request_id': 'req-453ed2f1-56ac-4dc2-9d22-a3fc205b58f8'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:18:02.693003 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-453ed2f1-56ac-4dc2-9d22-a3fc205b58f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52ba0b45e7ee4c72a169d191115ec929', 'request_id': 'req-453ed2f1-56ac-4dc2-9d22-a3fc205b58f8'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:18:02.701901 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-453ed2f1-56ac-4dc2-9d22-a3fc205b58f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52ba0b45e7ee4c72a169d191115ec929', 'request_id': 'req-453ed2f1-56ac-4dc2-9d22-a3fc205b58f8'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:18:02.714865 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-453ed2f1-56ac-4dc2-9d22-a3fc205b58f8 admin admin] The token cache is being invalidate because project 52ba0b45e7ee4c72a169d191115ec929 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:18:02.715244 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-453ed2f1-56ac-4dc2-9d22-a3fc205b58f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:18:02.716121 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-453ed2f1-56ac-4dc2-9d22-a3fc205b58f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:18:02.730614 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1066/2141] 10.222.0.43 () {58 vars in 1232 bytes} [Wed Jun 22 10:18:02 2022] DELETE /identity/v3/projects/52ba0b45e7ee4c72a169d191115ec929 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:18:05.318557 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00d0325-6df9-4bd4-9fe8-95b6360426ab service neutron] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:05.322132 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-b00d0325-6df9-4bd4-9fe8-95b6360426ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:05.342503 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00d0325-6df9-4bd4-9fe8-95b6360426ab service neutron] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:05.373252 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:18:05.438241 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b4f8b6-a537-4116-bcbe-da546cf8492f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:05.439949 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b4f8b6-a537-4116-bcbe-da546cf8492f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:05.440176 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b4f8b6-a537-4116-bcbe-da546cf8492f admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:05.440445 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b4f8b6-a537-4116-bcbe-da546cf8492f admin admin] PATH_INFO: `/v3/users/babe16661a5943ad9e5f84b5dbe64feb` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:05.442348 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b4f8b6-a537-4116-bcbe-da546cf8492f admin admin] RBAC: Authorizing `identity:delete_user(user_id=babe16661a5943ad9e5f84b5dbe64feb)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:05.445021 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b4f8b6-a537-4116-bcbe-da546cf8492f admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:05.542770 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-34b4f8b6-a537-4116-bcbe-da546cf8492f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'babe16661a5943ad9e5f84b5dbe64feb'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:18:05.566694 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-34b4f8b6-a537-4116-bcbe-da546cf8492f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'babe16661a5943ad9e5f84b5dbe64feb'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:18:05.581521 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-34b4f8b6-a537-4116-bcbe-da546cf8492f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'babe16661a5943ad9e5f84b5dbe64feb'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:18:05.590668 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-34b4f8b6-a537-4116-bcbe-da546cf8492f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'babe16661a5943ad9e5f84b5dbe64feb'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:18:05.591422 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-34b4f8b6-a537-4116-bcbe-da546cf8492f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'babe16661a5943ad9e5f84b5dbe64feb'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:18:05.599502 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1076/2142] 10.222.0.43 () {58 vars in 1223 bytes} [Wed Jun 22 10:18:05 2022] DELETE /identity/v3/users/babe16661a5943ad9e5f84b5dbe64feb => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:18:05.603954 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760cfa46-0c7a-44d5-8fcb-0d82aa197787 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:05.604832 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760cfa46-0c7a-44d5-8fcb-0d82aa197787 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:05.605289 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760cfa46-0c7a-44d5-8fcb-0d82aa197787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:05.624354 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-760cfa46-0c7a-44d5-8fcb-0d82aa197787 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:18:05.625556 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-760cfa46-0c7a-44d5-8fcb-0d82aa197787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:05.713172 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1067/2143] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:18:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:18:05.724530 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b4f8b6-a537-4116-bcbe-da546cf8492f admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:05.726006 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-34b4f8b6-a537-4116-bcbe-da546cf8492f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:05.790837 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b4f8b6-a537-4116-bcbe-da546cf8492f admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:05.794608 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde715e4-d8a1-46b3-83c9-b5aca165cad8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe93d4c0737249fd8623bb5ce188e34e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:05.795279 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde715e4-d8a1-46b3-83c9-b5aca165cad8 service neutron] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:05.795556 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde715e4-d8a1-46b3-83c9-b5aca165cad8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:05.795838 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde715e4-d8a1-46b3-83c9-b5aca165cad8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:05.810229 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde715e4-d8a1-46b3-83c9-b5aca165cad8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:05.811706 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde715e4-d8a1-46b3-83c9-b5aca165cad8 service neutron] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:05.822462 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1077/2144] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:18:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:18:06.185682 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760cfa46-0c7a-44d5-8fcb-0d82aa197787 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:06.190306 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-760cfa46-0c7a-44d5-8fcb-0d82aa197787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:06.212681 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760cfa46-0c7a-44d5-8fcb-0d82aa197787 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:06.218051 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9582a6c3-d679-4fcc-8095-9dafafa7267a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:06.219079 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9582a6c3-d679-4fcc-8095-9dafafa7267a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:06.219443 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9582a6c3-d679-4fcc-8095-9dafafa7267a admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:06.219786 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9582a6c3-d679-4fcc-8095-9dafafa7267a admin admin] PATH_INFO: `/v3/projects/3f5cbc2438bc4a6db7b0173bfc7b77d6` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:06.222246 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9582a6c3-d679-4fcc-8095-9dafafa7267a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f5cbc2438bc4a6db7b0173bfc7b77d6)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:06.224501 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9582a6c3-d679-4fcc-8095-9dafafa7267a admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:06.283853 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-9582a6c3-d679-4fcc-8095-9dafafa7267a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f5cbc2438bc4a6db7b0173bfc7b77d6', 'request_id': 'req-9582a6c3-d679-4fcc-8095-9dafafa7267a'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:18:06.290741 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-9582a6c3-d679-4fcc-8095-9dafafa7267a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f5cbc2438bc4a6db7b0173bfc7b77d6', 'request_id': 'req-9582a6c3-d679-4fcc-8095-9dafafa7267a'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:18:06.293857 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:18:06.300816 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-9582a6c3-d679-4fcc-8095-9dafafa7267a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f5cbc2438bc4a6db7b0173bfc7b77d6', 'request_id': 'req-9582a6c3-d679-4fcc-8095-9dafafa7267a'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:18:06.316868 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-9582a6c3-d679-4fcc-8095-9dafafa7267a admin admin] The token cache is being invalidate because project 3f5cbc2438bc4a6db7b0173bfc7b77d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:18:06.317416 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-9582a6c3-d679-4fcc-8095-9dafafa7267a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:18:06.318435 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-9582a6c3-d679-4fcc-8095-9dafafa7267a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:18:06.320506 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1068/2145] 10.222.0.43 () {58 vars in 1232 bytes} [Wed Jun 22 10:18:06 2022] DELETE /identity/v3/projects/3f5cbc2438bc4a6db7b0173bfc7b77d6 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:18:06.324580 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde715e4-d8a1-46b3-83c9-b5aca165cad8 service neutron] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:06.337269 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde715e4-d8a1-46b3-83c9-b5aca165cad8 service neutron] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:06.406249 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:18:06.424397 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff3dca6-ac19-4584-a63d-3e994c74631b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:06.425275 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff3dca6-ac19-4584-a63d-3e994c74631b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:06.425558 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff3dca6-ac19-4584-a63d-3e994c74631b admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:06.425867 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff3dca6-ac19-4584-a63d-3e994c74631b admin admin] PATH_INFO: `/v3/users/cee5cfb48cc34c90bfbfd773a37a756a` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:06.427048 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff3dca6-ac19-4584-a63d-3e994c74631b admin admin] RBAC: Authorizing `identity:delete_user(user_id=cee5cfb48cc34c90bfbfd773a37a756a)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:06.428978 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff3dca6-ac19-4584-a63d-3e994c74631b admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:06.475214 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-5ff3dca6-ac19-4584-a63d-3e994c74631b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cee5cfb48cc34c90bfbfd773a37a756a'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:18:06.488522 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-5ff3dca6-ac19-4584-a63d-3e994c74631b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cee5cfb48cc34c90bfbfd773a37a756a'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:18:06.496644 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-5ff3dca6-ac19-4584-a63d-3e994c74631b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cee5cfb48cc34c90bfbfd773a37a756a'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:18:06.511001 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-5ff3dca6-ac19-4584-a63d-3e994c74631b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cee5cfb48cc34c90bfbfd773a37a756a'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:18:06.511701 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-5ff3dca6-ac19-4584-a63d-3e994c74631b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cee5cfb48cc34c90bfbfd773a37a756a'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:18:06.519533 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1078/2146] 10.222.0.43 () {58 vars in 1223 bytes} [Wed Jun 22 10:18:06 2022] DELETE /identity/v3/users/cee5cfb48cc34c90bfbfd773a37a756a => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:18:06.998906 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9582a6c3-d679-4fcc-8095-9dafafa7267a admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:07.000431 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-9582a6c3-d679-4fcc-8095-9dafafa7267a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:07.015920 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9582a6c3-d679-4fcc-8095-9dafafa7267a admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:07.073825 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc242f69-8c77-40d8-b247-641587226dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:07.074695 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc242f69-8c77-40d8-b247-641587226dda admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:07.074981 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc242f69-8c77-40d8-b247-641587226dda admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:07.075256 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc242f69-8c77-40d8-b247-641587226dda admin admin] PATH_INFO: `/v3/projects/58d6b7614e194b4e9553e17dd53cff11` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:07.076468 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc242f69-8c77-40d8-b247-641587226dda admin admin] RBAC: Authorizing `identity:delete_project(project_id=58d6b7614e194b4e9553e17dd53cff11)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:07.078429 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc242f69-8c77-40d8-b247-641587226dda admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:07.131298 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-bc242f69-8c77-40d8-b247-641587226dda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58d6b7614e194b4e9553e17dd53cff11', 'request_id': 'req-bc242f69-8c77-40d8-b247-641587226dda'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:18:07.136883 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-bc242f69-8c77-40d8-b247-641587226dda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58d6b7614e194b4e9553e17dd53cff11', 'request_id': 'req-bc242f69-8c77-40d8-b247-641587226dda'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:18:07.145512 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-bc242f69-8c77-40d8-b247-641587226dda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58d6b7614e194b4e9553e17dd53cff11', 'request_id': 'req-bc242f69-8c77-40d8-b247-641587226dda'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:18:07.159434 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-bc242f69-8c77-40d8-b247-641587226dda admin admin] The token cache is being invalidate because project 58d6b7614e194b4e9553e17dd53cff11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:18:07.159730 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-bc242f69-8c77-40d8-b247-641587226dda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:18:07.160388 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-bc242f69-8c77-40d8-b247-641587226dda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:18:07.162195 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1069/2147] 10.222.0.43 () {58 vars in 1232 bytes} [Wed Jun 22 10:18:06 2022] DELETE /identity/v3/projects/58d6b7614e194b4e9553e17dd53cff11 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:18:07.166964 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf999516-db92-4cbf-9d4c-87e59abef463 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:07.167338 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf999516-db92-4cbf-9d4c-87e59abef463 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:07.167693 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf999516-db92-4cbf-9d4c-87e59abef463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:07.190240 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-cf999516-db92-4cbf-9d4c-87e59abef463 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:18:07.191463 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-cf999516-db92-4cbf-9d4c-87e59abef463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:07.263395 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1079/2148] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:18:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:18:07.273116 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aa9316-ba78-4313-b0d5-32c19bb3939c None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:07.273488 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aa9316-ba78-4313-b0d5-32c19bb3939c None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:07.273951 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aa9316-ba78-4313-b0d5-32c19bb3939c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:07.292960 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-d1aa9316-ba78-4313-b0d5-32c19bb3939c None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:18:07.294406 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-d1aa9316-ba78-4313-b0d5-32c19bb3939c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:07.302394 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1070/2149] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:18:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:18:07.306755 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf999516-db92-4cbf-9d4c-87e59abef463 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:07.317469 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf999516-db92-4cbf-9d4c-87e59abef463 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:07.322599 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2f2837-1404-4e21-8af6-1675f2793f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:07.323289 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2f2837-1404-4e21-8af6-1675f2793f67 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:07.323648 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2f2837-1404-4e21-8af6-1675f2793f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:07.323846 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2f2837-1404-4e21-8af6-1675f2793f67 admin admin] PATH_INFO: `/v3/domains` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:07.324595 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2f2837-1404-4e21-8af6-1675f2793f67 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:18:07.325142 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2f2837-1404-4e21-8af6-1675f2793f67 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:07.326594 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2f2837-1404-4e21-8af6-1675f2793f67 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:07.340277 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1080/2150] 10.222.0.43 () {58 vars in 1152 bytes} [Wed Jun 22 10:18:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:18:07.344652 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1aa9316-ba78-4313-b0d5-32c19bb3939c None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:07.354649 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1aa9316-ba78-4313-b0d5-32c19bb3939c None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:07.359245 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfea7115-8202-4475-906c-1a708bc868a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:07.359894 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfea7115-8202-4475-906c-1a708bc868a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:07.360178 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfea7115-8202-4475-906c-1a708bc868a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:07.360459 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfea7115-8202-4475-906c-1a708bc868a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:07.361811 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfea7115-8202-4475-906c-1a708bc868a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:07.363734 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfea7115-8202-4475-906c-1a708bc868a6 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:07.390557 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1071/2151] 10.222.0.43 () {60 vars in 1152 bytes} [Wed Jun 22 10:18:07 2022] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:18:07.395596 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2f2837-1404-4e21-8af6-1675f2793f67 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:07.405794 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2f2837-1404-4e21-8af6-1675f2793f67 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:07.463162 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:18:07.481330 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e20597-268e-479e-87e8-4ec39a467b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:07.482104 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e20597-268e-479e-87e8-4ec39a467b01 admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:07.482547 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e20597-268e-479e-87e8-4ec39a467b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:07.483189 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e20597-268e-479e-87e8-4ec39a467b01 admin admin] PATH_INFO: `/v3/users` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:07.484013 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e20597-268e-479e-87e8-4ec39a467b01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:07.487113 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e20597-268e-479e-87e8-4ec39a467b01 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:07.511133 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1081/2152] 10.222.0.43 () {60 vars in 1143 bytes} [Wed Jun 22 10:18:07 2022] POST /identity/v3/users => generated 292 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:18:07.512495 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfea7115-8202-4475-906c-1a708bc868a6 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:07.522900 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfea7115-8202-4475-906c-1a708bc868a6 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:07.527572 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31d65ad-0ae4-4f3e-8a1b-cb6bb3b1cde3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:07.528310 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31d65ad-0ae4-4f3e-8a1b-cb6bb3b1cde3 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:07.528603 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31d65ad-0ae4-4f3e-8a1b-cb6bb3b1cde3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:07.528886 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31d65ad-0ae4-4f3e-8a1b-cb6bb3b1cde3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:07.530216 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31d65ad-0ae4-4f3e-8a1b-cb6bb3b1cde3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:07.531284 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31d65ad-0ae4-4f3e-8a1b-cb6bb3b1cde3 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:07.548935 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1072/2153] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:18:07 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:18:07.550139 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e20597-268e-479e-87e8-4ec39a467b01 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:07.560863 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e20597-268e-479e-87e8-4ec39a467b01 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:07.566513 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0fd656-cc23-4cc2-be5f-fe22811f8046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:07.567199 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0fd656-cc23-4cc2-be5f-fe22811f8046 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:07.567487 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0fd656-cc23-4cc2-be5f-fe22811f8046 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:07.567770 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0fd656-cc23-4cc2-be5f-fe22811f8046 admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:07.568513 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0fd656-cc23-4cc2-be5f-fe22811f8046 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:07.570181 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0fd656-cc23-4cc2-be5f-fe22811f8046 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:07.580958 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1082/2154] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:18:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 10:18:07.585227 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31d65ad-0ae4-4f3e-8a1b-cb6bb3b1cde3 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:07.595852 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31d65ad-0ae4-4f3e-8a1b-cb6bb3b1cde3 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:07.600509 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cae32f-b005-4d8f-8380-17270fdcfa33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:07.601389 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cae32f-b005-4d8f-8380-17270fdcfa33 admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:07.601722 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cae32f-b005-4d8f-8380-17270fdcfa33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:07.602010 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cae32f-b005-4d8f-8380-17270fdcfa33 admin admin] PATH_INFO: `/v3/projects/718b8ba979094bd98182e33f925488c1/users/d7f635da44b743509e5733a67a711048/roles/9f88c83743f745a9a785a2f454753f06` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:07.619361 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cae32f-b005-4d8f-8380-17270fdcfa33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=718b8ba979094bd98182e33f925488c1, user_id=d7f635da44b743509e5733a67a711048, role_id=9f88c83743f745a9a785a2f454753f06)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:07.627533 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cae32f-b005-4d8f-8380-17270fdcfa33 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:07.643791 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1073/2155] 10.222.0.43 () {60 vars in 1482 bytes} [Wed Jun 22 10:18:07 2022] PUT /identity/v3/projects/718b8ba979094bd98182e33f925488c1/users/d7f635da44b743509e5733a67a711048/roles/9f88c83743f745a9a785a2f454753f06 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:18:07.656864 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72af1a1-74cd-4e18-8be9-08d6d89d1049 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:07.657067 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72af1a1-74cd-4e18-8be9-08d6d89d1049 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:07.657387 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72af1a1-74cd-4e18-8be9-08d6d89d1049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:07.696921 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-e72af1a1-74cd-4e18-8be9-08d6d89d1049 None None] MFA Rules not processed for user `d7f635da44b743509e5733a67a711048`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:18:07.698188 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-e72af1a1-74cd-4e18-8be9-08d6d89d1049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:07.789236 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1083/2156] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:18:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:18:07.802777 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cae32f-b005-4d8f-8380-17270fdcfa33 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:07.807586 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-89cae32f-b005-4d8f-8380-17270fdcfa33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:07.828628 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:18:07.881381 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cae32f-b005-4d8f-8380-17270fdcfa33 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:07.886986 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2f2276-321f-4a0c-bb74-7c2ad5747882 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bbcb3d4dc704dfdb0097abc594ca855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:07.887887 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2f2276-321f-4a0c-bb74-7c2ad5747882 service cinder] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:07.888193 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2f2276-321f-4a0c-bb74-7c2ad5747882 service cinder] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:07.888494 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2f2276-321f-4a0c-bb74-7c2ad5747882 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:07.898751 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2f2276-321f-4a0c-bb74-7c2ad5747882 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:07.900187 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2f2276-321f-4a0c-bb74-7c2ad5747882 service cinder] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:07.910100 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1074/2157] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:18:07 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 10:18:07.930339 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72af1a1-74cd-4e18-8be9-08d6d89d1049 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:08.006616 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72af1a1-74cd-4e18-8be9-08d6d89d1049 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:08.012491 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5e0681-af4f-4d82-9867-5f806231e61c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:08.013747 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5e0681-af4f-4d82-9867-5f806231e61c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:08.014201 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5e0681-af4f-4d82-9867-5f806231e61c admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:08.014631 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5e0681-af4f-4d82-9867-5f806231e61c admin admin] PATH_INFO: `/v3/users/d7f635da44b743509e5733a67a711048` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:08.016645 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5e0681-af4f-4d82-9867-5f806231e61c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7f635da44b743509e5733a67a711048)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:08.019616 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5e0681-af4f-4d82-9867-5f806231e61c admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:08.074768 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-ca5e0681-af4f-4d82-9867-5f806231e61c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7f635da44b743509e5733a67a711048'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:18:08.084742 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:18:08.096416 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-ca5e0681-af4f-4d82-9867-5f806231e61c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7f635da44b743509e5733a67a711048'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:18:08.110286 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-ca5e0681-af4f-4d82-9867-5f806231e61c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7f635da44b743509e5733a67a711048'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:18:08.121288 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-ca5e0681-af4f-4d82-9867-5f806231e61c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7f635da44b743509e5733a67a711048'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:18:08.122311 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-ca5e0681-af4f-4d82-9867-5f806231e61c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7f635da44b743509e5733a67a711048'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:18:08.129315 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1084/2158] 10.222.0.43 () {58 vars in 1223 bytes} [Wed Jun 22 10:18:07 2022] DELETE /identity/v3/users/d7f635da44b743509e5733a67a711048 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:18:08.133557 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675f552e-cf37-45b5-ae0b-00d457d86112 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:08.134049 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675f552e-cf37-45b5-ae0b-00d457d86112 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:08.134152 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675f552e-cf37-45b5-ae0b-00d457d86112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:08.153389 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-675f552e-cf37-45b5-ae0b-00d457d86112 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:18:08.154785 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-675f552e-cf37-45b5-ae0b-00d457d86112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:08.236329 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1075/2159] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:18:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:18:08.248362 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5e0681-af4f-4d82-9867-5f806231e61c admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:08.249930 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-ca5e0681-af4f-4d82-9867-5f806231e61c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:08.313012 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5e0681-af4f-4d82-9867-5f806231e61c admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:08.319793 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023d9a45-3e2c-432c-802e-6d877ef7cc22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe93d4c0737249fd8623bb5ce188e34e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:08.320464 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023d9a45-3e2c-432c-802e-6d877ef7cc22 service neutron] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:08.320852 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023d9a45-3e2c-432c-802e-6d877ef7cc22 service neutron] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:08.321065 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023d9a45-3e2c-432c-802e-6d877ef7cc22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:08.342565 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023d9a45-3e2c-432c-802e-6d877ef7cc22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:08.344193 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023d9a45-3e2c-432c-802e-6d877ef7cc22 service neutron] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:08.356395 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1085/2160] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:18:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:18:08.694283 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675f552e-cf37-45b5-ae0b-00d457d86112 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:08.694694 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-675f552e-cf37-45b5-ae0b-00d457d86112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:08.727159 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675f552e-cf37-45b5-ae0b-00d457d86112 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:08.732220 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e5914e-179f-4824-9514-d761eba651b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:08.733115 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e5914e-179f-4824-9514-d761eba651b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:08.733441 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e5914e-179f-4824-9514-d761eba651b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:08.733643 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e5914e-179f-4824-9514-d761eba651b3 admin admin] PATH_INFO: `/v3/projects/718b8ba979094bd98182e33f925488c1` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:08.734870 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e5914e-179f-4824-9514-d761eba651b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=718b8ba979094bd98182e33f925488c1)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:08.736920 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e5914e-179f-4824-9514-d761eba651b3 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:08.794414 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-34e5914e-179f-4824-9514-d761eba651b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '718b8ba979094bd98182e33f925488c1', 'request_id': 'req-34e5914e-179f-4824-9514-d761eba651b3'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:18:08.802417 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-34e5914e-179f-4824-9514-d761eba651b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '718b8ba979094bd98182e33f925488c1', 'request_id': 'req-34e5914e-179f-4824-9514-d761eba651b3'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:18:08.813288 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-34e5914e-179f-4824-9514-d761eba651b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '718b8ba979094bd98182e33f925488c1', 'request_id': 'req-34e5914e-179f-4824-9514-d761eba651b3'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:18:08.830295 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-34e5914e-179f-4824-9514-d761eba651b3 admin admin] The token cache is being invalidate because project 718b8ba979094bd98182e33f925488c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:18:08.830650 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-34e5914e-179f-4824-9514-d761eba651b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:18:08.831383 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-34e5914e-179f-4824-9514-d761eba651b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:18:08.833654 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1076/2161] 10.222.0.43 () {58 vars in 1232 bytes} [Wed Jun 22 10:18:08 2022] DELETE /identity/v3/projects/718b8ba979094bd98182e33f925488c1 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:18:08.838446 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cb5330-76b5-461a-80d9-992002f8b4ea None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:08.838740 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cb5330-76b5-461a-80d9-992002f8b4ea None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:08.839026 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cb5330-76b5-461a-80d9-992002f8b4ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:08.856337 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-a8cb5330-76b5-461a-80d9-992002f8b4ea None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:18:08.857521 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-a8cb5330-76b5-461a-80d9-992002f8b4ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:08.918847 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1086/2162] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:18:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:18:08.927050 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34a9153-90bf-4c3c-8ed6-fd064634db26 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:08.927413 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34a9153-90bf-4c3c-8ed6-fd064634db26 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:08.927763 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34a9153-90bf-4c3c-8ed6-fd064634db26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:08.947813 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-c34a9153-90bf-4c3c-8ed6-fd064634db26 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:18:08.949021 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-c34a9153-90bf-4c3c-8ed6-fd064634db26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:08.959499 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1077/2163] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:18:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:18:08.963708 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cb5330-76b5-461a-80d9-992002f8b4ea None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:08.982868 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cb5330-76b5-461a-80d9-992002f8b4ea None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:08.989019 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e108bc-4cd4-4591-b745-dd6801190c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:08.989724 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e108bc-4cd4-4591-b745-dd6801190c85 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:08.990023 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e108bc-4cd4-4591-b745-dd6801190c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:08.990302 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e108bc-4cd4-4591-b745-dd6801190c85 admin admin] PATH_INFO: `/v3/domains` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:08.991040 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e108bc-4cd4-4591-b745-dd6801190c85 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:18:08.991348 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e108bc-4cd4-4591-b745-dd6801190c85 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:08.992995 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e108bc-4cd4-4591-b745-dd6801190c85 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:09.006615 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1087/2164] 10.222.0.43 () {58 vars in 1152 bytes} [Wed Jun 22 10:18:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:18:09.013322 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34a9153-90bf-4c3c-8ed6-fd064634db26 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:09.022994 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34a9153-90bf-4c3c-8ed6-fd064634db26 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:09.027748 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f330041c-158c-428b-80fe-c196764b8fda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:09.028409 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f330041c-158c-428b-80fe-c196764b8fda admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:09.028696 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f330041c-158c-428b-80fe-c196764b8fda admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:09.028968 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f330041c-158c-428b-80fe-c196764b8fda admin admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:09.029955 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f330041c-158c-428b-80fe-c196764b8fda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:09.031894 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f330041c-158c-428b-80fe-c196764b8fda admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:09.068640 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1078/2165] 10.222.0.43 () {60 vars in 1152 bytes} [Wed Jun 22 10:18:09 2022] POST /identity/v3/projects => generated 373 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:18:09.072887 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e108bc-4cd4-4591-b745-dd6801190c85 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:09.084371 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e108bc-4cd4-4591-b745-dd6801190c85 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:09.166595 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f404d07-effa-477c-8a27-f5ebaf211891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:09.167274 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f404d07-effa-477c-8a27-f5ebaf211891 admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:09.167621 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f404d07-effa-477c-8a27-f5ebaf211891 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:09.167893 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f404d07-effa-477c-8a27-f5ebaf211891 admin admin] PATH_INFO: `/v3/users` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:09.168560 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f404d07-effa-477c-8a27-f5ebaf211891 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:09.170758 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f404d07-effa-477c-8a27-f5ebaf211891 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:09.181418 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:18:09.194249 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1088/2166] 10.222.0.43 () {60 vars in 1143 bytes} [Wed Jun 22 10:18:09 2022] POST /identity/v3/users => generated 287 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:18:09.199122 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f330041c-158c-428b-80fe-c196764b8fda admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:09.210306 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f330041c-158c-428b-80fe-c196764b8fda admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:09.219638 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f9afca-3f5c-4908-bfd0-0253103bfa5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:09.221888 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f9afca-3f5c-4908-bfd0-0253103bfa5e admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:09.221888 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f9afca-3f5c-4908-bfd0-0253103bfa5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:09.221888 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f9afca-3f5c-4908-bfd0-0253103bfa5e admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:09.222253 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f9afca-3f5c-4908-bfd0-0253103bfa5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:09.223879 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f9afca-3f5c-4908-bfd0-0253103bfa5e admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:09.237780 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1079/2167] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:18:09 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:18:09.241095 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f404d07-effa-477c-8a27-f5ebaf211891 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:09.251913 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f404d07-effa-477c-8a27-f5ebaf211891 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:09.256854 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d97f8d8-9fb8-4fcd-87fa-d796fbeccae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:09.257510 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d97f8d8-9fb8-4fcd-87fa-d796fbeccae0 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:09.257848 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d97f8d8-9fb8-4fcd-87fa-d796fbeccae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:09.258132 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d97f8d8-9fb8-4fcd-87fa-d796fbeccae0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:09.258859 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d97f8d8-9fb8-4fcd-87fa-d796fbeccae0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:09.260456 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d97f8d8-9fb8-4fcd-87fa-d796fbeccae0 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:09.271131 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1089/2168] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:18:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 10:18:09.275337 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f9afca-3f5c-4908-bfd0-0253103bfa5e admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:09.280544 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:18:09.287741 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f9afca-3f5c-4908-bfd0-0253103bfa5e admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:09.297089 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82339a3e-cf40-47e4-a1a9-36d1cb5b0947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:09.298024 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82339a3e-cf40-47e4-a1a9-36d1cb5b0947 admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:09.298408 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82339a3e-cf40-47e4-a1a9-36d1cb5b0947 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:09.298908 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82339a3e-cf40-47e4-a1a9-36d1cb5b0947 admin admin] PATH_INFO: `/v3/projects/7eb154d9bfd54de99f4a41f177a273d0/users/bdce188af69b4ff6951ad380651648ef/roles/9f88c83743f745a9a785a2f454753f06` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:09.313562 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82339a3e-cf40-47e4-a1a9-36d1cb5b0947 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7eb154d9bfd54de99f4a41f177a273d0, user_id=bdce188af69b4ff6951ad380651648ef, role_id=9f88c83743f745a9a785a2f454753f06)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:09.317031 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82339a3e-cf40-47e4-a1a9-36d1cb5b0947 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:09.337360 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1080/2169] 10.222.0.43 () {60 vars in 1482 bytes} [Wed Jun 22 10:18:09 2022] PUT /identity/v3/projects/7eb154d9bfd54de99f4a41f177a273d0/users/bdce188af69b4ff6951ad380651648ef/roles/9f88c83743f745a9a785a2f454753f06 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:18:09.348131 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56136b82-dadc-46fe-9763-a5c3581dc63e None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:09.348642 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56136b82-dadc-46fe-9763-a5c3581dc63e None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:09.348761 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56136b82-dadc-46fe-9763-a5c3581dc63e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:09.377222 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-56136b82-dadc-46fe-9763-a5c3581dc63e None None] MFA Rules not processed for user `bdce188af69b4ff6951ad380651648ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:18:09.378984 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-56136b82-dadc-46fe-9763-a5c3581dc63e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:09.477480 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1090/2170] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:18:09 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:18:09.492722 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82339a3e-cf40-47e4-a1a9-36d1cb5b0947 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:09.494580 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-82339a3e-cf40-47e4-a1a9-36d1cb5b0947 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:09.572288 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82339a3e-cf40-47e4-a1a9-36d1cb5b0947 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:09.576288 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457cd29f-0c8f-4273-bcea-9f02380ddc2e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bbcb3d4dc704dfdb0097abc594ca855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:09.577011 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457cd29f-0c8f-4273-bcea-9f02380ddc2e service cinder] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:09.577373 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457cd29f-0c8f-4273-bcea-9f02380ddc2e service cinder] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:09.577755 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457cd29f-0c8f-4273-bcea-9f02380ddc2e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:09.588132 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457cd29f-0c8f-4273-bcea-9f02380ddc2e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:09.589509 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457cd29f-0c8f-4273-bcea-9f02380ddc2e service cinder] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:09.601133 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1081/2171] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:18:09 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:18:09.623837 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56136b82-dadc-46fe-9763-a5c3581dc63e None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:09.704633 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56136b82-dadc-46fe-9763-a5c3581dc63e None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:09.711305 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0d7447-b707-400b-9834-37a61fb1f448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:09.712230 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0d7447-b707-400b-9834-37a61fb1f448 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:09.712554 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0d7447-b707-400b-9834-37a61fb1f448 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:09.712873 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0d7447-b707-400b-9834-37a61fb1f448 admin admin] PATH_INFO: `/v3/users/bdce188af69b4ff6951ad380651648ef` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:09.714234 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0d7447-b707-400b-9834-37a61fb1f448 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bdce188af69b4ff6951ad380651648ef)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:09.716604 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0d7447-b707-400b-9834-37a61fb1f448 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:09.798087 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-1d0d7447-b707-400b-9834-37a61fb1f448 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bdce188af69b4ff6951ad380651648ef'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:18:09.819367 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-1d0d7447-b707-400b-9834-37a61fb1f448 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bdce188af69b4ff6951ad380651648ef'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:18:09.827294 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-1d0d7447-b707-400b-9834-37a61fb1f448 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bdce188af69b4ff6951ad380651648ef'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:18:09.832409 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:18:09.837862 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-1d0d7447-b707-400b-9834-37a61fb1f448 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bdce188af69b4ff6951ad380651648ef'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:18:09.839026 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-1d0d7447-b707-400b-9834-37a61fb1f448 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bdce188af69b4ff6951ad380651648ef'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:18:09.847116 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1091/2172] 10.222.0.43 () {58 vars in 1223 bytes} [Wed Jun 22 10:18:09 2022] DELETE /identity/v3/users/bdce188af69b4ff6951ad380651648ef => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:18:09.856820 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dc4494-0d83-4a7f-a7d3-5506b30cd60f None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:09.857149 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dc4494-0d83-4a7f-a7d3-5506b30cd60f None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:09.857430 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dc4494-0d83-4a7f-a7d3-5506b30cd60f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:09.876863 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-a2dc4494-0d83-4a7f-a7d3-5506b30cd60f None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:18:09.878313 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-a2dc4494-0d83-4a7f-a7d3-5506b30cd60f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:09.965243 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1082/2173] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:18:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:18:09.977399 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0d7447-b707-400b-9834-37a61fb1f448 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:09.980508 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-1d0d7447-b707-400b-9834-37a61fb1f448 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:10.053154 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0d7447-b707-400b-9834-37a61fb1f448 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:10.056847 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2c841a-739c-4b47-8406-e4bd3362748e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe93d4c0737249fd8623bb5ce188e34e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:10.057583 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2c841a-739c-4b47-8406-e4bd3362748e service neutron] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:10.057944 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2c841a-739c-4b47-8406-e4bd3362748e service neutron] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:10.058284 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2c841a-739c-4b47-8406-e4bd3362748e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:10.068655 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2c841a-739c-4b47-8406-e4bd3362748e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:10.070173 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2c841a-739c-4b47-8406-e4bd3362748e service neutron] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:10.081047 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1092/2174] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:18:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:18:10.787049 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dc4494-0d83-4a7f-a7d3-5506b30cd60f None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:10.788505 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-a2dc4494-0d83-4a7f-a7d3-5506b30cd60f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:10.806277 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dc4494-0d83-4a7f-a7d3-5506b30cd60f None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:10.833784 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df5b18b-4313-40e9-866c-394ebe174641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:10.834635 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df5b18b-4313-40e9-866c-394ebe174641 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:10.834922 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df5b18b-4313-40e9-866c-394ebe174641 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:10.835202 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df5b18b-4313-40e9-866c-394ebe174641 admin admin] PATH_INFO: `/v3/projects/7eb154d9bfd54de99f4a41f177a273d0` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:10.857261 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df5b18b-4313-40e9-866c-394ebe174641 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7eb154d9bfd54de99f4a41f177a273d0)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:10.857261 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df5b18b-4313-40e9-866c-394ebe174641 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:10.935120 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-2df5b18b-4313-40e9-866c-394ebe174641 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7eb154d9bfd54de99f4a41f177a273d0', 'request_id': 'req-2df5b18b-4313-40e9-866c-394ebe174641'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:18:10.945164 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-2df5b18b-4313-40e9-866c-394ebe174641 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7eb154d9bfd54de99f4a41f177a273d0', 'request_id': 'req-2df5b18b-4313-40e9-866c-394ebe174641'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:18:10.958902 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-2df5b18b-4313-40e9-866c-394ebe174641 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7eb154d9bfd54de99f4a41f177a273d0', 'request_id': 'req-2df5b18b-4313-40e9-866c-394ebe174641'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:18:10.974667 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-2df5b18b-4313-40e9-866c-394ebe174641 admin admin] The token cache is being invalidate because project 7eb154d9bfd54de99f4a41f177a273d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:18:10.974970 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-2df5b18b-4313-40e9-866c-394ebe174641 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:18:10.976317 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-2df5b18b-4313-40e9-866c-394ebe174641 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:18:10.978433 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1083/2175] 10.222.0.43 () {58 vars in 1232 bytes} [Wed Jun 22 10:18:10 2022] DELETE /identity/v3/projects/7eb154d9bfd54de99f4a41f177a273d0 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:18:10.983601 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c9504f-fee3-4a8e-9413-4e9c31aefda9 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:10.984505 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c9504f-fee3-4a8e-9413-4e9c31aefda9 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:10.984984 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c9504f-fee3-4a8e-9413-4e9c31aefda9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:11.054239 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-d7c9504f-fee3-4a8e-9413-4e9c31aefda9 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:18:11.055712 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-d7c9504f-fee3-4a8e-9413-4e9c31aefda9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:11.194978 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1093/2176] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:18:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:18:11.196611 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82659b98-dcb3-44ce-b578-2137954ab2b9 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:11.196905 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82659b98-dcb3-44ce-b578-2137954ab2b9 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:11.197190 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82659b98-dcb3-44ce-b578-2137954ab2b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:11.208296 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:18:11.236602 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-82659b98-dcb3-44ce-b578-2137954ab2b9 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:18:11.239309 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-82659b98-dcb3-44ce-b578-2137954ab2b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:11.266355 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1084/2177] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:18:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:18:11.273046 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c9504f-fee3-4a8e-9413-4e9c31aefda9 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:11.289826 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c9504f-fee3-4a8e-9413-4e9c31aefda9 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:11.300884 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc786b94-c52a-47bf-bb59-f1431ef04e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:11.302181 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc786b94-c52a-47bf-bb59-f1431ef04e34 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:11.302471 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc786b94-c52a-47bf-bb59-f1431ef04e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:11.302753 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc786b94-c52a-47bf-bb59-f1431ef04e34 admin admin] PATH_INFO: `/v3/domains` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:11.303565 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc786b94-c52a-47bf-bb59-f1431ef04e34 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:18:11.303890 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc786b94-c52a-47bf-bb59-f1431ef04e34 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:11.307751 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc786b94-c52a-47bf-bb59-f1431ef04e34 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:11.356253 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82659b98-dcb3-44ce-b578-2137954ab2b9 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:11.372937 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1094/2178] 10.222.0.43 () {58 vars in 1152 bytes} [Wed Jun 22 10:18:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:18:11.375841 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8569809-cb5d-4f72-80e4-cb352f6c8138 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:11.376162 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8569809-cb5d-4f72-80e4-cb352f6c8138 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:11.376976 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8569809-cb5d-4f72-80e4-cb352f6c8138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:11.385021 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82659b98-dcb3-44ce-b578-2137954ab2b9 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:11.390916 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d714f104-276c-4f76-84ca-a3534eebe59d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:11.391700 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d714f104-276c-4f76-84ca-a3534eebe59d admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:11.392105 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d714f104-276c-4f76-84ca-a3534eebe59d admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:11.392512 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d714f104-276c-4f76-84ca-a3534eebe59d admin admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:11.393393 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d714f104-276c-4f76-84ca-a3534eebe59d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:11.397802 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d714f104-276c-4f76-84ca-a3534eebe59d admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:11.421027 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-d8569809-cb5d-4f72-80e4-cb352f6c8138 None None] MFA Rules not processed for user `317e7e7dd5c741d49d34a1fd949a7c07`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:18:11.422369 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-d8569809-cb5d-4f72-80e4-cb352f6c8138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:11.453303 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1085/2179] 10.222.0.43 () {60 vars in 1152 bytes} [Wed Jun 22 10:18:11 2022] POST /identity/v3/projects => generated 373 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:18:11.458123 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d714f104-276c-4f76-84ca-a3534eebe59d admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:11.567553 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1095/2180] 10.222.0.43 () {58 vars in 1009 bytes} [Wed Jun 22 10:18:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:18:11.585049 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8569809-cb5d-4f72-80e4-cb352f6c8138 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:11.586539 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-d8569809-cb5d-4f72-80e4-cb352f6c8138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:11.594188 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d714f104-276c-4f76-84ca-a3534eebe59d admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:11.607993 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f58f349-e4d7-4f89-83d0-e1857eb978dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:11.609188 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f58f349-e4d7-4f89-83d0-e1857eb978dc admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:11.610003 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f58f349-e4d7-4f89-83d0-e1857eb978dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:11.610474 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f58f349-e4d7-4f89-83d0-e1857eb978dc admin admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:11.612443 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f58f349-e4d7-4f89-83d0-e1857eb978dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:11.614664 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f58f349-e4d7-4f89-83d0-e1857eb978dc admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:11.646411 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:18:11.648941 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1086/2181] 10.222.0.43 () {60 vars in 1143 bytes} [Wed Jun 22 10:18:11 2022] POST /identity/v3/users => generated 287 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:18:11.653189 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f58f349-e4d7-4f89-83d0-e1857eb978dc admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:11.668576 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f58f349-e4d7-4f89-83d0-e1857eb978dc admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:11.675118 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87b0c21-ff72-4e8c-9b05-73564c7917a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:11.675301 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87b0c21-ff72-4e8c-9b05-73564c7917a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:11.675441 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87b0c21-ff72-4e8c-9b05-73564c7917a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:11.675724 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87b0c21-ff72-4e8c-9b05-73564c7917a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:11.676662 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87b0c21-ff72-4e8c-9b05-73564c7917a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:11.678329 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87b0c21-ff72-4e8c-9b05-73564c7917a8 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:11.700275 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1087/2182] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:18:11 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:18:11.701957 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87b0c21-ff72-4e8c-9b05-73564c7917a8 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:11.718928 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87b0c21-ff72-4e8c-9b05-73564c7917a8 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:11.722723 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8569809-cb5d-4f72-80e4-cb352f6c8138 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:11.725837 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9347d5-cec5-491a-969c-91b9ba030cee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:11.726748 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9347d5-cec5-491a-969c-91b9ba030cee admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:11.727612 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9347d5-cec5-491a-969c-91b9ba030cee admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:11.727953 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9347d5-cec5-491a-969c-91b9ba030cee admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:11.729067 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9347d5-cec5-491a-969c-91b9ba030cee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:11.730863 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9347d5-cec5-491a-969c-91b9ba030cee admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:11.746835 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1088/2183] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:18:11 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:18:11.752872 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9347d5-cec5-491a-969c-91b9ba030cee admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:11.787905 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9347d5-cec5-491a-969c-91b9ba030cee admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:11.793677 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1c2749-f5df-4b18-9172-24e6b9a9b199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:11.794646 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1c2749-f5df-4b18-9172-24e6b9a9b199 admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:11.794923 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1c2749-f5df-4b18-9172-24e6b9a9b199 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:11.795202 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1c2749-f5df-4b18-9172-24e6b9a9b199 admin admin] PATH_INFO: `/v3/projects/0b75addf2f334d7cb584ccae7779d3f1/users/f9517119110f4ab99bff1379d5f7e241/roles/9f88c83743f745a9a785a2f454753f06` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:11.817158 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1c2749-f5df-4b18-9172-24e6b9a9b199 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b75addf2f334d7cb584ccae7779d3f1, user_id=f9517119110f4ab99bff1379d5f7e241, role_id=9f88c83743f745a9a785a2f454753f06)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:11.820076 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1c2749-f5df-4b18-9172-24e6b9a9b199 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:11.831918 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3bda43-0242-4a09-9450-19f941abcc8d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9566f8cca2574f4cb5edcbf384f368a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:11.832692 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3bda43-0242-4a09-9450-19f941abcc8d service swift] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:11.833049 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3bda43-0242-4a09-9450-19f941abcc8d service swift] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:11.833471 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3bda43-0242-4a09-9450-19f941abcc8d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:11.838345 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1089/2184] 10.222.0.43 () {60 vars in 1482 bytes} [Wed Jun 22 10:18:11 2022] PUT /identity/v3/projects/0b75addf2f334d7cb584ccae7779d3f1/users/f9517119110f4ab99bff1379d5f7e241/roles/9f88c83743f745a9a785a2f454753f06 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:18:11.842083 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fbffd7-852f-4d09-81c7-6632bc2b2add None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:11.842083 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fbffd7-852f-4d09-81c7-6632bc2b2add None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:11.842083 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fbffd7-852f-4d09-81c7-6632bc2b2add None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:11.859485 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-62fbffd7-852f-4d09-81c7-6632bc2b2add None None] MFA Rules not processed for user `0d7292401816437fba46d073c4746e45`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:18:11.859652 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-62fbffd7-852f-4d09-81c7-6632bc2b2add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:11.927955 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3bda43-0242-4a09-9450-19f941abcc8d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:11.929881 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3bda43-0242-4a09-9450-19f941abcc8d service swift] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:11.941733 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1096/2185] 10.222.0.43 () {60 vars in 1384 bytes} [Wed Jun 22 10:18:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 22 10:18:11.943372 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cf7525-bb87-4fa8-a3fd-8c763d1fd407 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:11.943790 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cf7525-bb87-4fa8-a3fd-8c763d1fd407 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:11.943902 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cf7525-bb87-4fa8-a3fd-8c763d1fd407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:11.963544 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1090/2186] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:18:11 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:18:11.968389 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-91cf7525-bb87-4fa8-a3fd-8c763d1fd407 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:18:11.969627 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-91cf7525-bb87-4fa8-a3fd-8c763d1fd407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:12.068109 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1097/2187] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:18:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:18:12.078269 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fbffd7-852f-4d09-81c7-6632bc2b2add None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:12.080938 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-62fbffd7-852f-4d09-81c7-6632bc2b2add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:12.123743 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:18:12.170199 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fbffd7-852f-4d09-81c7-6632bc2b2add None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:12.174624 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d76462-cd40-4462-a08c-311f4d1e744e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe93d4c0737249fd8623bb5ce188e34e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:12.175303 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d76462-cd40-4462-a08c-311f4d1e744e service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:12.175595 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d76462-cd40-4462-a08c-311f4d1e744e service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:12.175880 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d76462-cd40-4462-a08c-311f4d1e744e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:12.188522 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d76462-cd40-4462-a08c-311f4d1e744e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:12.190682 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d76462-cd40-4462-a08c-311f4d1e744e service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:12.207680 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1091/2188] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:18:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:18:13.249841 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c131cbb-4b6d-4770-aa88-6a7085b868d5 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:13.249841 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c131cbb-4b6d-4770-aa88-6a7085b868d5 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:13.249841 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c131cbb-4b6d-4770-aa88-6a7085b868d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:13.281994 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:18:13.287266 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-2c131cbb-4b6d-4770-aa88-6a7085b868d5 None None] MFA Rules not processed for user `f9517119110f4ab99bff1379d5f7e241`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:18:13.288932 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-2c131cbb-4b6d-4770-aa88-6a7085b868d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:13.396579 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1098/2189] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:18:13 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:18:13.412523 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d76462-cd40-4462-a08c-311f4d1e744e service neutron] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:13.414119 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-82d76462-cd40-4462-a08c-311f4d1e744e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:13.513806 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d76462-cd40-4462-a08c-311f4d1e744e service neutron] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:13.522640 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2e90d1-f2ca-451d-886e-3263e0b27610 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bbcb3d4dc704dfdb0097abc594ca855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:13.523827 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2e90d1-f2ca-451d-886e-3263e0b27610 service cinder] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:13.523827 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2e90d1-f2ca-451d-886e-3263e0b27610 service cinder] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:13.524045 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2e90d1-f2ca-451d-886e-3263e0b27610 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:13.535772 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2e90d1-f2ca-451d-886e-3263e0b27610 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:13.537998 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2e90d1-f2ca-451d-886e-3263e0b27610 service cinder] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:13.555541 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1092/2190] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:18:13 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:18:15.066035 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5204411-dddc-4d86-9a79-6513eb906646 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:15.066629 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5204411-dddc-4d86-9a79-6513eb906646 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:15.066961 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5204411-dddc-4d86-9a79-6513eb906646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:15.102317 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-c5204411-dddc-4d86-9a79-6513eb906646 None None] MFA Rules not processed for user `f9517119110f4ab99bff1379d5f7e241`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:18:15.104084 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-c5204411-dddc-4d86-9a79-6513eb906646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:15.174549 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1099/2191] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:18:15 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:18:23.544719 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=41 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:18:25.162806 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=41 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:18:34.096640 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca010e1-22a7-4f65-8954-dd6a8220288d None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:34.097194 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca010e1-22a7-4f65-8954-dd6a8220288d None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:34.097194 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca010e1-22a7-4f65-8954-dd6a8220288d None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:34.098967 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1093/2192] 10.222.0.43 () {54 vars in 921 bytes} [Wed Jun 22 10:18:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:18:34.112825 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801cad2a-98e4-48c0-89bc-4d921fbe8bdb None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:34.114264 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801cad2a-98e4-48c0-89bc-4d921fbe8bdb None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:34.114767 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801cad2a-98e4-48c0-89bc-4d921fbe8bdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:34.165559 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-801cad2a-98e4-48c0-89bc-4d921fbe8bdb None None] MFA Rules not processed for user `158a49aa3750478a84bf71b9aad24397`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:18:34.167573 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-801cad2a-98e4-48c0-89bc-4d921fbe8bdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:34.286622 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1100/2193] 10.222.0.43 () {58 vars in 1018 bytes} [Wed Jun 22 10:18:34 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:18:34.299856 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca010e1-22a7-4f65-8954-dd6a8220288d None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:34.302272 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-aca010e1-22a7-4f65-8954-dd6a8220288d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:34.378247 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca010e1-22a7-4f65-8954-dd6a8220288d None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:34.381769 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64239a26-7f16-4add-9785-4592b1bbadd0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2418acec46b4db48346129004827853', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:34.382416 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64239a26-7f16-4add-9785-4592b1bbadd0 service glance] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:34.382695 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64239a26-7f16-4add-9785-4592b1bbadd0 service glance] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:34.382970 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64239a26-7f16-4add-9785-4592b1bbadd0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:34.394164 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64239a26-7f16-4add-9785-4592b1bbadd0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:34.395623 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64239a26-7f16-4add-9785-4592b1bbadd0 service glance] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:34.407752 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1094/2194] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:18:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:18:34.487552 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b51355f-d68d-4a79-83da-8435bd2a4324 None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:34.488397 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b51355f-d68d-4a79-83da-8435bd2a4324 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:34.488691 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b51355f-d68d-4a79-83da-8435bd2a4324 None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:34.490304 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1101/2195] 10.222.0.43 () {54 vars in 921 bytes} [Wed Jun 22 10:18:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:18:34.496678 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78251aed-c94f-4a25-a60f-e5349c9682ed None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:34.497221 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78251aed-c94f-4a25-a60f-e5349c9682ed None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:34.497753 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78251aed-c94f-4a25-a60f-e5349c9682ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:34.544292 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-78251aed-c94f-4a25-a60f-e5349c9682ed None None] MFA Rules not processed for user `fe93d4c0737249fd8623bb5ce188e34e`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:18:34.545622 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-78251aed-c94f-4a25-a60f-e5349c9682ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:34.564177 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1095/2196] 10.222.0.43 () {58 vars in 1018 bytes} [Wed Jun 22 10:18:34 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:18:34.576698 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b51355f-d68d-4a79-83da-8435bd2a4324 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:34.588543 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b51355f-d68d-4a79-83da-8435bd2a4324 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:34.594118 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9043961b-63ca-44ab-9406-8fbda7d4eb6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe93d4c0737249fd8623bb5ce188e34e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:34.595503 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9043961b-63ca-44ab-9406-8fbda7d4eb6a service neutron] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:34.596018 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9043961b-63ca-44ab-9406-8fbda7d4eb6a service neutron] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:34.596534 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9043961b-63ca-44ab-9406-8fbda7d4eb6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:34.606453 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9043961b-63ca-44ab-9406-8fbda7d4eb6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:34.607937 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9043961b-63ca-44ab-9406-8fbda7d4eb6a service neutron] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:34.617347 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1102/2197] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:18:34 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:18:34.705627 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd03494-691f-475d-85d7-bb6f67c4ebb0 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:34.706053 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd03494-691f-475d-85d7-bb6f67c4ebb0 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:34.706429 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd03494-691f-475d-85d7-bb6f67c4ebb0 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:34.707821 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1096/2198] 10.222.0.43 () {54 vars in 921 bytes} [Wed Jun 22 10:18:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:18:34.714527 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cb595c-427f-413d-84d4-f4406778d862 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:34.714825 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cb595c-427f-413d-84d4-f4406778d862 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:34.715111 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cb595c-427f-413d-84d4-f4406778d862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:34.738099 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-c7cb595c-427f-413d-84d4-f4406778d862 None None] MFA Rules not processed for user `158a49aa3750478a84bf71b9aad24397`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:18:34.739334 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-c7cb595c-427f-413d-84d4-f4406778d862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:34.749962 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1103/2199] 10.222.0.43 () {58 vars in 1018 bytes} [Wed Jun 22 10:18:34 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:18:34.761236 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd03494-691f-475d-85d7-bb6f67c4ebb0 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:34.762968 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-ebd03494-691f-475d-85d7-bb6f67c4ebb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:34.777331 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd03494-691f-475d-85d7-bb6f67c4ebb0 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:34.783494 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0290aa84-80df-4e73-aff3-c45181e3dec8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe93d4c0737249fd8623bb5ce188e34e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:34.784167 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0290aa84-80df-4e73-aff3-c45181e3dec8 service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:34.784460 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0290aa84-80df-4e73-aff3-c45181e3dec8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:34.784747 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0290aa84-80df-4e73-aff3-c45181e3dec8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:34.796453 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0290aa84-80df-4e73-aff3-c45181e3dec8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:34.797439 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0290aa84-80df-4e73-aff3-c45181e3dec8 service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:34.810358 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1097/2200] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:18:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:18:37.480196 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cb595c-427f-413d-84d4-f4406778d862 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:37.482117 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-c7cb595c-427f-413d-84d4-f4406778d862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:37.543858 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cb595c-427f-413d-84d4-f4406778d862 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:37.552297 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bd435e-9b92-445a-be1d-b1169e4da4e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:37.553567 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bd435e-9b92-445a-be1d-b1169e4da4e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:37.554168 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bd435e-9b92-445a-be1d-b1169e4da4e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:37.555877 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bd435e-9b92-445a-be1d-b1169e4da4e0 admin admin] PATH_INFO: `/v3/users/4bcc3e4afbde426d9c782d6ffa334f11` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:37.558004 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bd435e-9b92-445a-be1d-b1169e4da4e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4bcc3e4afbde426d9c782d6ffa334f11)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:37.561049 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bd435e-9b92-445a-be1d-b1169e4da4e0 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:37.624291 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-d2bd435e-9b92-445a-be1d-b1169e4da4e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4bcc3e4afbde426d9c782d6ffa334f11'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:18:37.634468 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:18:37.644200 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-d2bd435e-9b92-445a-be1d-b1169e4da4e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4bcc3e4afbde426d9c782d6ffa334f11'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:18:37.661532 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-d2bd435e-9b92-445a-be1d-b1169e4da4e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4bcc3e4afbde426d9c782d6ffa334f11'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:18:37.672284 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-d2bd435e-9b92-445a-be1d-b1169e4da4e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4bcc3e4afbde426d9c782d6ffa334f11'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:18:37.673915 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-d2bd435e-9b92-445a-be1d-b1169e4da4e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4bcc3e4afbde426d9c782d6ffa334f11'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:18:37.685742 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1104/2201] 10.222.0.43 () {58 vars in 1223 bytes} [Wed Jun 22 10:18:37 2022] DELETE /identity/v3/users/4bcc3e4afbde426d9c782d6ffa334f11 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:18:37.690712 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b115b581-b1e4-4e6d-830d-4f4e9659baf4 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:37.692397 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b115b581-b1e4-4e6d-830d-4f4e9659baf4 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:37.693440 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b115b581-b1e4-4e6d-830d-4f4e9659baf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:37.740607 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-b115b581-b1e4-4e6d-830d-4f4e9659baf4 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:18:37.742489 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-b115b581-b1e4-4e6d-830d-4f4e9659baf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:37.834662 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1098/2202] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:18:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:18:37.848988 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bd435e-9b92-445a-be1d-b1169e4da4e0 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:37.850985 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-d2bd435e-9b92-445a-be1d-b1169e4da4e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:37.948876 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bd435e-9b92-445a-be1d-b1169e4da4e0 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:37.953297 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d40bd3-d68f-4beb-a1d8-f1eb6ce7214c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe93d4c0737249fd8623bb5ce188e34e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:37.954019 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d40bd3-d68f-4beb-a1d8-f1eb6ce7214c service neutron] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:37.954383 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d40bd3-d68f-4beb-a1d8-f1eb6ce7214c service neutron] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:37.954666 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d40bd3-d68f-4beb-a1d8-f1eb6ce7214c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:37.964348 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d40bd3-d68f-4beb-a1d8-f1eb6ce7214c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:37.965864 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d40bd3-d68f-4beb-a1d8-f1eb6ce7214c service neutron] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:37.976799 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1105/2203] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:18:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:18:38.286042 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b115b581-b1e4-4e6d-830d-4f4e9659baf4 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:38.287728 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-b115b581-b1e4-4e6d-830d-4f4e9659baf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:38.311928 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b115b581-b1e4-4e6d-830d-4f4e9659baf4 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:38.318066 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40ed7a6-d720-4e25-83dd-92a5862b5bf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:38.319082 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40ed7a6-d720-4e25-83dd-92a5862b5bf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:38.319415 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40ed7a6-d720-4e25-83dd-92a5862b5bf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:38.319719 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40ed7a6-d720-4e25-83dd-92a5862b5bf4 admin admin] PATH_INFO: `/v3/projects/44a481b53f8f48e6a0b38e3f1198e2ef` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:38.321038 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40ed7a6-d720-4e25-83dd-92a5862b5bf4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=44a481b53f8f48e6a0b38e3f1198e2ef)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:38.323022 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40ed7a6-d720-4e25-83dd-92a5862b5bf4 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:38.376757 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-e40ed7a6-d720-4e25-83dd-92a5862b5bf4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44a481b53f8f48e6a0b38e3f1198e2ef', 'request_id': 'req-e40ed7a6-d720-4e25-83dd-92a5862b5bf4'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:18:38.379240 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:18:38.383642 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-e40ed7a6-d720-4e25-83dd-92a5862b5bf4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44a481b53f8f48e6a0b38e3f1198e2ef', 'request_id': 'req-e40ed7a6-d720-4e25-83dd-92a5862b5bf4'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:18:38.393709 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-e40ed7a6-d720-4e25-83dd-92a5862b5bf4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44a481b53f8f48e6a0b38e3f1198e2ef', 'request_id': 'req-e40ed7a6-d720-4e25-83dd-92a5862b5bf4'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:18:38.407585 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-e40ed7a6-d720-4e25-83dd-92a5862b5bf4 admin admin] The token cache is being invalidate because project 44a481b53f8f48e6a0b38e3f1198e2ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:18:38.407875 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-e40ed7a6-d720-4e25-83dd-92a5862b5bf4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:18:38.408440 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-e40ed7a6-d720-4e25-83dd-92a5862b5bf4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:18:38.410032 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1099/2204] 10.222.0.43 () {58 vars in 1232 bytes} [Wed Jun 22 10:18:38 2022] DELETE /identity/v3/projects/44a481b53f8f48e6a0b38e3f1198e2ef => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:18:39.920806 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6487501-e9a6-4e90-b0b6-939fba214adb None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:39.921286 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6487501-e9a6-4e90-b0b6-939fba214adb None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:39.921401 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6487501-e9a6-4e90-b0b6-939fba214adb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:39.938967 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-e6487501-e9a6-4e90-b0b6-939fba214adb None None] MFA Rules not processed for user `317e7e7dd5c741d49d34a1fd949a7c07`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:18:39.940196 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-e6487501-e9a6-4e90-b0b6-939fba214adb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:40.010896 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1106/2205] 10.222.0.43 () {58 vars in 1009 bytes} [Wed Jun 22 10:18:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:18:40.033627 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40ed7a6-d720-4e25-83dd-92a5862b5bf4 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:40.035081 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-e40ed7a6-d720-4e25-83dd-92a5862b5bf4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:40.126161 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40ed7a6-d720-4e25-83dd-92a5862b5bf4 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:40.131194 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ac48da-8a5d-454f-9c49-5266edd67cd6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9566f8cca2574f4cb5edcbf384f368a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:40.132000 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ac48da-8a5d-454f-9c49-5266edd67cd6 service swift] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:40.132288 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ac48da-8a5d-454f-9c49-5266edd67cd6 service swift] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:40.132565 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ac48da-8a5d-454f-9c49-5266edd67cd6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:40.141928 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ac48da-8a5d-454f-9c49-5266edd67cd6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:40.143609 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ac48da-8a5d-454f-9c49-5266edd67cd6 service swift] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:40.152431 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1100/2206] 10.222.0.43 () {60 vars in 1384 bytes} [Wed Jun 22 10:18:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 22 10:18:50.002374 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=62,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:18:50.148623 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=38,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:18:50.272829 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6487501-e9a6-4e90-b0b6-939fba214adb None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:18:50.274257 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-e6487501-e9a6-4e90-b0b6-939fba214adb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:50.380236 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6487501-e9a6-4e90-b0b6-939fba214adb None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:18:50.385854 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ff9dfb-7c6a-4141-b38d-3cc51805007c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '341ec95408c94dae8539ccff7225e3ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:18:50.386513 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ff9dfb-7c6a-4141-b38d-3cc51805007c service placement] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:50.386798 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ff9dfb-7c6a-4141-b38d-3cc51805007c service placement] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:50.387076 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ff9dfb-7c6a-4141-b38d-3cc51805007c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:50.388924 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-c1ff9dfb-7c6a-4141-b38d-3cc51805007c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:50.402158 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ff9dfb-7c6a-4141-b38d-3cc51805007c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:18:50.403195 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ff9dfb-7c6a-4141-b38d-3cc51805007c service placement] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:18:50.425858 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1107/2207] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:18:50 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:18:51.543867 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5def489-a5b0-49af-9e85-be62494e8f06 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:18:51.543867 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5def489-a5b0-49af-9e85-be62494e8f06 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:18:51.543867 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5def489-a5b0-49af-9e85-be62494e8f06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:18:51.564400 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-d5def489-a5b0-49af-9e85-be62494e8f06 None None] MFA Rules not processed for user `f9517119110f4ab99bff1379d5f7e241`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:18:51.566276 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-d5def489-a5b0-49af-9e85-be62494e8f06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:18:51.655637 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1101/2208] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:18:51 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:19:00.409872 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=41 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:19:01.633526 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=25 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:19:03.528172 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7925ab02-ad7b-4b06-b271-bdc49695d5ce None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:19:03.528660 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7925ab02-ad7b-4b06-b271-bdc49695d5ce None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:19:03.528759 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7925ab02-ad7b-4b06-b271-bdc49695d5ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:19:03.582657 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-7925ab02-ad7b-4b06-b271-bdc49695d5ce None None] MFA Rules not processed for user `317e7e7dd5c741d49d34a1fd949a7c07`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:19:03.583821 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-7925ab02-ad7b-4b06-b271-bdc49695d5ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:19:03.601041 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1108/2209] 10.222.0.43 () {58 vars in 967 bytes} [Wed Jun 22 10:19:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:19:03.614287 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5def489-a5b0-49af-9e85-be62494e8f06 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:19:03.637073 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5def489-a5b0-49af-9e85-be62494e8f06 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:19:03.645264 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86646e92-12ed-4e97-9374-2877050a3434 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9566f8cca2574f4cb5edcbf384f368a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:19:03.645975 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86646e92-12ed-4e97-9374-2877050a3434 service swift] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:19:03.646321 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86646e92-12ed-4e97-9374-2877050a3434 service swift] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:19:03.646698 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86646e92-12ed-4e97-9374-2877050a3434 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:19:03.656170 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86646e92-12ed-4e97-9374-2877050a3434 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:19:03.657793 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86646e92-12ed-4e97-9374-2877050a3434 service swift] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:19:03.667339 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1102/2210] 10.222.0.43 () {60 vars in 1384 bytes} [Wed Jun 22 10:19:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 22 10:19:13.597928 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=18 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:19:13.663825 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=10 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:19:16.256921 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582857f5-fa17-4d37-b284-237901b86bd2 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:19:16.257389 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582857f5-fa17-4d37-b284-237901b86bd2 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:19:16.257485 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582857f5-fa17-4d37-b284-237901b86bd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:19:16.275782 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-582857f5-fa17-4d37-b284-237901b86bd2 None None] MFA Rules not processed for user `317e7e7dd5c741d49d34a1fd949a7c07`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:19:16.277095 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-582857f5-fa17-4d37-b284-237901b86bd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:19:16.284607 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1109/2211] 10.222.0.43 () {58 vars in 1009 bytes} [Wed Jun 22 10:19:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:19:16.298597 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86646e92-12ed-4e97-9374-2877050a3434 service swift] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:19:16.309005 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86646e92-12ed-4e97-9374-2877050a3434 service swift] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:19:16.314734 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df25dc0c-865d-41ec-96f8-014c967fe273 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9566f8cca2574f4cb5edcbf384f368a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:19:16.315373 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df25dc0c-865d-41ec-96f8-014c967fe273 service swift] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:19:16.315656 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df25dc0c-865d-41ec-96f8-014c967fe273 service swift] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:19:16.315931 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df25dc0c-865d-41ec-96f8-014c967fe273 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:19:16.324199 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df25dc0c-865d-41ec-96f8-014c967fe273 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:19:16.325789 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df25dc0c-865d-41ec-96f8-014c967fe273 service swift] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:19:16.334656 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1103/2212] 10.222.0.43 () {60 vars in 1384 bytes} [Wed Jun 22 10:19:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 22 10:19:22.606867 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97daa30-77f3-4f46-91ec-f0247d46ad8b None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:19:22.607718 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97daa30-77f3-4f46-91ec-f0247d46ad8b None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:19:22.608218 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97daa30-77f3-4f46-91ec-f0247d46ad8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:19:22.645468 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-a97daa30-77f3-4f46-91ec-f0247d46ad8b None None] MFA Rules not processed for user `7be3d844dcee4d19966fc7944463a0bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:19:22.646808 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-a97daa30-77f3-4f46-91ec-f0247d46ad8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:19:22.706567 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1110/2213] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:19:22 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:19:26.331190 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=6 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:19:32.008220 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d53c12-f28b-4a2d-8b46-7e95e04c8c62 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:19:32.008790 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d53c12-f28b-4a2d-8b46-7e95e04c8c62 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:19:32.008790 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d53c12-f28b-4a2d-8b46-7e95e04c8c62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:19:32.029171 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-31d53c12-f28b-4a2d-8b46-7e95e04c8c62 None None] MFA Rules not processed for user `317e7e7dd5c741d49d34a1fd949a7c07`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:19:32.030417 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-31d53c12-f28b-4a2d-8b46-7e95e04c8c62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:19:32.038303 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1104/2214] 10.222.0.43 () {58 vars in 967 bytes} [Wed Jun 22 10:19:32 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:19:32.050933 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97daa30-77f3-4f46-91ec-f0247d46ad8b None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:19:32.062533 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97daa30-77f3-4f46-91ec-f0247d46ad8b None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:19:32.067897 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feae1f06-f64b-40ef-a0b3-bb4333f34732 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9566f8cca2574f4cb5edcbf384f368a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:19:32.068560 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feae1f06-f64b-40ef-a0b3-bb4333f34732 service swift] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:19:32.068852 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feae1f06-f64b-40ef-a0b3-bb4333f34732 service swift] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:19:32.069133 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feae1f06-f64b-40ef-a0b3-bb4333f34732 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:19:32.081133 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feae1f06-f64b-40ef-a0b3-bb4333f34732 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:19:32.082881 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feae1f06-f64b-40ef-a0b3-bb4333f34732 service swift] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:19:32.091216 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1111/2215] 10.222.0.43 () {60 vars in 1384 bytes} [Wed Jun 22 10:19:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 22 10:19:34.027661 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d53c12-f28b-4a2d-8b46-7e95e04c8c62 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:19:34.029115 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-31d53c12-f28b-4a2d-8b46-7e95e04c8c62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:19:34.098866 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d53c12-f28b-4a2d-8b46-7e95e04c8c62 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:19:34.104125 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2b4eeb-b8d3-444a-8b5b-465f520e3d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:19:34.105016 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2b4eeb-b8d3-444a-8b5b-465f520e3d0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:19:34.105303 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2b4eeb-b8d3-444a-8b5b-465f520e3d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:19:34.105584 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2b4eeb-b8d3-444a-8b5b-465f520e3d0a admin admin] PATH_INFO: `/v3/users/f9517119110f4ab99bff1379d5f7e241` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:19:34.106945 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2b4eeb-b8d3-444a-8b5b-465f520e3d0a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9517119110f4ab99bff1379d5f7e241)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:19:34.108928 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2b4eeb-b8d3-444a-8b5b-465f520e3d0a admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:19:34.158486 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-5e2b4eeb-b8d3-444a-8b5b-465f520e3d0a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9517119110f4ab99bff1379d5f7e241'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:19:34.170969 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-5e2b4eeb-b8d3-444a-8b5b-465f520e3d0a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9517119110f4ab99bff1379d5f7e241'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:19:34.179932 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-5e2b4eeb-b8d3-444a-8b5b-465f520e3d0a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9517119110f4ab99bff1379d5f7e241'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:19:34.180550 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-5e2b4eeb-b8d3-444a-8b5b-465f520e3d0a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9517119110f4ab99bff1379d5f7e241'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:19:34.187775 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-5e2b4eeb-b8d3-444a-8b5b-465f520e3d0a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9517119110f4ab99bff1379d5f7e241'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:19:34.194176 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1105/2216] 10.222.0.43 () {58 vars in 1223 bytes} [Wed Jun 22 10:19:34 2022] DELETE /identity/v3/users/f9517119110f4ab99bff1379d5f7e241 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:19:34.373819 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feae1f06-f64b-40ef-a0b3-bb4333f34732 service swift] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:19:34.389852 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feae1f06-f64b-40ef-a0b3-bb4333f34732 service swift] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:19:34.455720 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e561f39-1e42-4d59-bf1e-c5f6c7f02c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:19:34.456809 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e561f39-1e42-4d59-bf1e-c5f6c7f02c3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:19:34.457089 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e561f39-1e42-4d59-bf1e-c5f6c7f02c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:19:34.457367 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e561f39-1e42-4d59-bf1e-c5f6c7f02c3a admin admin] PATH_INFO: `/v3/projects/0b75addf2f334d7cb584ccae7779d3f1` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:19:34.461736 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e561f39-1e42-4d59-bf1e-c5f6c7f02c3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b75addf2f334d7cb584ccae7779d3f1)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:19:34.461736 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e561f39-1e42-4d59-bf1e-c5f6c7f02c3a admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:19:34.510334 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-1e561f39-1e42-4d59-bf1e-c5f6c7f02c3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b75addf2f334d7cb584ccae7779d3f1', 'request_id': 'req-1e561f39-1e42-4d59-bf1e-c5f6c7f02c3a'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:19:34.517548 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-1e561f39-1e42-4d59-bf1e-c5f6c7f02c3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b75addf2f334d7cb584ccae7779d3f1', 'request_id': 'req-1e561f39-1e42-4d59-bf1e-c5f6c7f02c3a'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:19:34.523597 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-1e561f39-1e42-4d59-bf1e-c5f6c7f02c3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b75addf2f334d7cb584ccae7779d3f1', 'request_id': 'req-1e561f39-1e42-4d59-bf1e-c5f6c7f02c3a'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:19:34.537859 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-1e561f39-1e42-4d59-bf1e-c5f6c7f02c3a admin admin] The token cache is being invalidate because project 0b75addf2f334d7cb584ccae7779d3f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:19:34.538149 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-1e561f39-1e42-4d59-bf1e-c5f6c7f02c3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:19:34.538779 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-1e561f39-1e42-4d59-bf1e-c5f6c7f02c3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:19:34.540330 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1112/2217] 10.222.0.43 () {58 vars in 1232 bytes} [Wed Jun 22 10:19:34 2022] DELETE /identity/v3/projects/0b75addf2f334d7cb584ccae7779d3f1 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:19:34.545116 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a105b7-d70b-4ec5-95da-6b3551519b34 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:19:34.545417 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a105b7-d70b-4ec5-95da-6b3551519b34 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:19:34.545712 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a105b7-d70b-4ec5-95da-6b3551519b34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:19:34.584101 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-b7a105b7-d70b-4ec5-95da-6b3551519b34 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:19:34.585313 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-b7a105b7-d70b-4ec5-95da-6b3551519b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:19:34.638207 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:19:34.650500 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1106/2218] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:19:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:19:34.658387 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9233d3a1-60f1-4f02-9543-473d1224777b None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:19:34.658678 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9233d3a1-60f1-4f02-9543-473d1224777b None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:19:34.659089 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9233d3a1-60f1-4f02-9543-473d1224777b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:19:34.678442 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-9233d3a1-60f1-4f02-9543-473d1224777b None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:19:34.679646 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-9233d3a1-60f1-4f02-9543-473d1224777b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:19:34.687516 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1113/2219] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:19:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:19:34.692422 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a105b7-d70b-4ec5-95da-6b3551519b34 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:19:34.702308 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a105b7-d70b-4ec5-95da-6b3551519b34 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:19:34.708306 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d59a8e3-7dc5-4b44-81fa-191075300c15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:19:34.708973 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d59a8e3-7dc5-4b44-81fa-191075300c15 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:19:34.709258 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d59a8e3-7dc5-4b44-81fa-191075300c15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:19:34.709538 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d59a8e3-7dc5-4b44-81fa-191075300c15 admin admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:19:34.710316 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d59a8e3-7dc5-4b44-81fa-191075300c15 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:19:34.710630 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d59a8e3-7dc5-4b44-81fa-191075300c15 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:19:34.712236 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d59a8e3-7dc5-4b44-81fa-191075300c15 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:19:34.727788 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1107/2220] 10.222.0.43 () {58 vars in 1152 bytes} [Wed Jun 22 10:19:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:19:34.729268 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9233d3a1-60f1-4f02-9543-473d1224777b None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:19:34.739048 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9233d3a1-60f1-4f02-9543-473d1224777b None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:19:34.743621 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b21b45-4cd6-4d44-ad7e-ddedbd9f90fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:19:34.744285 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b21b45-4cd6-4d44-ad7e-ddedbd9f90fc admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:19:34.744568 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b21b45-4cd6-4d44-ad7e-ddedbd9f90fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:19:34.744846 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b21b45-4cd6-4d44-ad7e-ddedbd9f90fc admin admin] PATH_INFO: `/v3/projects` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:19:34.745532 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b21b45-4cd6-4d44-ad7e-ddedbd9f90fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:19:34.747474 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b21b45-4cd6-4d44-ad7e-ddedbd9f90fc admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:19:34.752469 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:19:34.781738 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1114/2221] 10.222.0.43 () {60 vars in 1152 bytes} [Wed Jun 22 10:19:34 2022] POST /identity/v3/projects => generated 379 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:19:34.782898 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d59a8e3-7dc5-4b44-81fa-191075300c15 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:19:34.792927 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d59a8e3-7dc5-4b44-81fa-191075300c15 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:19:34.852275 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4856812-a8c6-4c88-9278-8a0ce9a7e6de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:19:34.853362 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4856812-a8c6-4c88-9278-8a0ce9a7e6de admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:19:34.853648 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4856812-a8c6-4c88-9278-8a0ce9a7e6de admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:19:34.853954 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4856812-a8c6-4c88-9278-8a0ce9a7e6de admin admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:19:34.854645 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4856812-a8c6-4c88-9278-8a0ce9a7e6de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:19:34.856606 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4856812-a8c6-4c88-9278-8a0ce9a7e6de admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:19:34.879124 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1108/2222] 10.222.0.43 () {60 vars in 1143 bytes} [Wed Jun 22 10:19:34 2022] POST /identity/v3/users => generated 290 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:19:34.883258 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b21b45-4cd6-4d44-ad7e-ddedbd9f90fc admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:19:34.894986 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b21b45-4cd6-4d44-ad7e-ddedbd9f90fc admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:19:34.899730 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ba8e4a-9ca9-4281-b2ed-883117af1eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:19:34.900403 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ba8e4a-9ca9-4281-b2ed-883117af1eef admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:19:34.900691 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ba8e4a-9ca9-4281-b2ed-883117af1eef admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:19:34.900974 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ba8e4a-9ca9-4281-b2ed-883117af1eef admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:19:34.901738 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ba8e4a-9ca9-4281-b2ed-883117af1eef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:19:34.903365 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ba8e4a-9ca9-4281-b2ed-883117af1eef admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:19:34.918701 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1115/2223] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:19:34 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:19:34.919913 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4856812-a8c6-4c88-9278-8a0ce9a7e6de admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:19:34.931145 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4856812-a8c6-4c88-9278-8a0ce9a7e6de admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:19:34.935941 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aba87d-2163-4df2-9d82-8a750704a335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:19:34.936637 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aba87d-2163-4df2-9d82-8a750704a335 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:19:34.936951 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aba87d-2163-4df2-9d82-8a750704a335 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:19:34.937384 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aba87d-2163-4df2-9d82-8a750704a335 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:19:34.938259 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59aba87d-2163-4df2-9d82-8a750704a335 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:19:34.939973 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59aba87d-2163-4df2-9d82-8a750704a335 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:19:34.950886 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1109/2224] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:19:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 10:19:34.954639 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ba8e4a-9ca9-4281-b2ed-883117af1eef admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:19:34.965086 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ba8e4a-9ca9-4281-b2ed-883117af1eef admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:19:34.969837 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1d27f8-5da4-448d-b6f4-2b427946fd8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:19:34.971303 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1d27f8-5da4-448d-b6f4-2b427946fd8e admin admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:19:34.971657 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1d27f8-5da4-448d-b6f4-2b427946fd8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:19:34.971804 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1d27f8-5da4-448d-b6f4-2b427946fd8e admin admin] PATH_INFO: `/v3/projects/1cb1af845e594466b12a11b7cab99a7c/users/b2d3aa18a0a146808f584127411a1cf5/roles/9f88c83743f745a9a785a2f454753f06` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:19:34.987138 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1d27f8-5da4-448d-b6f4-2b427946fd8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cb1af845e594466b12a11b7cab99a7c, user_id=b2d3aa18a0a146808f584127411a1cf5, role_id=9f88c83743f745a9a785a2f454753f06)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:19:34.989897 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1d27f8-5da4-448d-b6f4-2b427946fd8e admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:19:35.004828 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1116/2225] 10.222.0.43 () {60 vars in 1482 bytes} [Wed Jun 22 10:19:34 2022] PUT /identity/v3/projects/1cb1af845e594466b12a11b7cab99a7c/users/b2d3aa18a0a146808f584127411a1cf5/roles/9f88c83743f745a9a785a2f454753f06 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:19:35.009549 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1551748a-6073-4f7d-8873-d9a438e8df5f None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:19:35.009874 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1551748a-6073-4f7d-8873-d9a438e8df5f None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:19:35.010155 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1551748a-6073-4f7d-8873-d9a438e8df5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:19:35.030191 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-1551748a-6073-4f7d-8873-d9a438e8df5f None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:19:35.031402 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-1551748a-6073-4f7d-8873-d9a438e8df5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:19:35.094948 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1110/2226] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:19:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:19:35.110193 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1d27f8-5da4-448d-b6f4-2b427946fd8e admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:19:35.112140 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-7d1d27f8-5da4-448d-b6f4-2b427946fd8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:19:35.174755 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1d27f8-5da4-448d-b6f4-2b427946fd8e admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:19:35.178494 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603256dd-d368-4f7b-9b06-ff923b608ef0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe93d4c0737249fd8623bb5ce188e34e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:19:35.179154 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603256dd-d368-4f7b-9b06-ff923b608ef0 service neutron] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:19:35.179444 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603256dd-d368-4f7b-9b06-ff923b608ef0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:19:35.179727 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603256dd-d368-4f7b-9b06-ff923b608ef0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:19:35.190246 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603256dd-d368-4f7b-9b06-ff923b608ef0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:19:35.191750 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603256dd-d368-4f7b-9b06-ff923b608ef0 service neutron] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:19:35.201546 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1117/2227] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:19:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:19:39.787431 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e184663-fea7-4baa-af51-0f73d5b16c81 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:19:39.787996 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e184663-fea7-4baa-af51-0f73d5b16c81 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:19:39.787996 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e184663-fea7-4baa-af51-0f73d5b16c81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:19:39.813997 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-8e184663-fea7-4baa-af51-0f73d5b16c81 None None] MFA Rules not processed for user `b2d3aa18a0a146808f584127411a1cf5`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:19:39.814949 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-8e184663-fea7-4baa-af51-0f73d5b16c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:19:39.870888 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:19:39.891452 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1111/2228] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:19:39 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:19:39.897128 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603256dd-d368-4f7b-9b06-ff923b608ef0 service neutron] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:19:39.908270 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603256dd-d368-4f7b-9b06-ff923b608ef0 service neutron] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:19:39.912951 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7c2fc6-d44c-4b9e-bd79-3a6fb13048e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:19:39.913668 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7c2fc6-d44c-4b9e-bd79-3a6fb13048e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:19:39.914054 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7c2fc6-d44c-4b9e-bd79-3a6fb13048e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:19:39.914401 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7c2fc6-d44c-4b9e-bd79-3a6fb13048e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:19:39.915160 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7c2fc6-d44c-4b9e-bd79-3a6fb13048e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:19:39.917112 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7c2fc6-d44c-4b9e-bd79-3a6fb13048e9 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:19:39.945855 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1118/2229] 10.222.0.43 () {60 vars in 1152 bytes} [Wed Jun 22 10:19:39 2022] POST /identity/v3/projects => generated 377 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:19:39.949756 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e184663-fea7-4baa-af51-0f73d5b16c81 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:19:39.962335 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e184663-fea7-4baa-af51-0f73d5b16c81 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:19:40.019766 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6593fa0d-43dd-489e-979d-c768b0cd46c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:19:40.020451 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6593fa0d-43dd-489e-979d-c768b0cd46c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:19:40.020735 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6593fa0d-43dd-489e-979d-c768b0cd46c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:19:40.021016 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6593fa0d-43dd-489e-979d-c768b0cd46c2 admin admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:19:40.021745 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6593fa0d-43dd-489e-979d-c768b0cd46c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:19:40.023786 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6593fa0d-43dd-489e-979d-c768b0cd46c2 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:19:40.046304 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1112/2230] 10.222.0.43 () {60 vars in 1143 bytes} [Wed Jun 22 10:19:39 2022] POST /identity/v3/users => generated 295 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 10:19:40.049813 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7c2fc6-d44c-4b9e-bd79-3a6fb13048e9 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:19:40.070502 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7c2fc6-d44c-4b9e-bd79-3a6fb13048e9 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:19:40.082803 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c54f66-b9b2-4be1-bff6-d2189d0ed096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:19:40.083624 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c54f66-b9b2-4be1-bff6-d2189d0ed096 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:19:40.083917 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c54f66-b9b2-4be1-bff6-d2189d0ed096 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:19:40.084197 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c54f66-b9b2-4be1-bff6-d2189d0ed096 admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:19:40.085241 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c54f66-b9b2-4be1-bff6-d2189d0ed096 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:19:40.087631 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c54f66-b9b2-4be1-bff6-d2189d0ed096 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:19:40.099829 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1119/2231] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:19:40 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:19:40.106222 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6593fa0d-43dd-489e-979d-c768b0cd46c2 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:19:40.122930 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6593fa0d-43dd-489e-979d-c768b0cd46c2 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:19:40.128514 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3691564-242f-4d92-82bd-b1624b28de0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:19:40.129451 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3691564-242f-4d92-82bd-b1624b28de0d admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:19:40.129753 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3691564-242f-4d92-82bd-b1624b28de0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:19:40.130032 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3691564-242f-4d92-82bd-b1624b28de0d admin admin] PATH_INFO: `/v3/projects/0188989ab8b745338bb087d10c570c5f/users/926314de5db8403b9a0cba2e286d6ac5/roles/26d9c2ab5dfc4e6d9ca80c6014123906` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:19:40.150113 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3691564-242f-4d92-82bd-b1624b28de0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0188989ab8b745338bb087d10c570c5f, user_id=926314de5db8403b9a0cba2e286d6ac5, role_id=26d9c2ab5dfc4e6d9ca80c6014123906)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:19:40.153007 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3691564-242f-4d92-82bd-b1624b28de0d admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:19:40.168288 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1113/2232] 10.222.0.43 () {60 vars in 1482 bytes} [Wed Jun 22 10:19:40 2022] PUT /identity/v3/projects/0188989ab8b745338bb087d10c570c5f/users/926314de5db8403b9a0cba2e286d6ac5/roles/26d9c2ab5dfc4e6d9ca80c6014123906 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:19:40.172133 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c54f66-b9b2-4be1-bff6-d2189d0ed096 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:19:40.184998 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c54f66-b9b2-4be1-bff6-d2189d0ed096 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:19:40.244511 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d16f7f-129a-4642-b748-2004cf8daea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:19:40.245189 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d16f7f-129a-4642-b748-2004cf8daea9 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:19:40.245473 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d16f7f-129a-4642-b748-2004cf8daea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:19:40.245788 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d16f7f-129a-4642-b748-2004cf8daea9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:19:40.246521 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d16f7f-129a-4642-b748-2004cf8daea9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:19:40.248141 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d16f7f-129a-4642-b748-2004cf8daea9 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:19:40.260150 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1120/2233] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:19:40 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:19:40.264597 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3691564-242f-4d92-82bd-b1624b28de0d admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:19:40.279602 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3691564-242f-4d92-82bd-b1624b28de0d admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:19:40.284792 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97eb688-772f-478c-bb36-d2228ad5af48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:19:40.285924 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97eb688-772f-478c-bb36-d2228ad5af48 admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:19:40.286328 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97eb688-772f-478c-bb36-d2228ad5af48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:19:40.286745 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97eb688-772f-478c-bb36-d2228ad5af48 admin admin] PATH_INFO: `/v3/projects/0188989ab8b745338bb087d10c570c5f/users/926314de5db8403b9a0cba2e286d6ac5/roles/26d9c2ab5dfc4e6d9ca80c6014123906` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:19:40.289042 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97eb688-772f-478c-bb36-d2228ad5af48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0188989ab8b745338bb087d10c570c5f, user_id=926314de5db8403b9a0cba2e286d6ac5, role_id=26d9c2ab5dfc4e6d9ca80c6014123906)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:19:40.291795 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97eb688-772f-478c-bb36-d2228ad5af48 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:19:40.303471 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1114/2234] 10.222.0.43 () {60 vars in 1482 bytes} [Wed Jun 22 10:19:40 2022] PUT /identity/v3/projects/0188989ab8b745338bb087d10c570c5f/users/926314de5db8403b9a0cba2e286d6ac5/roles/26d9c2ab5dfc4e6d9ca80c6014123906 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:19:45.447222 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed399da-4e09-485a-bece-1967670e7868 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:19:45.447780 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed399da-4e09-485a-bece-1967670e7868 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:19:45.447953 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed399da-4e09-485a-bece-1967670e7868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:19:45.477475 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-4ed399da-4e09-485a-bece-1967670e7868 None None] MFA Rules not processed for user `926314de5db8403b9a0cba2e286d6ac5`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:19:45.478980 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-4ed399da-4e09-485a-bece-1967670e7868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:19:45.484659 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:19:45.567437 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1121/2235] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:19:45 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:19:45.581194 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97eb688-772f-478c-bb36-d2228ad5af48 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:19:45.583050 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-f97eb688-772f-478c-bb36-d2228ad5af48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:19:45.685082 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97eb688-772f-478c-bb36-d2228ad5af48 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:19:45.690891 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c9eeb5-cb9b-4564-8b0e-5753abecf77c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '158a49aa3750478a84bf71b9aad24397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:19:45.691539 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c9eeb5-cb9b-4564-8b0e-5753abecf77c service nova] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:19:45.691822 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c9eeb5-cb9b-4564-8b0e-5753abecf77c service nova] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:19:45.692098 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c9eeb5-cb9b-4564-8b0e-5753abecf77c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:19:45.713716 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:19:45.753022 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c9eeb5-cb9b-4564-8b0e-5753abecf77c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:19:45.754656 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c9eeb5-cb9b-4564-8b0e-5753abecf77c service nova] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:19:45.763949 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1115/2236] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:19:45 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:19:53.195025 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03cd0a9-8979-4c26-88e0-4cfb80f17cfc None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:19:53.195647 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03cd0a9-8979-4c26-88e0-4cfb80f17cfc None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:19:53.195647 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03cd0a9-8979-4c26-88e0-4cfb80f17cfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:19:53.214122 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-e03cd0a9-8979-4c26-88e0-4cfb80f17cfc None None] MFA Rules not processed for user `0d7292401816437fba46d073c4746e45`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:19:53.215468 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-e03cd0a9-8979-4c26-88e0-4cfb80f17cfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:19:53.276856 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1122/2237] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:19:53 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:19:55.761048 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=17 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:19:55.841806 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b80a181-c2e1-462c-a6c5-c27951017cac None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:19:55.842183 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b80a181-c2e1-462c-a6c5-c27951017cac None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:19:55.842450 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b80a181-c2e1-462c-a6c5-c27951017cac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:19:55.860850 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-9b80a181-c2e1-462c-a6c5-c27951017cac None None] MFA Rules not processed for user `75753b29a78640df9622d4e2655baf9b`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:19:55.862122 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-9b80a181-c2e1-462c-a6c5-c27951017cac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:19:55.924239 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1116/2238] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:19:55 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:20:02.337815 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c40b19-ba07-460e-acae-95e8ca975b95 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:02.338409 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c40b19-ba07-460e-acae-95e8ca975b95 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:02.338552 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c40b19-ba07-460e-acae-95e8ca975b95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:02.358075 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-90c40b19-ba07-460e-acae-95e8ca975b95 None None] MFA Rules not processed for user `b2d3aa18a0a146808f584127411a1cf5`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:20:02.359362 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-90c40b19-ba07-460e-acae-95e8ca975b95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:02.368956 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1123/2239] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:20:02 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:20:05.916956 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=25 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:12.354462 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=54 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:20.175545 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b80a181-c2e1-462c-a6c5-c27951017cac None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:20.238671 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b80a181-c2e1-462c-a6c5-c27951017cac None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:20.242588 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3a4e73-21af-4d01-870a-f5a67c868133 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe93d4c0737249fd8623bb5ce188e34e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:20.243246 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3a4e73-21af-4d01-870a-f5a67c868133 service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:20.243527 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3a4e73-21af-4d01-870a-f5a67c868133 service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:20.243797 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3a4e73-21af-4d01-870a-f5a67c868133 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:20.254404 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3a4e73-21af-4d01-870a-f5a67c868133 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:20.255858 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3a4e73-21af-4d01-870a-f5a67c868133 service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:20.265965 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1117/2240] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:20:20 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:20:30.261479 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=26 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:36.189057 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5ac088-2531-4186-b5c3-68d94944d907 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:36.189631 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5ac088-2531-4186-b5c3-68d94944d907 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:36.189833 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5ac088-2531-4186-b5c3-68d94944d907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:36.207836 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-0e5ac088-2531-4186-b5c3-68d94944d907 None None] MFA Rules not processed for user `7be3d844dcee4d19966fc7944463a0bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:20:36.209065 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-0e5ac088-2531-4186-b5c3-68d94944d907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:36.275684 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1124/2241] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:20:36 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:20:37.941275 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3a4e73-21af-4d01-870a-f5a67c868133 service neutron] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:37.942815 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-9b3a4e73-21af-4d01-870a-f5a67c868133 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:38.045371 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3a4e73-21af-4d01-870a-f5a67c868133 service neutron] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:38.053817 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7682e8a-de5b-4d4b-83e4-a8f31e89ff8b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bbcb3d4dc704dfdb0097abc594ca855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:38.054915 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7682e8a-de5b-4d4b-83e4-a8f31e89ff8b service cinder] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:38.055361 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7682e8a-de5b-4d4b-83e4-a8f31e89ff8b service cinder] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:38.055652 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7682e8a-de5b-4d4b-83e4-a8f31e89ff8b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:38.057945 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-b7682e8a-de5b-4d4b-83e4-a8f31e89ff8b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:38.075042 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7682e8a-de5b-4d4b-83e4-a8f31e89ff8b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:38.076727 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7682e8a-de5b-4d4b-83e4-a8f31e89ff8b service cinder] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:38.091354 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1118/2242] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:20:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:20:40.840986 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5ac088-2531-4186-b5c3-68d94944d907 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:40.842546 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-0e5ac088-2531-4186-b5c3-68d94944d907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:40.857266 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5ac088-2531-4186-b5c3-68d94944d907 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:40.861268 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4a83e7-41c0-4b60-bcb3-abe91c51accb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe93d4c0737249fd8623bb5ce188e34e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:40.861962 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4a83e7-41c0-4b60-bcb3-abe91c51accb service neutron] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:40.862246 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4a83e7-41c0-4b60-bcb3-abe91c51accb service neutron] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:40.862519 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4a83e7-41c0-4b60-bcb3-abe91c51accb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:40.864323 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-2a4a83e7-41c0-4b60-bcb3-abe91c51accb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:40.881223 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4a83e7-41c0-4b60-bcb3-abe91c51accb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:40.882921 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4a83e7-41c0-4b60-bcb3-abe91c51accb service neutron] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:40.897276 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1125/2243] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:20:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:20:48.084831 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=35 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:48.670937 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7682e8a-de5b-4d4b-83e4-a8f31e89ff8b service cinder] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:48.681525 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7682e8a-de5b-4d4b-83e4-a8f31e89ff8b service cinder] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:48.685881 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290f27ad-2418-497c-9b59-55f177dbd0e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe93d4c0737249fd8623bb5ce188e34e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:48.686546 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290f27ad-2418-497c-9b59-55f177dbd0e5 service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:48.686834 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290f27ad-2418-497c-9b59-55f177dbd0e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:48.687225 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290f27ad-2418-497c-9b59-55f177dbd0e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:48.689477 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-290f27ad-2418-497c-9b59-55f177dbd0e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:48.705029 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290f27ad-2418-497c-9b59-55f177dbd0e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:48.707616 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290f27ad-2418-497c-9b59-55f177dbd0e5 service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:48.733931 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1119/2244] 10.222.0.43 () {60 vars in 1396 bytes} [Wed Jun 22 10:20:48 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3248 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:20:50.460264 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a253f0-0078-4a7b-a31b-9c12e570a262 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:50.460754 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a253f0-0078-4a7b-a31b-9c12e570a262 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:50.460863 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a253f0-0078-4a7b-a31b-9c12e570a262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:50.480364 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-35a253f0-0078-4a7b-a31b-9c12e570a262 None None] MFA Rules not processed for user `78fe3fc4334c43d7a5ef6d70f9f57523`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:20:50.481563 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-35a253f0-0078-4a7b-a31b-9c12e570a262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:50.536982 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1126/2245] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:20:50 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:20:55.598549 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290f27ad-2418-497c-9b59-55f177dbd0e5 service neutron] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:20:55.599961 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-290f27ad-2418-497c-9b59-55f177dbd0e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:55.616791 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290f27ad-2418-497c-9b59-55f177dbd0e5 service neutron] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:20:55.623080 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c1ea14-4328-4328-b769-e7ec36e9ed27 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '158a49aa3750478a84bf71b9aad24397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:20:55.623770 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c1ea14-4328-4328-b769-e7ec36e9ed27 service nova] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:20:55.624117 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c1ea14-4328-4328-b769-e7ec36e9ed27 service nova] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:20:55.625023 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c1ea14-4328-4328-b769-e7ec36e9ed27 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:20:55.627078 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-48c1ea14-4328-4328-b769-e7ec36e9ed27 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:20:55.638011 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c1ea14-4328-4328-b769-e7ec36e9ed27 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:20:55.639642 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c1ea14-4328-4328-b769-e7ec36e9ed27 service nova] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:20:55.649927 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1120/2246] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:20:55 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:21:00.529751 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=56 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:03.127049 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a253f0-0078-4a7b-a31b-9c12e570a262 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:03.136607 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a253f0-0078-4a7b-a31b-9c12e570a262 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:03.140649 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d244666f-e3e0-46bb-ad34-89c6af224672 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe93d4c0737249fd8623bb5ce188e34e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:03.141292 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d244666f-e3e0-46bb-ad34-89c6af224672 service neutron] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:03.141580 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d244666f-e3e0-46bb-ad34-89c6af224672 service neutron] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:03.141898 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d244666f-e3e0-46bb-ad34-89c6af224672 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:03.143679 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-d244666f-e3e0-46bb-ad34-89c6af224672 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:03.206691 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d244666f-e3e0-46bb-ad34-89c6af224672 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:03.208135 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d244666f-e3e0-46bb-ad34-89c6af224672 service neutron] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:03.218301 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1127/2247] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:21:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:21:05.645664 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=12 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:06.761521 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c1ea14-4328-4328-b769-e7ec36e9ed27 service nova] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:06.763094 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-48c1ea14-4328-4328-b769-e7ec36e9ed27 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:06.783792 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c1ea14-4328-4328-b769-e7ec36e9ed27 service nova] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:06.788437 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d563f81-b8e6-4262-981a-a8855f225b5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:06.789342 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d563f81-b8e6-4262-981a-a8855f225b5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:06.789626 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d563f81-b8e6-4262-981a-a8855f225b5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:06.789943 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d563f81-b8e6-4262-981a-a8855f225b5d admin admin] PATH_INFO: `/v3/users/0d7292401816437fba46d073c4746e45` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:06.791171 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d563f81-b8e6-4262-981a-a8855f225b5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d7292401816437fba46d073c4746e45)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:06.793112 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d563f81-b8e6-4262-981a-a8855f225b5d admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:06.848458 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-8d563f81-b8e6-4262-981a-a8855f225b5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d7292401816437fba46d073c4746e45'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:06.861939 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-8d563f81-b8e6-4262-981a-a8855f225b5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d7292401816437fba46d073c4746e45'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:06.871867 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-8d563f81-b8e6-4262-981a-a8855f225b5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d7292401816437fba46d073c4746e45'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:06.874714 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-8d563f81-b8e6-4262-981a-a8855f225b5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d7292401816437fba46d073c4746e45'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:06.883137 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-8d563f81-b8e6-4262-981a-a8855f225b5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d7292401816437fba46d073c4746e45'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:06.893446 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1121/2248] 10.222.0.43 () {58 vars in 1223 bytes} [Wed Jun 22 10:21:06 2022] DELETE /identity/v3/users/0d7292401816437fba46d073c4746e45 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:21:07.150900 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d244666f-e3e0-46bb-ad34-89c6af224672 service neutron] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:07.170646 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d244666f-e3e0-46bb-ad34-89c6af224672 service neutron] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:07.235330 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d40ca8-fe0a-48c7-81e0-e656f6575c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:07.236200 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d40ca8-fe0a-48c7-81e0-e656f6575c44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:07.236485 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d40ca8-fe0a-48c7-81e0-e656f6575c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:07.236762 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d40ca8-fe0a-48c7-81e0-e656f6575c44 admin admin] PATH_INFO: `/v3/projects/c3277b9cbc4b4a8bbacee8440cea1ed2` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:07.238003 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d40ca8-fe0a-48c7-81e0-e656f6575c44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3277b9cbc4b4a8bbacee8440cea1ed2)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:07.239932 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d40ca8-fe0a-48c7-81e0-e656f6575c44 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:07.287214 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-96d40ca8-fe0a-48c7-81e0-e656f6575c44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3277b9cbc4b4a8bbacee8440cea1ed2', 'request_id': 'req-96d40ca8-fe0a-48c7-81e0-e656f6575c44'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:07.293284 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-96d40ca8-fe0a-48c7-81e0-e656f6575c44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3277b9cbc4b4a8bbacee8440cea1ed2', 'request_id': 'req-96d40ca8-fe0a-48c7-81e0-e656f6575c44'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:07.298840 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-96d40ca8-fe0a-48c7-81e0-e656f6575c44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3277b9cbc4b4a8bbacee8440cea1ed2', 'request_id': 'req-96d40ca8-fe0a-48c7-81e0-e656f6575c44'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:07.311080 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-96d40ca8-fe0a-48c7-81e0-e656f6575c44 admin admin] The token cache is being invalidate because project c3277b9cbc4b4a8bbacee8440cea1ed2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:21:07.311368 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-96d40ca8-fe0a-48c7-81e0-e656f6575c44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:07.311994 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-96d40ca8-fe0a-48c7-81e0-e656f6575c44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:07.313551 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1128/2249] 10.222.0.43 () {58 vars in 1232 bytes} [Wed Jun 22 10:21:07 2022] DELETE /identity/v3/projects/c3277b9cbc4b4a8bbacee8440cea1ed2 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:21:07.318627 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ce5cd2-5258-4dd3-b5e0-e260119b841a None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:07.318925 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ce5cd2-5258-4dd3-b5e0-e260119b841a None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:07.319211 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ce5cd2-5258-4dd3-b5e0-e260119b841a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:07.338251 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-60ce5cd2-5258-4dd3-b5e0-e260119b841a None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:21:07.339466 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-60ce5cd2-5258-4dd3-b5e0-e260119b841a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:07.398657 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1122/2250] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:21:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:21:07.407113 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccc3f73-0388-4fe4-a02b-2aded536fd37 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:07.407406 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccc3f73-0388-4fe4-a02b-2aded536fd37 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:07.407687 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccc3f73-0388-4fe4-a02b-2aded536fd37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:07.425933 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-4ccc3f73-0388-4fe4-a02b-2aded536fd37 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:21:07.427134 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-4ccc3f73-0388-4fe4-a02b-2aded536fd37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:07.435223 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1129/2251] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:21:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:21:07.439475 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ce5cd2-5258-4dd3-b5e0-e260119b841a None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:07.449183 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ce5cd2-5258-4dd3-b5e0-e260119b841a None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:07.454440 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c65a77-b18b-43cb-b91f-bc0e222f6075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:07.455096 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c65a77-b18b-43cb-b91f-bc0e222f6075 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:07.455387 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c65a77-b18b-43cb-b91f-bc0e222f6075 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:07.455670 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c65a77-b18b-43cb-b91f-bc0e222f6075 admin admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:07.456405 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c65a77-b18b-43cb-b91f-bc0e222f6075 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:21:07.456718 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c65a77-b18b-43cb-b91f-bc0e222f6075 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:07.458377 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c65a77-b18b-43cb-b91f-bc0e222f6075 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:07.471081 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1123/2252] 10.222.0.43 () {58 vars in 1152 bytes} [Wed Jun 22 10:21:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:21:07.474934 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccc3f73-0388-4fe4-a02b-2aded536fd37 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:07.484432 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccc3f73-0388-4fe4-a02b-2aded536fd37 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:07.489107 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aa3a25-39f3-4734-bed4-b909932fd7a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:07.489795 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aa3a25-39f3-4734-bed4-b909932fd7a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:07.490085 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aa3a25-39f3-4734-bed4-b909932fd7a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:07.490453 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aa3a25-39f3-4734-bed4-b909932fd7a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:07.491160 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45aa3a25-39f3-4734-bed4-b909932fd7a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:07.493075 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45aa3a25-39f3-4734-bed4-b909932fd7a8 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:07.509147 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:07.525987 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1130/2253] 10.222.0.43 () {60 vars in 1152 bytes} [Wed Jun 22 10:21:07 2022] POST /identity/v3/projects => generated 403 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:21:07.527092 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c65a77-b18b-43cb-b91f-bc0e222f6075 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:07.538386 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c65a77-b18b-43cb-b91f-bc0e222f6075 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:07.600388 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c7c5d4-e842-4f40-a228-2e43b8b9830f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:07.601095 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c7c5d4-e842-4f40-a228-2e43b8b9830f admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:07.601426 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c7c5d4-e842-4f40-a228-2e43b8b9830f admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:07.601663 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c7c5d4-e842-4f40-a228-2e43b8b9830f admin admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:07.602741 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c7c5d4-e842-4f40-a228-2e43b8b9830f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:07.604775 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c7c5d4-e842-4f40-a228-2e43b8b9830f admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:07.612458 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:07.633967 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1124/2254] 10.222.0.43 () {60 vars in 1143 bytes} [Wed Jun 22 10:21:07 2022] POST /identity/v3/users => generated 302 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 10:21:07.635212 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aa3a25-39f3-4734-bed4-b909932fd7a8 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:07.649557 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aa3a25-39f3-4734-bed4-b909932fd7a8 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:07.654346 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bdde14-97d6-4a8c-ab22-a866d9001d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:07.655043 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bdde14-97d6-4a8c-ab22-a866d9001d81 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:07.655807 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bdde14-97d6-4a8c-ab22-a866d9001d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:07.655807 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bdde14-97d6-4a8c-ab22-a866d9001d81 admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:07.656503 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bdde14-97d6-4a8c-ab22-a866d9001d81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:07.658196 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bdde14-97d6-4a8c-ab22-a866d9001d81 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:07.669223 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1131/2255] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:21:07 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:21:07.673636 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c7c5d4-e842-4f40-a228-2e43b8b9830f admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:07.685163 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c7c5d4-e842-4f40-a228-2e43b8b9830f admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:07.694431 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeae51f-ec2d-431e-adca-a84fce239ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:07.695178 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeae51f-ec2d-431e-adca-a84fce239ce1 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:07.695466 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeae51f-ec2d-431e-adca-a84fce239ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:07.695747 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeae51f-ec2d-431e-adca-a84fce239ce1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:07.696545 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eeae51f-ec2d-431e-adca-a84fce239ce1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:07.698220 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eeae51f-ec2d-431e-adca-a84fce239ce1 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:07.710357 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1125/2256] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:21:07 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 10:21:07.714786 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bdde14-97d6-4a8c-ab22-a866d9001d81 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:07.725813 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bdde14-97d6-4a8c-ab22-a866d9001d81 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:07.731087 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c20df67-e071-4636-a34e-7e08a07b8204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:07.731974 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c20df67-e071-4636-a34e-7e08a07b8204 admin admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:07.732264 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c20df67-e071-4636-a34e-7e08a07b8204 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:07.732548 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c20df67-e071-4636-a34e-7e08a07b8204 admin admin] PATH_INFO: `/v3/projects/4f559d27bf82473d81e9d1116b7af226/users/15b9128434504224a3e540d6bf7fcaec/roles/9f88c83743f745a9a785a2f454753f06` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:07.749346 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c20df67-e071-4636-a34e-7e08a07b8204 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f559d27bf82473d81e9d1116b7af226, user_id=15b9128434504224a3e540d6bf7fcaec, role_id=9f88c83743f745a9a785a2f454753f06)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:07.752074 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c20df67-e071-4636-a34e-7e08a07b8204 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:07.765338 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1132/2257] 10.222.0.43 () {60 vars in 1482 bytes} [Wed Jun 22 10:21:07 2022] PUT /identity/v3/projects/4f559d27bf82473d81e9d1116b7af226/users/15b9128434504224a3e540d6bf7fcaec/roles/9f88c83743f745a9a785a2f454753f06 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:21:07.775397 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abeaf33-97b4-47ca-9029-326422a717a9 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:07.775874 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abeaf33-97b4-47ca-9029-326422a717a9 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:07.775984 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abeaf33-97b4-47ca-9029-326422a717a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:07.803744 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-5abeaf33-97b4-47ca-9029-326422a717a9 None None] MFA Rules not processed for user `15b9128434504224a3e540d6bf7fcaec`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:21:07.804932 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-5abeaf33-97b4-47ca-9029-326422a717a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:07.868603 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1126/2258] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:21:07 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:21:07.873040 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c20df67-e071-4636-a34e-7e08a07b8204 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:07.935395 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c20df67-e071-4636-a34e-7e08a07b8204 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:07.940077 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8860e862-9b92-4f03-8faa-c0d8da1e0421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:07.940735 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8860e862-9b92-4f03-8faa-c0d8da1e0421 admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:07.941021 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8860e862-9b92-4f03-8faa-c0d8da1e0421 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:07.941301 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8860e862-9b92-4f03-8faa-c0d8da1e0421 admin admin] PATH_INFO: `/v3/projects` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:07.942023 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8860e862-9b92-4f03-8faa-c0d8da1e0421 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:07.943935 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8860e862-9b92-4f03-8faa-c0d8da1e0421 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:07.969429 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1133/2259] 10.222.0.43 () {60 vars in 1152 bytes} [Wed Jun 22 10:21:07 2022] POST /identity/v3/projects => generated 403 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:21:07.973456 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abeaf33-97b4-47ca-9029-326422a717a9 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:07.984435 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abeaf33-97b4-47ca-9029-326422a717a9 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:08.040439 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1426fba-2b7d-47b7-a26c-670262238e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:08.041103 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1426fba-2b7d-47b7-a26c-670262238e84 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:08.041391 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1426fba-2b7d-47b7-a26c-670262238e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:08.041665 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1426fba-2b7d-47b7-a26c-670262238e84 admin admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:08.042379 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1426fba-2b7d-47b7-a26c-670262238e84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:08.044285 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1426fba-2b7d-47b7-a26c-670262238e84 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:08.063833 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1127/2260] 10.222.0.43 () {60 vars in 1143 bytes} [Wed Jun 22 10:21:07 2022] POST /identity/v3/users => generated 308 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 10:21:08.067775 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8860e862-9b92-4f03-8faa-c0d8da1e0421 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:08.078414 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8860e862-9b92-4f03-8faa-c0d8da1e0421 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:08.082958 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1243f326-f558-4da0-a66b-1b9fb7a7f7b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:08.083607 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1243f326-f558-4da0-a66b-1b9fb7a7f7b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:08.083890 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1243f326-f558-4da0-a66b-1b9fb7a7f7b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:08.084164 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1243f326-f558-4da0-a66b-1b9fb7a7f7b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:08.084885 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1243f326-f558-4da0-a66b-1b9fb7a7f7b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:08.086517 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1243f326-f558-4da0-a66b-1b9fb7a7f7b2 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:08.097983 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1134/2261] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:21:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:21:08.102124 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1426fba-2b7d-47b7-a26c-670262238e84 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:08.113276 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1426fba-2b7d-47b7-a26c-670262238e84 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:08.117977 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a76034-1dd6-4f13-8534-4430a410e62d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:08.118861 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a76034-1dd6-4f13-8534-4430a410e62d admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:08.119147 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a76034-1dd6-4f13-8534-4430a410e62d admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:08.119423 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a76034-1dd6-4f13-8534-4430a410e62d admin admin] PATH_INFO: `/v3/projects/bcd52598bfec46e1973ac218d3111690/users/cd70d97d89c345ae9e2095e874b77a0b/roles/26d9c2ab5dfc4e6d9ca80c6014123906` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:08.134392 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a76034-1dd6-4f13-8534-4430a410e62d admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcd52598bfec46e1973ac218d3111690, user_id=cd70d97d89c345ae9e2095e874b77a0b, role_id=26d9c2ab5dfc4e6d9ca80c6014123906)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:08.137110 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a76034-1dd6-4f13-8534-4430a410e62d admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:08.150825 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1128/2262] 10.222.0.43 () {60 vars in 1482 bytes} [Wed Jun 22 10:21:08 2022] PUT /identity/v3/projects/bcd52598bfec46e1973ac218d3111690/users/cd70d97d89c345ae9e2095e874b77a0b/roles/26d9c2ab5dfc4e6d9ca80c6014123906 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:21:08.154852 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1243f326-f558-4da0-a66b-1b9fb7a7f7b2 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:08.165427 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1243f326-f558-4da0-a66b-1b9fb7a7f7b2 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:08.223918 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f2e56d-4099-4de4-b47e-6b12f3cfe662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:08.224501 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f2e56d-4099-4de4-b47e-6b12f3cfe662 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:08.224784 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f2e56d-4099-4de4-b47e-6b12f3cfe662 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:08.225058 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f2e56d-4099-4de4-b47e-6b12f3cfe662 admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:08.225817 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f2e56d-4099-4de4-b47e-6b12f3cfe662 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:08.227683 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f2e56d-4099-4de4-b47e-6b12f3cfe662 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:08.238208 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1135/2263] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:21:08 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:21:08.242513 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a76034-1dd6-4f13-8534-4430a410e62d admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:08.254197 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a76034-1dd6-4f13-8534-4430a410e62d admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:08.258983 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70048c54-438a-4751-931c-bd95c7ddfd0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:08.259913 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70048c54-438a-4751-931c-bd95c7ddfd0e admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:08.260202 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70048c54-438a-4751-931c-bd95c7ddfd0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:08.260482 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70048c54-438a-4751-931c-bd95c7ddfd0e admin admin] PATH_INFO: `/v3/projects/bcd52598bfec46e1973ac218d3111690/users/cd70d97d89c345ae9e2095e874b77a0b/roles/26d9c2ab5dfc4e6d9ca80c6014123906` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:08.262538 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70048c54-438a-4751-931c-bd95c7ddfd0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcd52598bfec46e1973ac218d3111690, user_id=cd70d97d89c345ae9e2095e874b77a0b, role_id=26d9c2ab5dfc4e6d9ca80c6014123906)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:08.268582 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70048c54-438a-4751-931c-bd95c7ddfd0e admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:08.279814 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1129/2264] 10.222.0.43 () {60 vars in 1482 bytes} [Wed Jun 22 10:21:08 2022] PUT /identity/v3/projects/bcd52598bfec46e1973ac218d3111690/users/cd70d97d89c345ae9e2095e874b77a0b/roles/26d9c2ab5dfc4e6d9ca80c6014123906 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:21:08.292612 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05fa487-6159-4e82-b931-9f914e32aade None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:08.292987 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05fa487-6159-4e82-b931-9f914e32aade None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:08.293278 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05fa487-6159-4e82-b931-9f914e32aade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:08.320755 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-b05fa487-6159-4e82-b931-9f914e32aade None None] MFA Rules not processed for user `cd70d97d89c345ae9e2095e874b77a0b`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:21:08.322130 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-b05fa487-6159-4e82-b931-9f914e32aade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:08.340447 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:08.394723 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1136/2265] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:21:08 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:21:08.406246 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70048c54-438a-4751-931c-bd95c7ddfd0e admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:08.408823 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-70048c54-438a-4751-931c-bd95c7ddfd0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:08.433239 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:08.489057 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70048c54-438a-4751-931c-bd95c7ddfd0e admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:08.492926 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee536cd-0fc8-4bbf-ad98-f9cf070c2de5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bbcb3d4dc704dfdb0097abc594ca855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:08.493590 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee536cd-0fc8-4bbf-ad98-f9cf070c2de5 service cinder] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:08.494050 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee536cd-0fc8-4bbf-ad98-f9cf070c2de5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:08.494327 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee536cd-0fc8-4bbf-ad98-f9cf070c2de5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:08.504304 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee536cd-0fc8-4bbf-ad98-f9cf070c2de5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:08.505835 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee536cd-0fc8-4bbf-ad98-f9cf070c2de5 service cinder] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:08.515926 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1130/2266] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:21:08 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:21:08.648045 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05fa487-6159-4e82-b931-9f914e32aade None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:08.713746 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05fa487-6159-4e82-b931-9f914e32aade None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:08.719518 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c033e920-3f4e-4fa9-8808-214686fa2898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:08.720670 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c033e920-3f4e-4fa9-8808-214686fa2898 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:08.721353 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c033e920-3f4e-4fa9-8808-214686fa2898 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:08.721598 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c033e920-3f4e-4fa9-8808-214686fa2898 admin admin] PATH_INFO: `/v3/users/15b9128434504224a3e540d6bf7fcaec` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:08.723546 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c033e920-3f4e-4fa9-8808-214686fa2898 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15b9128434504224a3e540d6bf7fcaec)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:08.726607 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c033e920-3f4e-4fa9-8808-214686fa2898 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:08.783253 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-c033e920-3f4e-4fa9-8808-214686fa2898 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15b9128434504224a3e540d6bf7fcaec'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:08.797978 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-c033e920-3f4e-4fa9-8808-214686fa2898 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15b9128434504224a3e540d6bf7fcaec'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:08.805559 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-c033e920-3f4e-4fa9-8808-214686fa2898 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15b9128434504224a3e540d6bf7fcaec'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:08.813048 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-c033e920-3f4e-4fa9-8808-214686fa2898 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15b9128434504224a3e540d6bf7fcaec'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:08.813786 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-c033e920-3f4e-4fa9-8808-214686fa2898 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15b9128434504224a3e540d6bf7fcaec'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:08.819631 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1137/2267] 10.222.0.43 () {58 vars in 1223 bytes} [Wed Jun 22 10:21:08 2022] DELETE /identity/v3/users/15b9128434504224a3e540d6bf7fcaec => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:21:08.824144 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a50eff-0661-4cc0-bc68-fb3947467026 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:08.824674 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a50eff-0661-4cc0-bc68-fb3947467026 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:08.824790 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a50eff-0661-4cc0-bc68-fb3947467026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:08.844724 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-92a50eff-0661-4cc0-bc68-fb3947467026 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:21:08.845974 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-92a50eff-0661-4cc0-bc68-fb3947467026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:08.916912 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1131/2268] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:21:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:21:08.927692 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c033e920-3f4e-4fa9-8808-214686fa2898 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:08.929182 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-c033e920-3f4e-4fa9-8808-214686fa2898 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:08.974292 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:09.001508 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c033e920-3f4e-4fa9-8808-214686fa2898 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:09.005119 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e255ef1-44fb-46c4-92e6-fb74ab944e9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe93d4c0737249fd8623bb5ce188e34e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:09.005838 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e255ef1-44fb-46c4-92e6-fb74ab944e9f service neutron] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:09.006153 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e255ef1-44fb-46c4-92e6-fb74ab944e9f service neutron] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:09.006441 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e255ef1-44fb-46c4-92e6-fb74ab944e9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:09.016900 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e255ef1-44fb-46c4-92e6-fb74ab944e9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:09.018402 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e255ef1-44fb-46c4-92e6-fb74ab944e9f service neutron] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:09.029551 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1138/2269] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:21:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:21:09.480341 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a50eff-0661-4cc0-bc68-fb3947467026 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:09.481943 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-92a50eff-0661-4cc0-bc68-fb3947467026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:09.494253 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a50eff-0661-4cc0-bc68-fb3947467026 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:09.498991 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca858b34-0298-4e75-8fc1-0f137114806e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:09.500070 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca858b34-0298-4e75-8fc1-0f137114806e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:09.500353 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca858b34-0298-4e75-8fc1-0f137114806e admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:09.500633 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca858b34-0298-4e75-8fc1-0f137114806e admin admin] PATH_INFO: `/v3/projects/4f559d27bf82473d81e9d1116b7af226` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:09.501896 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca858b34-0298-4e75-8fc1-0f137114806e admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f559d27bf82473d81e9d1116b7af226)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:09.503826 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca858b34-0298-4e75-8fc1-0f137114806e admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:09.554543 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-ca858b34-0298-4e75-8fc1-0f137114806e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f559d27bf82473d81e9d1116b7af226', 'request_id': 'req-ca858b34-0298-4e75-8fc1-0f137114806e'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:09.560365 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-ca858b34-0298-4e75-8fc1-0f137114806e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f559d27bf82473d81e9d1116b7af226', 'request_id': 'req-ca858b34-0298-4e75-8fc1-0f137114806e'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:09.568838 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-ca858b34-0298-4e75-8fc1-0f137114806e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f559d27bf82473d81e9d1116b7af226', 'request_id': 'req-ca858b34-0298-4e75-8fc1-0f137114806e'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:09.581589 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-ca858b34-0298-4e75-8fc1-0f137114806e admin admin] The token cache is being invalidate because project 4f559d27bf82473d81e9d1116b7af226 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:21:09.581998 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-ca858b34-0298-4e75-8fc1-0f137114806e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:09.582722 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-ca858b34-0298-4e75-8fc1-0f137114806e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:09.584355 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1132/2270] 10.222.0.43 () {58 vars in 1232 bytes} [Wed Jun 22 10:21:09 2022] DELETE /identity/v3/projects/4f559d27bf82473d81e9d1116b7af226 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:21:09.588468 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e255ef1-44fb-46c4-92e6-fb74ab944e9f service neutron] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:09.598961 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e255ef1-44fb-46c4-92e6-fb74ab944e9f service neutron] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:09.659576 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09ea15e-82ca-46f9-afa5-a2a258281873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:09.660577 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09ea15e-82ca-46f9-afa5-a2a258281873 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:09.660931 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09ea15e-82ca-46f9-afa5-a2a258281873 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:09.661274 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09ea15e-82ca-46f9-afa5-a2a258281873 admin admin] PATH_INFO: `/v3/users/cd70d97d89c345ae9e2095e874b77a0b` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:09.662649 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09ea15e-82ca-46f9-afa5-a2a258281873 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd70d97d89c345ae9e2095e874b77a0b)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:09.664615 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09ea15e-82ca-46f9-afa5-a2a258281873 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:09.712498 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-b09ea15e-82ca-46f9-afa5-a2a258281873 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd70d97d89c345ae9e2095e874b77a0b'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:09.725399 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-b09ea15e-82ca-46f9-afa5-a2a258281873 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd70d97d89c345ae9e2095e874b77a0b'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:09.737985 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-b09ea15e-82ca-46f9-afa5-a2a258281873 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd70d97d89c345ae9e2095e874b77a0b'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:09.747183 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-b09ea15e-82ca-46f9-afa5-a2a258281873 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd70d97d89c345ae9e2095e874b77a0b'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:09.747949 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-b09ea15e-82ca-46f9-afa5-a2a258281873 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd70d97d89c345ae9e2095e874b77a0b'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:09.755239 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1139/2271] 10.222.0.43 () {58 vars in 1223 bytes} [Wed Jun 22 10:21:09 2022] DELETE /identity/v3/users/cd70d97d89c345ae9e2095e874b77a0b => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:21:09.900461 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca858b34-0298-4e75-8fc1-0f137114806e admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:09.902657 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-ca858b34-0298-4e75-8fc1-0f137114806e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:09.968191 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:09.976748 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca858b34-0298-4e75-8fc1-0f137114806e admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:10.042121 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50de3cb-eca7-4a82-9158-c2a78cef47a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe93d4c0737249fd8623bb5ce188e34e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:10.043227 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50de3cb-eca7-4a82-9158-c2a78cef47a3 service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:10.043590 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50de3cb-eca7-4a82-9158-c2a78cef47a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:10.043940 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50de3cb-eca7-4a82-9158-c2a78cef47a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:10.047304 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-d50de3cb-eca7-4a82-9158-c2a78cef47a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:10.059222 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50de3cb-eca7-4a82-9158-c2a78cef47a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:10.060672 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50de3cb-eca7-4a82-9158-c2a78cef47a3 service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:10.071901 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1133/2272] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:21:09 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:21:10.167624 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09ea15e-82ca-46f9-afa5-a2a258281873 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:10.169221 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-b09ea15e-82ca-46f9-afa5-a2a258281873 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:10.284095 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:10.288824 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09ea15e-82ca-46f9-afa5-a2a258281873 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:10.298518 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f85a74-4b21-4d2d-9459-b41877ad2277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:10.300385 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f85a74-4b21-4d2d-9459-b41877ad2277 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:10.300685 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f85a74-4b21-4d2d-9459-b41877ad2277 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:10.301519 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f85a74-4b21-4d2d-9459-b41877ad2277 admin admin] PATH_INFO: `/v3/projects/bcd52598bfec46e1973ac218d3111690` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:10.303168 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f85a74-4b21-4d2d-9459-b41877ad2277 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bcd52598bfec46e1973ac218d3111690)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:10.305257 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f85a74-4b21-4d2d-9459-b41877ad2277 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:10.368798 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-45f85a74-4b21-4d2d-9459-b41877ad2277 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bcd52598bfec46e1973ac218d3111690', 'request_id': 'req-45f85a74-4b21-4d2d-9459-b41877ad2277'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:10.375655 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-45f85a74-4b21-4d2d-9459-b41877ad2277 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bcd52598bfec46e1973ac218d3111690', 'request_id': 'req-45f85a74-4b21-4d2d-9459-b41877ad2277'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:10.381875 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-45f85a74-4b21-4d2d-9459-b41877ad2277 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bcd52598bfec46e1973ac218d3111690', 'request_id': 'req-45f85a74-4b21-4d2d-9459-b41877ad2277'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:10.403460 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-45f85a74-4b21-4d2d-9459-b41877ad2277 admin admin] The token cache is being invalidate because project bcd52598bfec46e1973ac218d3111690 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:21:10.403771 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-45f85a74-4b21-4d2d-9459-b41877ad2277 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:10.407473 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-45f85a74-4b21-4d2d-9459-b41877ad2277 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:10.411210 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1140/2273] 10.222.0.43 () {58 vars in 1232 bytes} [Wed Jun 22 10:21:10 2022] DELETE /identity/v3/projects/bcd52598bfec46e1973ac218d3111690 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:21:10.413061 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c5bcc6-c3e6-49d4-a796-66b01ff87a55 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:10.413354 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c5bcc6-c3e6-49d4-a796-66b01ff87a55 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:10.413679 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c5bcc6-c3e6-49d4-a796-66b01ff87a55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:10.434185 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-a2c5bcc6-c3e6-49d4-a796-66b01ff87a55 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:21:10.435733 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-a2c5bcc6-c3e6-49d4-a796-66b01ff87a55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:10.519834 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1134/2274] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:21:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:21:10.527251 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7c463d-ab4d-4897-b228-c8cf360b310e None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:10.527747 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7c463d-ab4d-4897-b228-c8cf360b310e None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:10.528127 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7c463d-ab4d-4897-b228-c8cf360b310e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:10.557141 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-6b7c463d-ab4d-4897-b228-c8cf360b310e None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:21:10.559339 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-6b7c463d-ab4d-4897-b228-c8cf360b310e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:10.571790 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1141/2275] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:21:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:21:10.578475 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c5bcc6-c3e6-49d4-a796-66b01ff87a55 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:10.596112 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c5bcc6-c3e6-49d4-a796-66b01ff87a55 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:10.601939 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab3d903-14b0-44ca-85be-8052a0576f4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:10.603249 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab3d903-14b0-44ca-85be-8052a0576f4f admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:10.603692 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab3d903-14b0-44ca-85be-8052a0576f4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:10.604124 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab3d903-14b0-44ca-85be-8052a0576f4f admin admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:10.605018 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab3d903-14b0-44ca-85be-8052a0576f4f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:21:10.605481 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab3d903-14b0-44ca-85be-8052a0576f4f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:10.607487 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab3d903-14b0-44ca-85be-8052a0576f4f admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:10.626141 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1135/2276] 10.222.0.43 () {58 vars in 1152 bytes} [Wed Jun 22 10:21:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:21:10.627392 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7c463d-ab4d-4897-b228-c8cf360b310e None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:10.637785 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7c463d-ab4d-4897-b228-c8cf360b310e None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:10.643513 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2abfdf-1778-4108-8402-f6fc87ad791c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:10.644188 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2abfdf-1778-4108-8402-f6fc87ad791c admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:10.644475 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2abfdf-1778-4108-8402-f6fc87ad791c admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:10.644757 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2abfdf-1778-4108-8402-f6fc87ad791c admin admin] PATH_INFO: `/v3/projects` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:10.645462 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2abfdf-1778-4108-8402-f6fc87ad791c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:10.647430 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2abfdf-1778-4108-8402-f6fc87ad791c admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:10.674392 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1142/2277] 10.222.0.43 () {60 vars in 1152 bytes} [Wed Jun 22 10:21:10 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:21:10.678385 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab3d903-14b0-44ca-85be-8052a0576f4f admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:10.689169 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab3d903-14b0-44ca-85be-8052a0576f4f admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:10.759610 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332d5c7e-1195-44c7-8f20-7c3f44989b10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:10.760316 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332d5c7e-1195-44c7-8f20-7c3f44989b10 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:10.760821 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332d5c7e-1195-44c7-8f20-7c3f44989b10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:10.760950 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332d5c7e-1195-44c7-8f20-7c3f44989b10 admin admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:10.761660 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332d5c7e-1195-44c7-8f20-7c3f44989b10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:10.763696 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332d5c7e-1195-44c7-8f20-7c3f44989b10 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:10.791916 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1136/2278] 10.222.0.43 () {60 vars in 1143 bytes} [Wed Jun 22 10:21:10 2022] POST /identity/v3/users => generated 293 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 10:21:10.793242 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2abfdf-1778-4108-8402-f6fc87ad791c admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:10.804072 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2abfdf-1778-4108-8402-f6fc87ad791c admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:10.809181 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dd3c82-bf0e-426a-a5fa-6d0eeedbdc2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:10.809889 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dd3c82-bf0e-426a-a5fa-6d0eeedbdc2b admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:10.810173 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dd3c82-bf0e-426a-a5fa-6d0eeedbdc2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:10.810449 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dd3c82-bf0e-426a-a5fa-6d0eeedbdc2b admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:10.811732 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dd3c82-bf0e-426a-a5fa-6d0eeedbdc2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:10.813358 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dd3c82-bf0e-426a-a5fa-6d0eeedbdc2b admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:10.824532 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1143/2279] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:21:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:21:10.829211 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332d5c7e-1195-44c7-8f20-7c3f44989b10 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:10.839808 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332d5c7e-1195-44c7-8f20-7c3f44989b10 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:10.845391 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a276e281-f4ca-4320-8dde-2fb3019dbb0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:10.846278 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a276e281-f4ca-4320-8dde-2fb3019dbb0a admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:10.846545 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a276e281-f4ca-4320-8dde-2fb3019dbb0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:10.846751 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a276e281-f4ca-4320-8dde-2fb3019dbb0a admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:10.847491 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a276e281-f4ca-4320-8dde-2fb3019dbb0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:10.849119 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a276e281-f4ca-4320-8dde-2fb3019dbb0a admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:10.865116 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1137/2280] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:21:10 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:21:10.866431 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dd3c82-bf0e-426a-a5fa-6d0eeedbdc2b admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:10.878581 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dd3c82-bf0e-426a-a5fa-6d0eeedbdc2b admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:10.884468 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96010e0-553b-4651-b4a9-eba5d5614886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:10.885367 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96010e0-553b-4651-b4a9-eba5d5614886 admin admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:10.885655 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96010e0-553b-4651-b4a9-eba5d5614886 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:10.885966 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96010e0-553b-4651-b4a9-eba5d5614886 admin admin] PATH_INFO: `/v3/projects/8a2a78007ee8473f82a4ae8f0012cc4a/users/3686f831bd4a4f7487cc31d795c8d7d4/roles/9f88c83743f745a9a785a2f454753f06` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:10.903103 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96010e0-553b-4651-b4a9-eba5d5614886 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a2a78007ee8473f82a4ae8f0012cc4a, user_id=3686f831bd4a4f7487cc31d795c8d7d4, role_id=9f88c83743f745a9a785a2f454753f06)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:10.906320 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96010e0-553b-4651-b4a9-eba5d5614886 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:10.923589 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1144/2281] 10.222.0.43 () {60 vars in 1482 bytes} [Wed Jun 22 10:21:10 2022] PUT /identity/v3/projects/8a2a78007ee8473f82a4ae8f0012cc4a/users/3686f831bd4a4f7487cc31d795c8d7d4/roles/9f88c83743f745a9a785a2f454753f06 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:21:10.933760 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a49cef5-a4d2-47e3-ab5c-03c67b99c554 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:10.934290 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a49cef5-a4d2-47e3-ab5c-03c67b99c554 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:10.934467 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a49cef5-a4d2-47e3-ab5c-03c67b99c554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:10.955537 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:10.964251 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-4a49cef5-a4d2-47e3-ab5c-03c67b99c554 None None] MFA Rules not processed for user `3686f831bd4a4f7487cc31d795c8d7d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:21:10.966178 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-4a49cef5-a4d2-47e3-ab5c-03c67b99c554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:11.036030 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1138/2282] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:21:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:21:11.040617 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96010e0-553b-4651-b4a9-eba5d5614886 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:11.115440 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96010e0-553b-4651-b4a9-eba5d5614886 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:11.120270 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dd6816-0c0a-47e9-a096-d70425a70ee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:11.120929 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dd6816-0c0a-47e9-a096-d70425a70ee0 admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:11.121215 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dd6816-0c0a-47e9-a096-d70425a70ee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:11.121497 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dd6816-0c0a-47e9-a096-d70425a70ee0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:11.122234 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dd6816-0c0a-47e9-a096-d70425a70ee0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:11.124920 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dd6816-0c0a-47e9-a096-d70425a70ee0 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:11.152418 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1145/2283] 10.222.0.43 () {60 vars in 1152 bytes} [Wed Jun 22 10:21:11 2022] POST /identity/v3/projects => generated 385 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:21:11.156492 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a49cef5-a4d2-47e3-ab5c-03c67b99c554 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:11.167254 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a49cef5-a4d2-47e3-ab5c-03c67b99c554 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:11.223508 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9341b64-d2be-47a2-bc28-e3a08c92c68e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:11.224173 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9341b64-d2be-47a2-bc28-e3a08c92c68e admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:11.224460 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9341b64-d2be-47a2-bc28-e3a08c92c68e admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:11.224741 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9341b64-d2be-47a2-bc28-e3a08c92c68e admin admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:11.225437 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9341b64-d2be-47a2-bc28-e3a08c92c68e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:11.227675 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9341b64-d2be-47a2-bc28-e3a08c92c68e admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:11.247799 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1139/2284] 10.222.0.43 () {60 vars in 1143 bytes} [Wed Jun 22 10:21:11 2022] POST /identity/v3/users => generated 299 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:21:11.251925 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dd6816-0c0a-47e9-a096-d70425a70ee0 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:11.262279 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dd6816-0c0a-47e9-a096-d70425a70ee0 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:11.270035 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57e80f9-bb69-40d3-bad5-68d9ca1ba9f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:11.270704 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57e80f9-bb69-40d3-bad5-68d9ca1ba9f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:11.270987 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57e80f9-bb69-40d3-bad5-68d9ca1ba9f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:11.271266 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57e80f9-bb69-40d3-bad5-68d9ca1ba9f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:11.272000 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57e80f9-bb69-40d3-bad5-68d9ca1ba9f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:11.273641 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57e80f9-bb69-40d3-bad5-68d9ca1ba9f7 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:11.275904 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:11.287822 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1146/2285] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:21:11 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:21:11.292577 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9341b64-d2be-47a2-bc28-e3a08c92c68e admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:11.303397 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9341b64-d2be-47a2-bc28-e3a08c92c68e admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:11.308111 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2179874b-3834-4958-8c53-8ad0cef947ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:11.308994 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2179874b-3834-4958-8c53-8ad0cef947ab admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:11.309277 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2179874b-3834-4958-8c53-8ad0cef947ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:11.309559 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2179874b-3834-4958-8c53-8ad0cef947ab admin admin] PATH_INFO: `/v3/projects/eaeb1096686a4d61b2d03c2d106621db/users/15c4208d5eee4eb7b11c5fe91d0f9130/roles/26d9c2ab5dfc4e6d9ca80c6014123906` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:11.324611 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2179874b-3834-4958-8c53-8ad0cef947ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=eaeb1096686a4d61b2d03c2d106621db, user_id=15c4208d5eee4eb7b11c5fe91d0f9130, role_id=26d9c2ab5dfc4e6d9ca80c6014123906)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:11.327658 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2179874b-3834-4958-8c53-8ad0cef947ab admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:11.341157 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1140/2286] 10.222.0.43 () {60 vars in 1482 bytes} [Wed Jun 22 10:21:11 2022] PUT /identity/v3/projects/eaeb1096686a4d61b2d03c2d106621db/users/15c4208d5eee4eb7b11c5fe91d0f9130/roles/26d9c2ab5dfc4e6d9ca80c6014123906 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:21:11.346956 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57e80f9-bb69-40d3-bad5-68d9ca1ba9f7 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:11.357458 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57e80f9-bb69-40d3-bad5-68d9ca1ba9f7 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:11.417934 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0caab5a-fa17-46e5-95ae-6d920647a58b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:11.418614 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0caab5a-fa17-46e5-95ae-6d920647a58b admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:11.418900 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0caab5a-fa17-46e5-95ae-6d920647a58b admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:11.419206 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0caab5a-fa17-46e5-95ae-6d920647a58b admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:11.419899 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0caab5a-fa17-46e5-95ae-6d920647a58b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:11.422384 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0caab5a-fa17-46e5-95ae-6d920647a58b admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:11.433220 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1147/2287] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:21:11 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:21:11.436950 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2179874b-3834-4958-8c53-8ad0cef947ab admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:11.447226 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2179874b-3834-4958-8c53-8ad0cef947ab admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:11.451783 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587d6054-2b11-43df-b8d5-475972545b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:11.452950 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587d6054-2b11-43df-b8d5-475972545b16 admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:11.453239 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587d6054-2b11-43df-b8d5-475972545b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:11.453521 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587d6054-2b11-43df-b8d5-475972545b16 admin admin] PATH_INFO: `/v3/projects/eaeb1096686a4d61b2d03c2d106621db/users/15c4208d5eee4eb7b11c5fe91d0f9130/roles/26d9c2ab5dfc4e6d9ca80c6014123906` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:11.455816 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587d6054-2b11-43df-b8d5-475972545b16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eaeb1096686a4d61b2d03c2d106621db, user_id=15c4208d5eee4eb7b11c5fe91d0f9130, role_id=26d9c2ab5dfc4e6d9ca80c6014123906)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:11.458487 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587d6054-2b11-43df-b8d5-475972545b16 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:11.469301 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1141/2288] 10.222.0.43 () {60 vars in 1482 bytes} [Wed Jun 22 10:21:11 2022] PUT /identity/v3/projects/eaeb1096686a4d61b2d03c2d106621db/users/15c4208d5eee4eb7b11c5fe91d0f9130/roles/26d9c2ab5dfc4e6d9ca80c6014123906 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:21:11.480546 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26810cb-8222-48f2-a436-679fe0188fe9 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:11.480837 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26810cb-8222-48f2-a436-679fe0188fe9 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:11.481120 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26810cb-8222-48f2-a436-679fe0188fe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:11.507844 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-e26810cb-8222-48f2-a436-679fe0188fe9 None None] MFA Rules not processed for user `15c4208d5eee4eb7b11c5fe91d0f9130`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:21:11.509044 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-e26810cb-8222-48f2-a436-679fe0188fe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:11.575987 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1148/2289] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:21:11 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:21:11.587957 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587d6054-2b11-43df-b8d5-475972545b16 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:11.589880 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-587d6054-2b11-43df-b8d5-475972545b16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:11.649592 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587d6054-2b11-43df-b8d5-475972545b16 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:11.653207 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807070f9-cd37-46e4-b59d-507f0c328903 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bbcb3d4dc704dfdb0097abc594ca855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:11.653886 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807070f9-cd37-46e4-b59d-507f0c328903 service cinder] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:11.654170 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807070f9-cd37-46e4-b59d-507f0c328903 service cinder] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:11.654448 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807070f9-cd37-46e4-b59d-507f0c328903 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:11.662578 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:11.664992 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807070f9-cd37-46e4-b59d-507f0c328903 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:11.666722 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807070f9-cd37-46e4-b59d-507f0c328903 service cinder] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:11.677904 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1142/2290] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:21:11 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:21:11.740504 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26810cb-8222-48f2-a436-679fe0188fe9 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:11.801864 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26810cb-8222-48f2-a436-679fe0188fe9 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:11.806333 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6f1519-4398-4585-b9c7-1a7a3890e406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:11.807193 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6f1519-4398-4585-b9c7-1a7a3890e406 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:11.807477 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6f1519-4398-4585-b9c7-1a7a3890e406 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:11.807751 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6f1519-4398-4585-b9c7-1a7a3890e406 admin admin] PATH_INFO: `/v3/users/3686f831bd4a4f7487cc31d795c8d7d4` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:11.808926 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6f1519-4398-4585-b9c7-1a7a3890e406 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3686f831bd4a4f7487cc31d795c8d7d4)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:11.810869 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6f1519-4398-4585-b9c7-1a7a3890e406 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:11.832759 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:11.857610 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-ee6f1519-4398-4585-b9c7-1a7a3890e406 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3686f831bd4a4f7487cc31d795c8d7d4'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:11.870061 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-ee6f1519-4398-4585-b9c7-1a7a3890e406 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3686f831bd4a4f7487cc31d795c8d7d4'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:11.878133 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-ee6f1519-4398-4585-b9c7-1a7a3890e406 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3686f831bd4a4f7487cc31d795c8d7d4'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:11.885096 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-ee6f1519-4398-4585-b9c7-1a7a3890e406 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3686f831bd4a4f7487cc31d795c8d7d4'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:11.885760 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-ee6f1519-4398-4585-b9c7-1a7a3890e406 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3686f831bd4a4f7487cc31d795c8d7d4'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:11.892193 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1149/2291] 10.222.0.43 () {58 vars in 1223 bytes} [Wed Jun 22 10:21:11 2022] DELETE /identity/v3/users/3686f831bd4a4f7487cc31d795c8d7d4 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:21:11.896810 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c984790-9893-4e78-8b8d-bebf2bc28fd3 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:11.897104 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c984790-9893-4e78-8b8d-bebf2bc28fd3 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:11.897385 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c984790-9893-4e78-8b8d-bebf2bc28fd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:11.917404 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-1c984790-9893-4e78-8b8d-bebf2bc28fd3 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:21:11.918572 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-1c984790-9893-4e78-8b8d-bebf2bc28fd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:11.980465 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1143/2292] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:21:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:21:11.990978 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6f1519-4398-4585-b9c7-1a7a3890e406 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:11.992387 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-ee6f1519-4398-4585-b9c7-1a7a3890e406 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:12.051192 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6f1519-4398-4585-b9c7-1a7a3890e406 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:12.055056 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81e14de-fe45-494b-92f2-6d4b58c30b6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe93d4c0737249fd8623bb5ce188e34e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:12.055736 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81e14de-fe45-494b-92f2-6d4b58c30b6e service neutron] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:12.056021 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81e14de-fe45-494b-92f2-6d4b58c30b6e service neutron] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:12.056293 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81e14de-fe45-494b-92f2-6d4b58c30b6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:12.067200 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81e14de-fe45-494b-92f2-6d4b58c30b6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:12.068628 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81e14de-fe45-494b-92f2-6d4b58c30b6e service neutron] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:12.078731 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1150/2293] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:21:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:21:12.379491 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c984790-9893-4e78-8b8d-bebf2bc28fd3 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:12.380949 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-1c984790-9893-4e78-8b8d-bebf2bc28fd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:12.394483 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c984790-9893-4e78-8b8d-bebf2bc28fd3 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:12.399123 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf82288-3271-4190-8a0b-d60b9923a106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:12.400495 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf82288-3271-4190-8a0b-d60b9923a106 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:12.400782 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf82288-3271-4190-8a0b-d60b9923a106 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:12.401228 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf82288-3271-4190-8a0b-d60b9923a106 admin admin] PATH_INFO: `/v3/projects/8a2a78007ee8473f82a4ae8f0012cc4a` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:12.402432 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf82288-3271-4190-8a0b-d60b9923a106 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a2a78007ee8473f82a4ae8f0012cc4a)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:12.404329 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf82288-3271-4190-8a0b-d60b9923a106 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:12.459841 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-eaf82288-3271-4190-8a0b-d60b9923a106 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a2a78007ee8473f82a4ae8f0012cc4a', 'request_id': 'req-eaf82288-3271-4190-8a0b-d60b9923a106'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:12.465796 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-eaf82288-3271-4190-8a0b-d60b9923a106 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a2a78007ee8473f82a4ae8f0012cc4a', 'request_id': 'req-eaf82288-3271-4190-8a0b-d60b9923a106'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:12.475241 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-eaf82288-3271-4190-8a0b-d60b9923a106 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a2a78007ee8473f82a4ae8f0012cc4a', 'request_id': 'req-eaf82288-3271-4190-8a0b-d60b9923a106'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:12.487996 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-eaf82288-3271-4190-8a0b-d60b9923a106 admin admin] The token cache is being invalidate because project 8a2a78007ee8473f82a4ae8f0012cc4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:21:12.488287 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-eaf82288-3271-4190-8a0b-d60b9923a106 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:12.488957 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-eaf82288-3271-4190-8a0b-d60b9923a106 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:12.490572 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1144/2294] 10.222.0.43 () {58 vars in 1232 bytes} [Wed Jun 22 10:21:12 2022] DELETE /identity/v3/projects/8a2a78007ee8473f82a4ae8f0012cc4a => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:21:12.494483 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81e14de-fe45-494b-92f2-6d4b58c30b6e service neutron] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:12.504872 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81e14de-fe45-494b-92f2-6d4b58c30b6e service neutron] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:12.563699 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331b3cb8-093f-420b-9d66-ea3d0683c926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:12.564585 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331b3cb8-093f-420b-9d66-ea3d0683c926 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:12.564894 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331b3cb8-093f-420b-9d66-ea3d0683c926 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:12.565173 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331b3cb8-093f-420b-9d66-ea3d0683c926 admin admin] PATH_INFO: `/v3/users/15c4208d5eee4eb7b11c5fe91d0f9130` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:12.566405 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331b3cb8-093f-420b-9d66-ea3d0683c926 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15c4208d5eee4eb7b11c5fe91d0f9130)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:12.568356 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331b3cb8-093f-420b-9d66-ea3d0683c926 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:12.620691 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:12.625325 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-331b3cb8-093f-420b-9d66-ea3d0683c926 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15c4208d5eee4eb7b11c5fe91d0f9130'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:12.656119 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-331b3cb8-093f-420b-9d66-ea3d0683c926 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15c4208d5eee4eb7b11c5fe91d0f9130'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:12.668792 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-331b3cb8-093f-420b-9d66-ea3d0683c926 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15c4208d5eee4eb7b11c5fe91d0f9130'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:12.677670 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-331b3cb8-093f-420b-9d66-ea3d0683c926 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15c4208d5eee4eb7b11c5fe91d0f9130'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:12.678349 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-331b3cb8-093f-420b-9d66-ea3d0683c926 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15c4208d5eee4eb7b11c5fe91d0f9130'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:12.684212 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1151/2295] 10.222.0.43 () {58 vars in 1223 bytes} [Wed Jun 22 10:21:12 2022] DELETE /identity/v3/users/15c4208d5eee4eb7b11c5fe91d0f9130 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:21:12.962172 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf82288-3271-4190-8a0b-d60b9923a106 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:12.963690 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-eaf82288-3271-4190-8a0b-d60b9923a106 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:12.980490 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf82288-3271-4190-8a0b-d60b9923a106 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:13.038059 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f8bee5-c549-43c7-a9e8-df56dce02482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:13.038937 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f8bee5-c549-43c7-a9e8-df56dce02482 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:13.039223 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f8bee5-c549-43c7-a9e8-df56dce02482 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:13.039499 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f8bee5-c549-43c7-a9e8-df56dce02482 admin admin] PATH_INFO: `/v3/projects/eaeb1096686a4d61b2d03c2d106621db` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:13.040685 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f8bee5-c549-43c7-a9e8-df56dce02482 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eaeb1096686a4d61b2d03c2d106621db)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:13.042645 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f8bee5-c549-43c7-a9e8-df56dce02482 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:13.066164 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:13.090219 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-54f8bee5-c549-43c7-a9e8-df56dce02482 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eaeb1096686a4d61b2d03c2d106621db', 'request_id': 'req-54f8bee5-c549-43c7-a9e8-df56dce02482'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:13.095854 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-54f8bee5-c549-43c7-a9e8-df56dce02482 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eaeb1096686a4d61b2d03c2d106621db', 'request_id': 'req-54f8bee5-c549-43c7-a9e8-df56dce02482'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:13.104698 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-54f8bee5-c549-43c7-a9e8-df56dce02482 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eaeb1096686a4d61b2d03c2d106621db', 'request_id': 'req-54f8bee5-c549-43c7-a9e8-df56dce02482'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:13.119962 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-54f8bee5-c549-43c7-a9e8-df56dce02482 admin admin] The token cache is being invalidate because project eaeb1096686a4d61b2d03c2d106621db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:21:13.120251 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-54f8bee5-c549-43c7-a9e8-df56dce02482 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:13.120892 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-54f8bee5-c549-43c7-a9e8-df56dce02482 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:13.122466 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1145/2296] 10.222.0.43 () {58 vars in 1232 bytes} [Wed Jun 22 10:21:12 2022] DELETE /identity/v3/projects/eaeb1096686a4d61b2d03c2d106621db => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:21:13.128135 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a064976f-7164-44a1-873f-5acd99b6368f None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:13.128600 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a064976f-7164-44a1-873f-5acd99b6368f None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:13.128693 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a064976f-7164-44a1-873f-5acd99b6368f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:13.147094 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-a064976f-7164-44a1-873f-5acd99b6368f None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:21:13.148296 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-a064976f-7164-44a1-873f-5acd99b6368f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:13.207017 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1152/2297] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:21:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:21:13.214678 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba126b1-1d30-49da-bc82-d2c602b669da None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:13.214971 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba126b1-1d30-49da-bc82-d2c602b669da None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:13.215249 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba126b1-1d30-49da-bc82-d2c602b669da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:13.237224 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-6ba126b1-1d30-49da-bc82-d2c602b669da None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:21:13.238455 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-6ba126b1-1d30-49da-bc82-d2c602b669da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:13.247121 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1146/2298] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:21:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:21:13.252453 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a064976f-7164-44a1-873f-5acd99b6368f None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:13.262115 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a064976f-7164-44a1-873f-5acd99b6368f None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:13.266677 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc285ca-6ead-4def-9e74-1a94fd25973c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:13.267353 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc285ca-6ead-4def-9e74-1a94fd25973c admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:13.267635 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc285ca-6ead-4def-9e74-1a94fd25973c admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:13.267912 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc285ca-6ead-4def-9e74-1a94fd25973c admin admin] PATH_INFO: `/v3/domains` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:13.268634 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc285ca-6ead-4def-9e74-1a94fd25973c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:21:13.268940 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc285ca-6ead-4def-9e74-1a94fd25973c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:13.270575 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc285ca-6ead-4def-9e74-1a94fd25973c admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:13.282366 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1153/2299] 10.222.0.43 () {58 vars in 1152 bytes} [Wed Jun 22 10:21:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:21:13.286511 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba126b1-1d30-49da-bc82-d2c602b669da None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:13.296194 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba126b1-1d30-49da-bc82-d2c602b669da None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:13.300962 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedede45-54a2-4c5f-9bc3-55b0f47b25fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:13.301610 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedede45-54a2-4c5f-9bc3-55b0f47b25fb admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:13.301927 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedede45-54a2-4c5f-9bc3-55b0f47b25fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:13.302211 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedede45-54a2-4c5f-9bc3-55b0f47b25fb admin admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:13.302898 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedede45-54a2-4c5f-9bc3-55b0f47b25fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:13.304787 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedede45-54a2-4c5f-9bc3-55b0f47b25fb admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:13.330745 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1147/2300] 10.222.0.43 () {60 vars in 1152 bytes} [Wed Jun 22 10:21:13 2022] POST /identity/v3/projects => generated 387 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:21:13.334769 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc285ca-6ead-4def-9e74-1a94fd25973c admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:13.345133 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc285ca-6ead-4def-9e74-1a94fd25973c admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:13.401234 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a6ec39-2952-4fb7-8cc0-28050dfa3e44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:13.401990 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a6ec39-2952-4fb7-8cc0-28050dfa3e44 admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:13.402298 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a6ec39-2952-4fb7-8cc0-28050dfa3e44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:13.402582 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a6ec39-2952-4fb7-8cc0-28050dfa3e44 admin admin] PATH_INFO: `/v3/users` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:13.403272 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a6ec39-2952-4fb7-8cc0-28050dfa3e44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:13.405242 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a6ec39-2952-4fb7-8cc0-28050dfa3e44 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:13.429928 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1154/2301] 10.222.0.43 () {60 vars in 1143 bytes} [Wed Jun 22 10:21:13 2022] POST /identity/v3/users => generated 294 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 10:21:13.431214 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedede45-54a2-4c5f-9bc3-55b0f47b25fb admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:13.443083 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedede45-54a2-4c5f-9bc3-55b0f47b25fb admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:13.448057 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ddc38d-ddc3-42c9-a81d-11f5b8cf32bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:13.448787 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ddc38d-ddc3-42c9-a81d-11f5b8cf32bf admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:13.449076 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ddc38d-ddc3-42c9-a81d-11f5b8cf32bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:13.449357 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ddc38d-ddc3-42c9-a81d-11f5b8cf32bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:13.450129 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ddc38d-ddc3-42c9-a81d-11f5b8cf32bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:13.452327 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ddc38d-ddc3-42c9-a81d-11f5b8cf32bf admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:13.463331 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1148/2302] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:21:13 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:21:13.468099 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a6ec39-2952-4fb7-8cc0-28050dfa3e44 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:13.478587 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a6ec39-2952-4fb7-8cc0-28050dfa3e44 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:13.483926 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0efdfe-964d-4535-bb2c-03e6b9bc9067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:13.484731 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0efdfe-964d-4535-bb2c-03e6b9bc9067 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:13.485161 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0efdfe-964d-4535-bb2c-03e6b9bc9067 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:13.485602 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0efdfe-964d-4535-bb2c-03e6b9bc9067 admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:13.486391 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0efdfe-964d-4535-bb2c-03e6b9bc9067 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:13.488001 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0efdfe-964d-4535-bb2c-03e6b9bc9067 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:13.498055 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1155/2303] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:21:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:21:13.502250 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ddc38d-ddc3-42c9-a81d-11f5b8cf32bf admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:13.512266 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ddc38d-ddc3-42c9-a81d-11f5b8cf32bf admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:13.517388 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccdb3aa-fec0-45cb-bf26-3746e54f7ac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:13.518362 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccdb3aa-fec0-45cb-bf26-3746e54f7ac7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:13.518643 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccdb3aa-fec0-45cb-bf26-3746e54f7ac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:13.518920 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccdb3aa-fec0-45cb-bf26-3746e54f7ac7 admin admin] PATH_INFO: `/v3/projects/9d0e4600a6d74b4baf3806444499f907/users/7c2c8a86a7c04358928297053be4495e/roles/9f88c83743f745a9a785a2f454753f06` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:13.534202 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccdb3aa-fec0-45cb-bf26-3746e54f7ac7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d0e4600a6d74b4baf3806444499f907, user_id=7c2c8a86a7c04358928297053be4495e, role_id=9f88c83743f745a9a785a2f454753f06)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:13.536848 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccdb3aa-fec0-45cb-bf26-3746e54f7ac7 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:13.550254 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1149/2304] 10.222.0.43 () {60 vars in 1482 bytes} [Wed Jun 22 10:21:13 2022] PUT /identity/v3/projects/9d0e4600a6d74b4baf3806444499f907/users/7c2c8a86a7c04358928297053be4495e/roles/9f88c83743f745a9a785a2f454753f06 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:21:13.560378 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf3ce20-b342-4b84-a8e2-70f9de514ee3 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:13.560675 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf3ce20-b342-4b84-a8e2-70f9de514ee3 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:13.561033 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf3ce20-b342-4b84-a8e2-70f9de514ee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:13.586946 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-fcf3ce20-b342-4b84-a8e2-70f9de514ee3 None None] MFA Rules not processed for user `7c2c8a86a7c04358928297053be4495e`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:21:13.588142 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-fcf3ce20-b342-4b84-a8e2-70f9de514ee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:13.600966 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:13.657308 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1156/2305] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:21:13 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:21:13.661859 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccdb3aa-fec0-45cb-bf26-3746e54f7ac7 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:13.725081 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccdb3aa-fec0-45cb-bf26-3746e54f7ac7 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:13.729929 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429bc693-fde5-476a-a585-3fd12f47fa66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:13.730591 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429bc693-fde5-476a-a585-3fd12f47fa66 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:13.730877 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429bc693-fde5-476a-a585-3fd12f47fa66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:13.731158 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429bc693-fde5-476a-a585-3fd12f47fa66 admin admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:13.731855 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429bc693-fde5-476a-a585-3fd12f47fa66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:13.734255 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429bc693-fde5-476a-a585-3fd12f47fa66 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:13.762155 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1150/2306] 10.222.0.43 () {60 vars in 1152 bytes} [Wed Jun 22 10:21:13 2022] POST /identity/v3/projects => generated 387 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 10:21:13.766461 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf3ce20-b342-4b84-a8e2-70f9de514ee3 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:13.779261 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf3ce20-b342-4b84-a8e2-70f9de514ee3 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:13.835286 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3398af-a6b6-478b-b4d6-d07c92c72ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:13.835957 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3398af-a6b6-478b-b4d6-d07c92c72ea8 admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:13.836242 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3398af-a6b6-478b-b4d6-d07c92c72ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:13.836542 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3398af-a6b6-478b-b4d6-d07c92c72ea8 admin admin] PATH_INFO: `/v3/users` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:13.837221 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3398af-a6b6-478b-b4d6-d07c92c72ea8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:13.839178 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3398af-a6b6-478b-b4d6-d07c92c72ea8 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:13.859971 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1157/2307] 10.222.0.43 () {60 vars in 1143 bytes} [Wed Jun 22 10:21:13 2022] POST /identity/v3/users => generated 294 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 10:21:13.863919 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429bc693-fde5-476a-a585-3fd12f47fa66 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:13.875436 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429bc693-fde5-476a-a585-3fd12f47fa66 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:13.880657 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a78fd9c-19ce-4c44-86d7-2842ef67a93f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:13.881307 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a78fd9c-19ce-4c44-86d7-2842ef67a93f admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:13.881593 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a78fd9c-19ce-4c44-86d7-2842ef67a93f admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:13.881921 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a78fd9c-19ce-4c44-86d7-2842ef67a93f admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:13.882693 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a78fd9c-19ce-4c44-86d7-2842ef67a93f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:13.884277 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a78fd9c-19ce-4c44-86d7-2842ef67a93f admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:13.895997 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1151/2308] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:21:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:21:13.900084 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3398af-a6b6-478b-b4d6-d07c92c72ea8 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:13.910492 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3398af-a6b6-478b-b4d6-d07c92c72ea8 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:13.915186 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdc6da2-5bfe-47d4-89ac-222bd5984f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:13.915846 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdc6da2-5bfe-47d4-89ac-222bd5984f63 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:13.916133 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdc6da2-5bfe-47d4-89ac-222bd5984f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:13.916415 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdc6da2-5bfe-47d4-89ac-222bd5984f63 admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:13.917146 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdc6da2-5bfe-47d4-89ac-222bd5984f63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:13.918990 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdc6da2-5bfe-47d4-89ac-222bd5984f63 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:13.929652 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1158/2309] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:21:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:21:13.933680 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a78fd9c-19ce-4c44-86d7-2842ef67a93f admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:13.944812 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a78fd9c-19ce-4c44-86d7-2842ef67a93f admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:13.950493 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4836fdaa-c565-4f74-88be-3cc5740b5f04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:13.951371 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4836fdaa-c565-4f74-88be-3cc5740b5f04 admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:13.952196 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4836fdaa-c565-4f74-88be-3cc5740b5f04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:13.952508 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4836fdaa-c565-4f74-88be-3cc5740b5f04 admin admin] PATH_INFO: `/v3/projects/c8114967fafc476caf5574500a7bc01d/users/45b9abf51a7c401da2c234b85090dc12/roles/9f88c83743f745a9a785a2f454753f06` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:13.967943 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4836fdaa-c565-4f74-88be-3cc5740b5f04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8114967fafc476caf5574500a7bc01d, user_id=45b9abf51a7c401da2c234b85090dc12, role_id=9f88c83743f745a9a785a2f454753f06)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:13.971016 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4836fdaa-c565-4f74-88be-3cc5740b5f04 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:13.973774 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:DELETE=7,keystone:SELECT=88,keystone:INSERT=5 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:13.987411 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1152/2310] 10.222.0.43 () {60 vars in 1482 bytes} [Wed Jun 22 10:21:13 2022] PUT /identity/v3/projects/c8114967fafc476caf5574500a7bc01d/users/45b9abf51a7c401da2c234b85090dc12/roles/9f88c83743f745a9a785a2f454753f06 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:21:14.000008 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe53ec31-68f6-49db-92b0-a3a80e71aa8f None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:14.002779 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe53ec31-68f6-49db-92b0-a3a80e71aa8f None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:14.003098 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe53ec31-68f6-49db-92b0-a3a80e71aa8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:14.031893 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-fe53ec31-68f6-49db-92b0-a3a80e71aa8f None None] MFA Rules not processed for user `45b9abf51a7c401da2c234b85090dc12`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:21:14.033083 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-fe53ec31-68f6-49db-92b0-a3a80e71aa8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:14.096378 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1159/2311] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:21:13 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:21:14.100815 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4836fdaa-c565-4f74-88be-3cc5740b5f04 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:14.164668 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4836fdaa-c565-4f74-88be-3cc5740b5f04 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:14.169507 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdb4b18-6163-425d-a478-f094e79d5c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:14.170803 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdb4b18-6163-425d-a478-f094e79d5c0a admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:14.171257 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdb4b18-6163-425d-a478-f094e79d5c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:14.171573 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdb4b18-6163-425d-a478-f094e79d5c0a admin admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:14.172313 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdb4b18-6163-425d-a478-f094e79d5c0a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:14.174276 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdb4b18-6163-425d-a478-f094e79d5c0a admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:14.199918 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1153/2312] 10.222.0.43 () {60 vars in 1152 bytes} [Wed Jun 22 10:21:14 2022] POST /identity/v3/projects => generated 387 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:21:14.204152 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe53ec31-68f6-49db-92b0-a3a80e71aa8f None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:14.214793 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe53ec31-68f6-49db-92b0-a3a80e71aa8f None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:14.236737 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:14.275028 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd65310-2c35-41d1-b78b-3ebbee198fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:14.275629 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd65310-2c35-41d1-b78b-3ebbee198fe1 admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:14.275916 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd65310-2c35-41d1-b78b-3ebbee198fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:14.276192 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd65310-2c35-41d1-b78b-3ebbee198fe1 admin admin] PATH_INFO: `/v3/users` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:14.276893 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd65310-2c35-41d1-b78b-3ebbee198fe1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:14.278852 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd65310-2c35-41d1-b78b-3ebbee198fe1 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:14.300134 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1160/2313] 10.222.0.43 () {60 vars in 1143 bytes} [Wed Jun 22 10:21:14 2022] POST /identity/v3/users => generated 300 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:21:14.304233 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdb4b18-6163-425d-a478-f094e79d5c0a admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:14.314908 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdb4b18-6163-425d-a478-f094e79d5c0a admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:14.319428 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2b7405-a45b-43f3-9c84-a048d7675872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:14.320079 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2b7405-a45b-43f3-9c84-a048d7675872 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:14.320360 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2b7405-a45b-43f3-9c84-a048d7675872 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:14.320669 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2b7405-a45b-43f3-9c84-a048d7675872 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:14.321392 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2b7405-a45b-43f3-9c84-a048d7675872 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:14.323027 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2b7405-a45b-43f3-9c84-a048d7675872 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:14.333565 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1154/2314] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:21:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:21:14.337466 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd65310-2c35-41d1-b78b-3ebbee198fe1 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:14.347812 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd65310-2c35-41d1-b78b-3ebbee198fe1 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:14.352619 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ab2365-e537-4ead-adaf-e002fe508e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:14.353489 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ab2365-e537-4ead-adaf-e002fe508e59 admin admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:14.353884 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ab2365-e537-4ead-adaf-e002fe508e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:14.354094 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ab2365-e537-4ead-adaf-e002fe508e59 admin admin] PATH_INFO: `/v3/projects/f475609706834f35b4d3ed86f1967d0e/users/ab086ff7f3434c93a410ccb2b881986f/roles/26d9c2ab5dfc4e6d9ca80c6014123906` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:14.369159 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ab2365-e537-4ead-adaf-e002fe508e59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f475609706834f35b4d3ed86f1967d0e, user_id=ab086ff7f3434c93a410ccb2b881986f, role_id=26d9c2ab5dfc4e6d9ca80c6014123906)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:14.371862 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ab2365-e537-4ead-adaf-e002fe508e59 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:14.384594 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1161/2315] 10.222.0.43 () {60 vars in 1482 bytes} [Wed Jun 22 10:21:14 2022] PUT /identity/v3/projects/f475609706834f35b4d3ed86f1967d0e/users/ab086ff7f3434c93a410ccb2b881986f/roles/26d9c2ab5dfc4e6d9ca80c6014123906 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:21:14.388559 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2b7405-a45b-43f3-9c84-a048d7675872 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:14.398429 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2b7405-a45b-43f3-9c84-a048d7675872 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:14.455411 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a060b0c-6690-4fd3-bc33-1991ed736ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:14.456112 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a060b0c-6690-4fd3-bc33-1991ed736ce9 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:14.456431 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a060b0c-6690-4fd3-bc33-1991ed736ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:14.456755 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a060b0c-6690-4fd3-bc33-1991ed736ce9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:14.457498 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a060b0c-6690-4fd3-bc33-1991ed736ce9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:14.459135 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a060b0c-6690-4fd3-bc33-1991ed736ce9 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:14.471181 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1155/2316] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:21:14 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:21:14.475423 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ab2365-e537-4ead-adaf-e002fe508e59 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:14.486603 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ab2365-e537-4ead-adaf-e002fe508e59 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:14.491118 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345e54a2-e063-4efa-aebd-dc4a0653a267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:14.491992 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345e54a2-e063-4efa-aebd-dc4a0653a267 admin admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:14.492275 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345e54a2-e063-4efa-aebd-dc4a0653a267 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:14.492552 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345e54a2-e063-4efa-aebd-dc4a0653a267 admin admin] PATH_INFO: `/v3/projects/f475609706834f35b4d3ed86f1967d0e/users/ab086ff7f3434c93a410ccb2b881986f/roles/26d9c2ab5dfc4e6d9ca80c6014123906` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:14.494501 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345e54a2-e063-4efa-aebd-dc4a0653a267 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f475609706834f35b4d3ed86f1967d0e, user_id=ab086ff7f3434c93a410ccb2b881986f, role_id=26d9c2ab5dfc4e6d9ca80c6014123906)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:14.497144 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345e54a2-e063-4efa-aebd-dc4a0653a267 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:14.507506 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1162/2317] 10.222.0.43 () {60 vars in 1482 bytes} [Wed Jun 22 10:21:14 2022] PUT /identity/v3/projects/f475609706834f35b4d3ed86f1967d0e/users/ab086ff7f3434c93a410ccb2b881986f/roles/26d9c2ab5dfc4e6d9ca80c6014123906 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:21:14.517640 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765a75f7-98d7-4c9c-bf4e-9e8f7292b0c9 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:14.517987 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765a75f7-98d7-4c9c-bf4e-9e8f7292b0c9 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:14.518273 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765a75f7-98d7-4c9c-bf4e-9e8f7292b0c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:14.544838 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-765a75f7-98d7-4c9c-bf4e-9e8f7292b0c9 None None] MFA Rules not processed for user `ab086ff7f3434c93a410ccb2b881986f`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:21:14.546994 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-765a75f7-98d7-4c9c-bf4e-9e8f7292b0c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:14.600131 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:14.619233 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1156/2318] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:21:14 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:21:14.630187 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345e54a2-e063-4efa-aebd-dc4a0653a267 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:14.631906 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-345e54a2-e063-4efa-aebd-dc4a0653a267 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:14.689873 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345e54a2-e063-4efa-aebd-dc4a0653a267 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:14.693617 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd17b5f0-f5c2-4ab5-8401-c59936b4f3f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bbcb3d4dc704dfdb0097abc594ca855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:14.694321 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd17b5f0-f5c2-4ab5-8401-c59936b4f3f5 service cinder] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:14.694608 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd17b5f0-f5c2-4ab5-8401-c59936b4f3f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:14.694893 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd17b5f0-f5c2-4ab5-8401-c59936b4f3f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:14.704972 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd17b5f0-f5c2-4ab5-8401-c59936b4f3f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:14.706450 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd17b5f0-f5c2-4ab5-8401-c59936b4f3f5 service cinder] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:14.715901 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1163/2319] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:21:14 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:21:15.211950 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765a75f7-98d7-4c9c-bf4e-9e8f7292b0c9 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:15.213430 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-765a75f7-98d7-4c9c-bf4e-9e8f7292b0c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:15.225241 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765a75f7-98d7-4c9c-bf4e-9e8f7292b0c9 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:15.229060 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a276f4-fc56-48ea-84ed-90e7816a1a16 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bbcb3d4dc704dfdb0097abc594ca855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:15.229731 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a276f4-fc56-48ea-84ed-90e7816a1a16 service cinder] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:15.230022 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a276f4-fc56-48ea-84ed-90e7816a1a16 service cinder] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:15.230303 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a276f4-fc56-48ea-84ed-90e7816a1a16 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:15.288452 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a276f4-fc56-48ea-84ed-90e7816a1a16 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:15.290896 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a276f4-fc56-48ea-84ed-90e7816a1a16 service cinder] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:15.300404 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1157/2320] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:21:15 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:21:18.663949 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044b08a0-3f9e-4bfe-b26c-183815aff601 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:18.664465 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044b08a0-3f9e-4bfe-b26c-183815aff601 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:18.664568 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044b08a0-3f9e-4bfe-b26c-183815aff601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:18.683692 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-044b08a0-3f9e-4bfe-b26c-183815aff601 None None] MFA Rules not processed for user `317e7e7dd5c741d49d34a1fd949a7c07`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:21:18.684922 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-044b08a0-3f9e-4bfe-b26c-183815aff601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:18.742543 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1164/2321] 10.222.0.43 () {58 vars in 1009 bytes} [Wed Jun 22 10:21:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:21:18.790579 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a276f4-fc56-48ea-84ed-90e7816a1a16 service cinder] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:18.791981 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-d8a276f4-fc56-48ea-84ed-90e7816a1a16 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:18.878754 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a276f4-fc56-48ea-84ed-90e7816a1a16 service cinder] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:18.883659 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8788f7-138a-411a-b8f2-3241c24b4d04 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9566f8cca2574f4cb5edcbf384f368a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:18.884305 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8788f7-138a-411a-b8f2-3241c24b4d04 service swift] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:18.884593 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8788f7-138a-411a-b8f2-3241c24b4d04 service swift] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:18.884873 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8788f7-138a-411a-b8f2-3241c24b4d04 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:18.893259 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8788f7-138a-411a-b8f2-3241c24b4d04 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:18.894940 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8788f7-138a-411a-b8f2-3241c24b4d04 service swift] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:18.904097 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1158/2322] 10.222.0.43 () {60 vars in 1384 bytes} [Wed Jun 22 10:21:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 22 10:21:19.315788 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044b08a0-3f9e-4bfe-b26c-183815aff601 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:19.325659 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044b08a0-3f9e-4bfe-b26c-183815aff601 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:19.333564 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0af44d5-1d94-477b-afc5-a66db074ec1f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bbcb3d4dc704dfdb0097abc594ca855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:19.334273 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0af44d5-1d94-477b-afc5-a66db074ec1f service cinder] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:19.334556 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0af44d5-1d94-477b-afc5-a66db074ec1f service cinder] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:19.334834 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0af44d5-1d94-477b-afc5-a66db074ec1f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:19.362743 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:19.410511 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0af44d5-1d94-477b-afc5-a66db074ec1f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:19.412036 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0af44d5-1d94-477b-afc5-a66db074ec1f service cinder] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:19.423868 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1165/2323] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:21:19 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:21:21.913659 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8788f7-138a-411a-b8f2-3241c24b4d04 service swift] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:22.001072 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8788f7-138a-411a-b8f2-3241c24b4d04 service swift] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:22.006012 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a088fe91-3da4-4385-aa5b-0330e495b5f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:22.006915 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a088fe91-3da4-4385-aa5b-0330e495b5f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:22.007454 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a088fe91-3da4-4385-aa5b-0330e495b5f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:22.007454 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a088fe91-3da4-4385-aa5b-0330e495b5f0 admin admin] PATH_INFO: `/v3/users/7c2c8a86a7c04358928297053be4495e` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:22.008695 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a088fe91-3da4-4385-aa5b-0330e495b5f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c2c8a86a7c04358928297053be4495e)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:22.011717 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a088fe91-3da4-4385-aa5b-0330e495b5f0 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:22.031839 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:22.110367 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-a088fe91-3da4-4385-aa5b-0330e495b5f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c2c8a86a7c04358928297053be4495e'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:22.125764 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-a088fe91-3da4-4385-aa5b-0330e495b5f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c2c8a86a7c04358928297053be4495e'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:22.138918 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-a088fe91-3da4-4385-aa5b-0330e495b5f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c2c8a86a7c04358928297053be4495e'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:22.139668 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-a088fe91-3da4-4385-aa5b-0330e495b5f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c2c8a86a7c04358928297053be4495e'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:22.153225 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-a088fe91-3da4-4385-aa5b-0330e495b5f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c2c8a86a7c04358928297053be4495e'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:22.160873 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1159/2324] 10.222.0.43 () {58 vars in 1223 bytes} [Wed Jun 22 10:21:21 2022] DELETE /identity/v3/users/7c2c8a86a7c04358928297053be4495e => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:21:22.165367 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0e7807-3c23-4f80-b25d-588a73c6542d None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:22.165957 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0e7807-3c23-4f80-b25d-588a73c6542d None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:22.165957 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0e7807-3c23-4f80-b25d-588a73c6542d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:22.187473 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-ab0e7807-3c23-4f80-b25d-588a73c6542d None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:21:22.188805 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-ab0e7807-3c23-4f80-b25d-588a73c6542d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:22.277491 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1166/2325] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:21:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:21:22.287511 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a088fe91-3da4-4385-aa5b-0330e495b5f0 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:22.290784 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-a088fe91-3da4-4385-aa5b-0330e495b5f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:22.355807 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a088fe91-3da4-4385-aa5b-0330e495b5f0 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:22.360632 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e6f42b-52ec-4566-9f52-41a522f2b1f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe93d4c0737249fd8623bb5ce188e34e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:22.361368 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e6f42b-52ec-4566-9f52-41a522f2b1f5 service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:22.361757 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e6f42b-52ec-4566-9f52-41a522f2b1f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:22.362048 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e6f42b-52ec-4566-9f52-41a522f2b1f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:22.371793 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e6f42b-52ec-4566-9f52-41a522f2b1f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:22.373351 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e6f42b-52ec-4566-9f52-41a522f2b1f5 service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:22.384171 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1160/2326] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:21:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:21:22.708894 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0e7807-3c23-4f80-b25d-588a73c6542d None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:22.710548 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-ab0e7807-3c23-4f80-b25d-588a73c6542d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:22.727811 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0e7807-3c23-4f80-b25d-588a73c6542d None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:22.733367 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606c132e-c02f-4759-b9d6-c0423b725466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:22.735970 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606c132e-c02f-4759-b9d6-c0423b725466 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:22.736281 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606c132e-c02f-4759-b9d6-c0423b725466 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:22.736551 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606c132e-c02f-4759-b9d6-c0423b725466 admin admin] PATH_INFO: `/v3/projects/9d0e4600a6d74b4baf3806444499f907` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:22.737843 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606c132e-c02f-4759-b9d6-c0423b725466 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d0e4600a6d74b4baf3806444499f907)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:22.739789 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606c132e-c02f-4759-b9d6-c0423b725466 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:22.813192 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-606c132e-c02f-4759-b9d6-c0423b725466 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d0e4600a6d74b4baf3806444499f907', 'request_id': 'req-606c132e-c02f-4759-b9d6-c0423b725466'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:22.819885 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-606c132e-c02f-4759-b9d6-c0423b725466 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d0e4600a6d74b4baf3806444499f907', 'request_id': 'req-606c132e-c02f-4759-b9d6-c0423b725466'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:22.827083 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-606c132e-c02f-4759-b9d6-c0423b725466 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d0e4600a6d74b4baf3806444499f907', 'request_id': 'req-606c132e-c02f-4759-b9d6-c0423b725466'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:22.841216 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-606c132e-c02f-4759-b9d6-c0423b725466 admin admin] The token cache is being invalidate because project 9d0e4600a6d74b4baf3806444499f907 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:21:22.841511 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-606c132e-c02f-4759-b9d6-c0423b725466 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:22.842971 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-606c132e-c02f-4759-b9d6-c0423b725466 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:22.847839 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1167/2327] 10.222.0.43 () {58 vars in 1232 bytes} [Wed Jun 22 10:21:22 2022] DELETE /identity/v3/projects/9d0e4600a6d74b4baf3806444499f907 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:21:22.850549 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e6f42b-52ec-4566-9f52-41a522f2b1f5 service neutron] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:22.861993 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e6f42b-52ec-4566-9f52-41a522f2b1f5 service neutron] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:22.936980 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1608feb2-b34c-4d9c-b891-6a001e3c7289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:22.937984 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1608feb2-b34c-4d9c-b891-6a001e3c7289 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:22.938351 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1608feb2-b34c-4d9c-b891-6a001e3c7289 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:22.938701 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1608feb2-b34c-4d9c-b891-6a001e3c7289 admin admin] PATH_INFO: `/v3/users/45b9abf51a7c401da2c234b85090dc12` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:22.941887 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1608feb2-b34c-4d9c-b891-6a001e3c7289 admin admin] RBAC: Authorizing `identity:delete_user(user_id=45b9abf51a7c401da2c234b85090dc12)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:22.943228 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1608feb2-b34c-4d9c-b891-6a001e3c7289 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:22.991684 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:23.012963 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-1608feb2-b34c-4d9c-b891-6a001e3c7289 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45b9abf51a7c401da2c234b85090dc12'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:23.029435 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-1608feb2-b34c-4d9c-b891-6a001e3c7289 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45b9abf51a7c401da2c234b85090dc12'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:23.039752 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-1608feb2-b34c-4d9c-b891-6a001e3c7289 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45b9abf51a7c401da2c234b85090dc12'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:23.040417 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-1608feb2-b34c-4d9c-b891-6a001e3c7289 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45b9abf51a7c401da2c234b85090dc12'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:23.051513 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-1608feb2-b34c-4d9c-b891-6a001e3c7289 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45b9abf51a7c401da2c234b85090dc12'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:23.059147 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1161/2328] 10.222.0.43 () {58 vars in 1223 bytes} [Wed Jun 22 10:21:22 2022] DELETE /identity/v3/users/45b9abf51a7c401da2c234b85090dc12 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:21:23.482626 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606c132e-c02f-4759-b9d6-c0423b725466 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:23.485409 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-606c132e-c02f-4759-b9d6-c0423b725466 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:23.502919 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606c132e-c02f-4759-b9d6-c0423b725466 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:23.566811 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:23.584299 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41215677-506c-4186-8f4f-1798232a85c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:23.586628 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41215677-506c-4186-8f4f-1798232a85c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:23.587101 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41215677-506c-4186-8f4f-1798232a85c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:23.587653 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41215677-506c-4186-8f4f-1798232a85c7 admin admin] PATH_INFO: `/v3/projects/c8114967fafc476caf5574500a7bc01d` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:23.589053 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41215677-506c-4186-8f4f-1798232a85c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8114967fafc476caf5574500a7bc01d)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:23.591176 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41215677-506c-4186-8f4f-1798232a85c7 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:23.651803 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-41215677-506c-4186-8f4f-1798232a85c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8114967fafc476caf5574500a7bc01d', 'request_id': 'req-41215677-506c-4186-8f4f-1798232a85c7'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:23.662655 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-41215677-506c-4186-8f4f-1798232a85c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8114967fafc476caf5574500a7bc01d', 'request_id': 'req-41215677-506c-4186-8f4f-1798232a85c7'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:23.669946 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-41215677-506c-4186-8f4f-1798232a85c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8114967fafc476caf5574500a7bc01d', 'request_id': 'req-41215677-506c-4186-8f4f-1798232a85c7'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:23.686423 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-41215677-506c-4186-8f4f-1798232a85c7 admin admin] The token cache is being invalidate because project c8114967fafc476caf5574500a7bc01d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:21:23.686729 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-41215677-506c-4186-8f4f-1798232a85c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:23.687345 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-41215677-506c-4186-8f4f-1798232a85c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:23.689151 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1168/2329] 10.222.0.43 () {58 vars in 1232 bytes} [Wed Jun 22 10:21:23 2022] DELETE /identity/v3/projects/c8114967fafc476caf5574500a7bc01d => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:21:23.693278 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1608feb2-b34c-4d9c-b891-6a001e3c7289 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:23.694955 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-1608feb2-b34c-4d9c-b891-6a001e3c7289 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:23.711040 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1608feb2-b34c-4d9c-b891-6a001e3c7289 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:23.777530 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d581dfa6-58cf-4a84-99f7-db4ed8bf5972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:23.778445 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d581dfa6-58cf-4a84-99f7-db4ed8bf5972 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:23.778764 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d581dfa6-58cf-4a84-99f7-db4ed8bf5972 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:23.779046 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d581dfa6-58cf-4a84-99f7-db4ed8bf5972 admin admin] PATH_INFO: `/v3/users/ab086ff7f3434c93a410ccb2b881986f` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:23.781525 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d581dfa6-58cf-4a84-99f7-db4ed8bf5972 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab086ff7f3434c93a410ccb2b881986f)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:23.783752 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d581dfa6-58cf-4a84-99f7-db4ed8bf5972 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:23.842688 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-d581dfa6-58cf-4a84-99f7-db4ed8bf5972 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab086ff7f3434c93a410ccb2b881986f'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:23.856556 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-d581dfa6-58cf-4a84-99f7-db4ed8bf5972 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab086ff7f3434c93a410ccb2b881986f'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:23.869441 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-d581dfa6-58cf-4a84-99f7-db4ed8bf5972 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab086ff7f3434c93a410ccb2b881986f'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:23.870332 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-d581dfa6-58cf-4a84-99f7-db4ed8bf5972 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab086ff7f3434c93a410ccb2b881986f'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:23.882255 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-d581dfa6-58cf-4a84-99f7-db4ed8bf5972 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab086ff7f3434c93a410ccb2b881986f'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:23.891096 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1162/2330] 10.222.0.43 () {58 vars in 1223 bytes} [Wed Jun 22 10:21:23 2022] DELETE /identity/v3/users/ab086ff7f3434c93a410ccb2b881986f => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:21:24.241420 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41215677-506c-4186-8f4f-1798232a85c7 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:24.242915 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-41215677-506c-4186-8f4f-1798232a85c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:24.278516 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41215677-506c-4186-8f4f-1798232a85c7 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:24.355945 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30539431-4966-4675-8901-278a558386ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:24.356747 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30539431-4966-4675-8901-278a558386ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:24.357028 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30539431-4966-4675-8901-278a558386ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:24.357310 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30539431-4966-4675-8901-278a558386ac admin admin] PATH_INFO: `/v3/projects/f475609706834f35b4d3ed86f1967d0e` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:24.359073 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30539431-4966-4675-8901-278a558386ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=f475609706834f35b4d3ed86f1967d0e)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:24.360974 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30539431-4966-4675-8901-278a558386ac admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:24.426256 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-30539431-4966-4675-8901-278a558386ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f475609706834f35b4d3ed86f1967d0e', 'request_id': 'req-30539431-4966-4675-8901-278a558386ac'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:24.432879 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-30539431-4966-4675-8901-278a558386ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f475609706834f35b4d3ed86f1967d0e', 'request_id': 'req-30539431-4966-4675-8901-278a558386ac'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:24.439965 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-30539431-4966-4675-8901-278a558386ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f475609706834f35b4d3ed86f1967d0e', 'request_id': 'req-30539431-4966-4675-8901-278a558386ac'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:24.458020 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-30539431-4966-4675-8901-278a558386ac admin admin] The token cache is being invalidate because project f475609706834f35b4d3ed86f1967d0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:21:24.458311 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-30539431-4966-4675-8901-278a558386ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:24.458953 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-30539431-4966-4675-8901-278a558386ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:24.460867 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1169/2331] 10.222.0.43 () {58 vars in 1232 bytes} [Wed Jun 22 10:21:24 2022] DELETE /identity/v3/projects/f475609706834f35b4d3ed86f1967d0e => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:21:24.466817 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2de51ab-9b60-4d70-9afd-f4699f0d096a None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:24.468488 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2de51ab-9b60-4d70-9afd-f4699f0d096a None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:24.468488 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2de51ab-9b60-4d70-9afd-f4699f0d096a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:24.501349 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-d2de51ab-9b60-4d70-9afd-f4699f0d096a None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:21:24.502987 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-d2de51ab-9b60-4d70-9afd-f4699f0d096a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:24.542061 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:24.625089 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1163/2332] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:21:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:21:24.634656 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b06fdd-6ffd-45e5-bca1-83d8161250cc None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:24.635210 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b06fdd-6ffd-45e5-bca1-83d8161250cc None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:24.635210 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b06fdd-6ffd-45e5-bca1-83d8161250cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:24.651639 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:24.663795 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-c4b06fdd-6ffd-45e5-bca1-83d8161250cc None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:21:24.665869 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-c4b06fdd-6ffd-45e5-bca1-83d8161250cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:24.685187 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1170/2333] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:21:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:21:24.688570 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2de51ab-9b60-4d70-9afd-f4699f0d096a None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:24.712014 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2de51ab-9b60-4d70-9afd-f4699f0d096a None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:24.721329 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc4352e-29bf-4110-9c79-c809126c32ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:24.722053 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc4352e-29bf-4110-9c79-c809126c32ba admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:24.722341 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc4352e-29bf-4110-9c79-c809126c32ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:24.722618 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc4352e-29bf-4110-9c79-c809126c32ba admin admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:24.723427 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc4352e-29bf-4110-9c79-c809126c32ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:21:24.723740 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc4352e-29bf-4110-9c79-c809126c32ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:24.725344 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc4352e-29bf-4110-9c79-c809126c32ba admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:24.741324 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1164/2334] 10.222.0.43 () {58 vars in 1152 bytes} [Wed Jun 22 10:21:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:21:24.745901 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b06fdd-6ffd-45e5-bca1-83d8161250cc None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:24.755573 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b06fdd-6ffd-45e5-bca1-83d8161250cc None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:24.762377 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a40a994-5d2c-442c-84ee-e1d55cfabaa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:24.763058 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a40a994-5d2c-442c-84ee-e1d55cfabaa0 admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:24.763340 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a40a994-5d2c-442c-84ee-e1d55cfabaa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:24.763617 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a40a994-5d2c-442c-84ee-e1d55cfabaa0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:24.764888 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a40a994-5d2c-442c-84ee-e1d55cfabaa0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:24.766848 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a40a994-5d2c-442c-84ee-e1d55cfabaa0 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:24.801562 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1171/2335] 10.222.0.43 () {60 vars in 1152 bytes} [Wed Jun 22 10:21:24 2022] POST /identity/v3/projects => generated 391 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:21:24.802754 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc4352e-29bf-4110-9c79-c809126c32ba admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:24.813586 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc4352e-29bf-4110-9c79-c809126c32ba admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:24.875834 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037fa386-2eeb-4161-bfdf-78a5ef6bdc65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:24.876460 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037fa386-2eeb-4161-bfdf-78a5ef6bdc65 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:24.876747 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037fa386-2eeb-4161-bfdf-78a5ef6bdc65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:24.877027 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037fa386-2eeb-4161-bfdf-78a5ef6bdc65 admin admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:24.877751 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037fa386-2eeb-4161-bfdf-78a5ef6bdc65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:24.879843 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037fa386-2eeb-4161-bfdf-78a5ef6bdc65 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:24.914684 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1165/2336] 10.222.0.43 () {60 vars in 1143 bytes} [Wed Jun 22 10:21:24 2022] POST /identity/v3/users => generated 296 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:21:24.915899 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a40a994-5d2c-442c-84ee-e1d55cfabaa0 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:24.929895 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a40a994-5d2c-442c-84ee-e1d55cfabaa0 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:24.935119 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d974d7-8b27-45ae-9465-03204d7aebf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:24.936744 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d974d7-8b27-45ae-9465-03204d7aebf3 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:24.937192 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d974d7-8b27-45ae-9465-03204d7aebf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:24.937538 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d974d7-8b27-45ae-9465-03204d7aebf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:24.938394 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d974d7-8b27-45ae-9465-03204d7aebf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:24.940080 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d974d7-8b27-45ae-9465-03204d7aebf3 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:24.955274 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1172/2337] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:21:24 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:21:24.959138 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037fa386-2eeb-4161-bfdf-78a5ef6bdc65 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:24.972188 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037fa386-2eeb-4161-bfdf-78a5ef6bdc65 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:24.978572 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b34014c-06e0-419e-a335-fc8615834de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:24.979450 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b34014c-06e0-419e-a335-fc8615834de1 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:24.979896 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b34014c-06e0-419e-a335-fc8615834de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:24.980336 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b34014c-06e0-419e-a335-fc8615834de1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:24.981269 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b34014c-06e0-419e-a335-fc8615834de1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:24.983004 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b34014c-06e0-419e-a335-fc8615834de1 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:25.001720 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1166/2338] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:21:24 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:21:25.002943 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d974d7-8b27-45ae-9465-03204d7aebf3 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:25.015781 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d974d7-8b27-45ae-9465-03204d7aebf3 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:25.020514 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c75bdb8-dfa2-4bf8-96af-b64c32a68281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:25.021381 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c75bdb8-dfa2-4bf8-96af-b64c32a68281 admin admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:25.021659 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c75bdb8-dfa2-4bf8-96af-b64c32a68281 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:25.021964 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c75bdb8-dfa2-4bf8-96af-b64c32a68281 admin admin] PATH_INFO: `/v3/projects/ce4f1cfe562648c485da37580eca48f9/users/ae0eb1e8b9364299a9248b88512d5ce7/roles/9f88c83743f745a9a785a2f454753f06` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:25.039802 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c75bdb8-dfa2-4bf8-96af-b64c32a68281 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce4f1cfe562648c485da37580eca48f9, user_id=ae0eb1e8b9364299a9248b88512d5ce7, role_id=9f88c83743f745a9a785a2f454753f06)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:25.042837 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c75bdb8-dfa2-4bf8-96af-b64c32a68281 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:25.059829 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1173/2339] 10.222.0.43 () {60 vars in 1482 bytes} [Wed Jun 22 10:21:25 2022] PUT /identity/v3/projects/ce4f1cfe562648c485da37580eca48f9/users/ae0eb1e8b9364299a9248b88512d5ce7/roles/9f88c83743f745a9a785a2f454753f06 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:21:25.072256 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699e6bc3-e3ba-4605-aac1-680e0b7e8bc4 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:25.072587 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699e6bc3-e3ba-4605-aac1-680e0b7e8bc4 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:25.074157 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699e6bc3-e3ba-4605-aac1-680e0b7e8bc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:25.116596 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-699e6bc3-e3ba-4605-aac1-680e0b7e8bc4 None None] MFA Rules not processed for user `ae0eb1e8b9364299a9248b88512d5ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:21:25.118329 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-699e6bc3-e3ba-4605-aac1-680e0b7e8bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:25.199053 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1167/2340] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:21:25 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:21:25.204014 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c75bdb8-dfa2-4bf8-96af-b64c32a68281 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:25.281683 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c75bdb8-dfa2-4bf8-96af-b64c32a68281 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:25.286967 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ddbbeb-c7c5-43ce-897d-45b65cfca7ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:25.287638 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ddbbeb-c7c5-43ce-897d-45b65cfca7ac admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:25.287921 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ddbbeb-c7c5-43ce-897d-45b65cfca7ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:25.288193 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ddbbeb-c7c5-43ce-897d-45b65cfca7ac admin admin] PATH_INFO: `/v3/projects` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:25.288890 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ddbbeb-c7c5-43ce-897d-45b65cfca7ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:25.291140 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ddbbeb-c7c5-43ce-897d-45b65cfca7ac admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:25.325808 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1174/2341] 10.222.0.43 () {60 vars in 1152 bytes} [Wed Jun 22 10:21:25 2022] POST /identity/v3/projects => generated 393 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:21:25.326439 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699e6bc3-e3ba-4605-aac1-680e0b7e8bc4 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:25.339518 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699e6bc3-e3ba-4605-aac1-680e0b7e8bc4 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:25.367898 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:25.408856 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98abafa-7fc5-4212-9a25-1ea249d48708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:25.409739 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98abafa-7fc5-4212-9a25-1ea249d48708 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:25.410136 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98abafa-7fc5-4212-9a25-1ea249d48708 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:25.410498 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98abafa-7fc5-4212-9a25-1ea249d48708 admin admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:25.411269 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98abafa-7fc5-4212-9a25-1ea249d48708 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:25.413219 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98abafa-7fc5-4212-9a25-1ea249d48708 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:25.437746 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1168/2342] 10.222.0.43 () {60 vars in 1143 bytes} [Wed Jun 22 10:21:25 2022] POST /identity/v3/users => generated 303 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 10:21:25.441648 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ddbbeb-c7c5-43ce-897d-45b65cfca7ac admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:25.453500 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ddbbeb-c7c5-43ce-897d-45b65cfca7ac admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:25.458266 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a09ac8-c10e-4383-8e2c-82c3b0216200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:25.459099 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a09ac8-c10e-4383-8e2c-82c3b0216200 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:25.459392 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a09ac8-c10e-4383-8e2c-82c3b0216200 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:25.459674 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a09ac8-c10e-4383-8e2c-82c3b0216200 admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:25.460410 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a09ac8-c10e-4383-8e2c-82c3b0216200 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:25.462077 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a09ac8-c10e-4383-8e2c-82c3b0216200 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:25.477982 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1175/2343] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:21:25 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:21:25.481952 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98abafa-7fc5-4212-9a25-1ea249d48708 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:25.497655 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98abafa-7fc5-4212-9a25-1ea249d48708 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:25.503974 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20802ab9-8b6c-4d1d-b168-b83d9b4db300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:25.504973 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20802ab9-8b6c-4d1d-b168-b83d9b4db300 admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:25.505265 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20802ab9-8b6c-4d1d-b168-b83d9b4db300 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:25.505554 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20802ab9-8b6c-4d1d-b168-b83d9b4db300 admin admin] PATH_INFO: `/v3/projects/a1cbf501c91f4f98827781488b02f946/users/01344be6d0314b8989e453a59fbd4f0c/roles/26d9c2ab5dfc4e6d9ca80c6014123906` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:25.524673 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20802ab9-8b6c-4d1d-b168-b83d9b4db300 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1cbf501c91f4f98827781488b02f946, user_id=01344be6d0314b8989e453a59fbd4f0c, role_id=26d9c2ab5dfc4e6d9ca80c6014123906)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:25.527531 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20802ab9-8b6c-4d1d-b168-b83d9b4db300 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:25.546836 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1169/2344] 10.222.0.43 () {60 vars in 1482 bytes} [Wed Jun 22 10:21:25 2022] PUT /identity/v3/projects/a1cbf501c91f4f98827781488b02f946/users/01344be6d0314b8989e453a59fbd4f0c/roles/26d9c2ab5dfc4e6d9ca80c6014123906 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:21:25.550896 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a09ac8-c10e-4383-8e2c-82c3b0216200 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:25.562135 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a09ac8-c10e-4383-8e2c-82c3b0216200 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:25.633513 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3712b1fe-e19e-41b7-bc7e-ea6658739bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:25.634219 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3712b1fe-e19e-41b7-bc7e-ea6658739bfd admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:25.634503 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3712b1fe-e19e-41b7-bc7e-ea6658739bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:25.634777 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3712b1fe-e19e-41b7-bc7e-ea6658739bfd admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:25.635506 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3712b1fe-e19e-41b7-bc7e-ea6658739bfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:25.637161 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3712b1fe-e19e-41b7-bc7e-ea6658739bfd admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:25.649613 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1176/2345] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:21:25 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:21:25.653301 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20802ab9-8b6c-4d1d-b168-b83d9b4db300 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:25.665464 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20802ab9-8b6c-4d1d-b168-b83d9b4db300 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:25.671366 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58a4bfa-4319-4e13-8452-1f568955409c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:25.672308 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58a4bfa-4319-4e13-8452-1f568955409c admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:25.672635 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58a4bfa-4319-4e13-8452-1f568955409c admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:25.672963 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58a4bfa-4319-4e13-8452-1f568955409c admin admin] PATH_INFO: `/v3/projects/a1cbf501c91f4f98827781488b02f946/users/01344be6d0314b8989e453a59fbd4f0c/roles/26d9c2ab5dfc4e6d9ca80c6014123906` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:25.675051 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58a4bfa-4319-4e13-8452-1f568955409c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1cbf501c91f4f98827781488b02f946, user_id=01344be6d0314b8989e453a59fbd4f0c, role_id=26d9c2ab5dfc4e6d9ca80c6014123906)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:25.677778 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58a4bfa-4319-4e13-8452-1f568955409c admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:25.693643 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1170/2346] 10.222.0.43 () {60 vars in 1482 bytes} [Wed Jun 22 10:21:25 2022] PUT /identity/v3/projects/a1cbf501c91f4f98827781488b02f946/users/01344be6d0314b8989e453a59fbd4f0c/roles/26d9c2ab5dfc4e6d9ca80c6014123906 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:21:25.704842 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f13044b-54df-4a4a-9901-d87e8b4ee342 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:25.705098 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f13044b-54df-4a4a-9901-d87e8b4ee342 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:25.705392 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f13044b-54df-4a4a-9901-d87e8b4ee342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:25.732375 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:25.736585 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-3f13044b-54df-4a4a-9901-d87e8b4ee342 None None] MFA Rules not processed for user `01344be6d0314b8989e453a59fbd4f0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:21:25.738686 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-3f13044b-54df-4a4a-9901-d87e8b4ee342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:25.834675 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1177/2347] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:21:25 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:21:25.848024 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58a4bfa-4319-4e13-8452-1f568955409c admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:25.849926 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-b58a4bfa-4319-4e13-8452-1f568955409c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:25.932641 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58a4bfa-4319-4e13-8452-1f568955409c admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:25.937844 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5c20fd-d899-48f0-8aec-738f4d6e880e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bbcb3d4dc704dfdb0097abc594ca855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:25.938557 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5c20fd-d899-48f0-8aec-738f4d6e880e service cinder] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:25.938901 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5c20fd-d899-48f0-8aec-738f4d6e880e service cinder] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:25.939309 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5c20fd-d899-48f0-8aec-738f4d6e880e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:25.951949 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5c20fd-d899-48f0-8aec-738f4d6e880e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:25.953502 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5c20fd-d899-48f0-8aec-738f4d6e880e service cinder] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:25.964598 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1171/2348] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:21:25 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:21:26.019134 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f13044b-54df-4a4a-9901-d87e8b4ee342 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:26.020537 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-3f13044b-54df-4a4a-9901-d87e8b4ee342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:26.033369 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f13044b-54df-4a4a-9901-d87e8b4ee342 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:26.038346 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8c5be0-9c38-4ed5-a1ea-8503af3c9900 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bbcb3d4dc704dfdb0097abc594ca855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:26.039008 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8c5be0-9c38-4ed5-a1ea-8503af3c9900 service cinder] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:26.039298 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8c5be0-9c38-4ed5-a1ea-8503af3c9900 service cinder] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:26.039579 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8c5be0-9c38-4ed5-a1ea-8503af3c9900 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:26.127750 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8c5be0-9c38-4ed5-a1ea-8503af3c9900 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:26.129522 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8c5be0-9c38-4ed5-a1ea-8503af3c9900 service cinder] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:26.140127 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1178/2349] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:21:26 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:21:29.559915 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5c20fd-d899-48f0-8aec-738f4d6e880e service cinder] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:29.624868 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5c20fd-d899-48f0-8aec-738f4d6e880e service cinder] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:29.629433 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772c2f9f-f612-4495-b85e-c467792195a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:29.630326 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772c2f9f-f612-4495-b85e-c467792195a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:29.630613 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772c2f9f-f612-4495-b85e-c467792195a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:29.630892 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772c2f9f-f612-4495-b85e-c467792195a9 admin admin] PATH_INFO: `/v3/users/ae0eb1e8b9364299a9248b88512d5ce7` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:29.632072 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772c2f9f-f612-4495-b85e-c467792195a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae0eb1e8b9364299a9248b88512d5ce7)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:29.634034 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772c2f9f-f612-4495-b85e-c467792195a9 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:29.655116 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:29.681361 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-772c2f9f-f612-4495-b85e-c467792195a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae0eb1e8b9364299a9248b88512d5ce7'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:29.694561 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-772c2f9f-f612-4495-b85e-c467792195a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae0eb1e8b9364299a9248b88512d5ce7'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:29.703491 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-772c2f9f-f612-4495-b85e-c467792195a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae0eb1e8b9364299a9248b88512d5ce7'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:29.704237 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-772c2f9f-f612-4495-b85e-c467792195a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae0eb1e8b9364299a9248b88512d5ce7'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:29.711321 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-772c2f9f-f612-4495-b85e-c467792195a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae0eb1e8b9364299a9248b88512d5ce7'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:29.717344 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1172/2350] 10.222.0.43 () {58 vars in 1223 bytes} [Wed Jun 22 10:21:29 2022] DELETE /identity/v3/users/ae0eb1e8b9364299a9248b88512d5ce7 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:21:29.722083 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe4cb01-df46-4ffb-b671-0e36d8f47ed4 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:29.722574 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe4cb01-df46-4ffb-b671-0e36d8f47ed4 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:29.722711 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe4cb01-df46-4ffb-b671-0e36d8f47ed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:29.740280 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-abe4cb01-df46-4ffb-b671-0e36d8f47ed4 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:21:29.741476 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-abe4cb01-df46-4ffb-b671-0e36d8f47ed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:29.800257 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1179/2351] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:21:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:21:29.809889 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772c2f9f-f612-4495-b85e-c467792195a9 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:29.812071 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-772c2f9f-f612-4495-b85e-c467792195a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:29.869031 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772c2f9f-f612-4495-b85e-c467792195a9 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:29.872738 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fdf4eb-154b-4b51-a337-a0f2ae2d7e22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe93d4c0737249fd8623bb5ce188e34e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:29.874074 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fdf4eb-154b-4b51-a337-a0f2ae2d7e22 service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:29.874361 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fdf4eb-154b-4b51-a337-a0f2ae2d7e22 service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:29.874641 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fdf4eb-154b-4b51-a337-a0f2ae2d7e22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:29.883622 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fdf4eb-154b-4b51-a337-a0f2ae2d7e22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:29.885049 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fdf4eb-154b-4b51-a337-a0f2ae2d7e22 service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:29.894623 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1173/2352] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:21:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:21:30.168873 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe4cb01-df46-4ffb-b671-0e36d8f47ed4 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:30.171103 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-abe4cb01-df46-4ffb-b671-0e36d8f47ed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:30.183892 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe4cb01-df46-4ffb-b671-0e36d8f47ed4 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:30.189054 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a913ed0d-2424-40f5-9960-1228e549e04c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:30.190043 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a913ed0d-2424-40f5-9960-1228e549e04c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:30.190388 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a913ed0d-2424-40f5-9960-1228e549e04c admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:30.190732 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a913ed0d-2424-40f5-9960-1228e549e04c admin admin] PATH_INFO: `/v3/projects/ce4f1cfe562648c485da37580eca48f9` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:30.191978 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a913ed0d-2424-40f5-9960-1228e549e04c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce4f1cfe562648c485da37580eca48f9)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:30.193940 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a913ed0d-2424-40f5-9960-1228e549e04c admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:30.230340 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:30.244256 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-a913ed0d-2424-40f5-9960-1228e549e04c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce4f1cfe562648c485da37580eca48f9', 'request_id': 'req-a913ed0d-2424-40f5-9960-1228e549e04c'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:30.250944 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-a913ed0d-2424-40f5-9960-1228e549e04c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce4f1cfe562648c485da37580eca48f9', 'request_id': 'req-a913ed0d-2424-40f5-9960-1228e549e04c'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:30.256577 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-a913ed0d-2424-40f5-9960-1228e549e04c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce4f1cfe562648c485da37580eca48f9', 'request_id': 'req-a913ed0d-2424-40f5-9960-1228e549e04c'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:30.269342 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-a913ed0d-2424-40f5-9960-1228e549e04c admin admin] The token cache is being invalidate because project ce4f1cfe562648c485da37580eca48f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:21:30.269625 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-a913ed0d-2424-40f5-9960-1228e549e04c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:30.270273 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-a913ed0d-2424-40f5-9960-1228e549e04c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:30.271789 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1180/2353] 10.222.0.43 () {58 vars in 1232 bytes} [Wed Jun 22 10:21:30 2022] DELETE /identity/v3/projects/ce4f1cfe562648c485da37580eca48f9 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:21:30.275698 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fdf4eb-154b-4b51-a337-a0f2ae2d7e22 service neutron] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:30.286544 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fdf4eb-154b-4b51-a337-a0f2ae2d7e22 service neutron] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:30.343342 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d85e5b9-74a3-49a1-beed-aaaa7ce8f70f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:30.344213 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d85e5b9-74a3-49a1-beed-aaaa7ce8f70f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:30.344499 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d85e5b9-74a3-49a1-beed-aaaa7ce8f70f admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:30.344779 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d85e5b9-74a3-49a1-beed-aaaa7ce8f70f admin admin] PATH_INFO: `/v3/users/01344be6d0314b8989e453a59fbd4f0c` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:30.346006 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d85e5b9-74a3-49a1-beed-aaaa7ce8f70f admin admin] RBAC: Authorizing `identity:delete_user(user_id=01344be6d0314b8989e453a59fbd4f0c)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:30.347929 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d85e5b9-74a3-49a1-beed-aaaa7ce8f70f admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:30.390900 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:30.393549 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-1d85e5b9-74a3-49a1-beed-aaaa7ce8f70f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01344be6d0314b8989e453a59fbd4f0c'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:30.408097 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-1d85e5b9-74a3-49a1-beed-aaaa7ce8f70f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01344be6d0314b8989e453a59fbd4f0c'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:30.415626 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-1d85e5b9-74a3-49a1-beed-aaaa7ce8f70f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01344be6d0314b8989e453a59fbd4f0c'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:30.416246 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-1d85e5b9-74a3-49a1-beed-aaaa7ce8f70f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01344be6d0314b8989e453a59fbd4f0c'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:30.423767 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-1d85e5b9-74a3-49a1-beed-aaaa7ce8f70f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01344be6d0314b8989e453a59fbd4f0c'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:30.430272 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1174/2354] 10.222.0.43 () {58 vars in 1223 bytes} [Wed Jun 22 10:21:30 2022] DELETE /identity/v3/users/01344be6d0314b8989e453a59fbd4f0c => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:21:30.715822 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a913ed0d-2424-40f5-9960-1228e549e04c admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:30.718731 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-a913ed0d-2424-40f5-9960-1228e549e04c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:30.745810 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a913ed0d-2424-40f5-9960-1228e549e04c admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:30.817227 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cca60a-4fd6-4a1a-bf4a-e629ca425c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:30.818449 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cca60a-4fd6-4a1a-bf4a-e629ca425c08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:30.818738 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cca60a-4fd6-4a1a-bf4a-e629ca425c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:30.818995 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cca60a-4fd6-4a1a-bf4a-e629ca425c08 admin admin] PATH_INFO: `/v3/projects/a1cbf501c91f4f98827781488b02f946` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:30.821119 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cca60a-4fd6-4a1a-bf4a-e629ca425c08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1cbf501c91f4f98827781488b02f946)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:30.823307 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cca60a-4fd6-4a1a-bf4a-e629ca425c08 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:30.885842 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-10cca60a-4fd6-4a1a-bf4a-e629ca425c08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1cbf501c91f4f98827781488b02f946', 'request_id': 'req-10cca60a-4fd6-4a1a-bf4a-e629ca425c08'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:30.892980 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-10cca60a-4fd6-4a1a-bf4a-e629ca425c08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1cbf501c91f4f98827781488b02f946', 'request_id': 'req-10cca60a-4fd6-4a1a-bf4a-e629ca425c08'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:30.899725 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-10cca60a-4fd6-4a1a-bf4a-e629ca425c08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1cbf501c91f4f98827781488b02f946', 'request_id': 'req-10cca60a-4fd6-4a1a-bf4a-e629ca425c08'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:30.914719 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-10cca60a-4fd6-4a1a-bf4a-e629ca425c08 admin admin] The token cache is being invalidate because project a1cbf501c91f4f98827781488b02f946 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:21:30.915045 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-10cca60a-4fd6-4a1a-bf4a-e629ca425c08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:30.915884 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-10cca60a-4fd6-4a1a-bf4a-e629ca425c08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:30.917304 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1181/2355] 10.222.0.43 () {58 vars in 1232 bytes} [Wed Jun 22 10:21:30 2022] DELETE /identity/v3/projects/a1cbf501c91f4f98827781488b02f946 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:21:30.922573 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc663a74-548a-46ea-85c9-ce4739593376 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:30.923047 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc663a74-548a-46ea-85c9-ce4739593376 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:30.923234 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc663a74-548a-46ea-85c9-ce4739593376 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:30.942218 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-bc663a74-548a-46ea-85c9-ce4739593376 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:21:30.943554 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-bc663a74-548a-46ea-85c9-ce4739593376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:31.009164 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1175/2356] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:21:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:21:31.018889 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a87b10-5f28-4013-96d2-ed92bb71e269 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:31.024173 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a87b10-5f28-4013-96d2-ed92bb71e269 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:31.024173 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a87b10-5f28-4013-96d2-ed92bb71e269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:31.046299 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-a7a87b10-5f28-4013-96d2-ed92bb71e269 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:21:31.047720 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-a7a87b10-5f28-4013-96d2-ed92bb71e269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:31.055823 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1182/2357] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:21:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:21:31.060089 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc663a74-548a-46ea-85c9-ce4739593376 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:31.071497 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc663a74-548a-46ea-85c9-ce4739593376 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:31.079283 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719e94c6-ca81-46a7-bf3a-9923191a3763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:31.079971 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719e94c6-ca81-46a7-bf3a-9923191a3763 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:31.080261 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719e94c6-ca81-46a7-bf3a-9923191a3763 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:31.080545 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719e94c6-ca81-46a7-bf3a-9923191a3763 admin admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:31.081313 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719e94c6-ca81-46a7-bf3a-9923191a3763 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:21:31.081628 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719e94c6-ca81-46a7-bf3a-9923191a3763 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:31.083423 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719e94c6-ca81-46a7-bf3a-9923191a3763 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:31.101886 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1176/2358] 10.222.0.43 () {58 vars in 1152 bytes} [Wed Jun 22 10:21:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:21:31.103545 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a87b10-5f28-4013-96d2-ed92bb71e269 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:31.114345 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a87b10-5f28-4013-96d2-ed92bb71e269 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:31.119226 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafe1c60-800b-4eee-91f3-ef021ab6dd2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:31.119892 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafe1c60-800b-4eee-91f3-ef021ab6dd2f admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:31.120177 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafe1c60-800b-4eee-91f3-ef021ab6dd2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:31.120454 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafe1c60-800b-4eee-91f3-ef021ab6dd2f admin admin] PATH_INFO: `/v3/projects` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:31.121164 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafe1c60-800b-4eee-91f3-ef021ab6dd2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:31.124512 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafe1c60-800b-4eee-91f3-ef021ab6dd2f admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:31.152292 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1183/2359] 10.222.0.43 () {60 vars in 1152 bytes} [Wed Jun 22 10:21:31 2022] POST /identity/v3/projects => generated 401 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:21:31.156539 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719e94c6-ca81-46a7-bf3a-9923191a3763 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:31.166878 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719e94c6-ca81-46a7-bf3a-9923191a3763 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:31.226937 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d32eb9-c72b-4464-af97-0171e3847bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:31.227934 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d32eb9-c72b-4464-af97-0171e3847bea admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:31.228292 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d32eb9-c72b-4464-af97-0171e3847bea admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:31.228580 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d32eb9-c72b-4464-af97-0171e3847bea admin admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:31.229283 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d32eb9-c72b-4464-af97-0171e3847bea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:31.231232 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d32eb9-c72b-4464-af97-0171e3847bea admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:31.252966 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1177/2360] 10.222.0.43 () {60 vars in 1143 bytes} [Wed Jun 22 10:21:31 2022] POST /identity/v3/users => generated 301 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:21:31.256934 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafe1c60-800b-4eee-91f3-ef021ab6dd2f admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:31.268933 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafe1c60-800b-4eee-91f3-ef021ab6dd2f admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:31.274427 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aab39c-57e5-4616-8497-04d0dbc54cf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:31.275096 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aab39c-57e5-4616-8497-04d0dbc54cf8 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:31.275391 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aab39c-57e5-4616-8497-04d0dbc54cf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:31.275674 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aab39c-57e5-4616-8497-04d0dbc54cf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:31.276407 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0aab39c-57e5-4616-8497-04d0dbc54cf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:31.278075 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0aab39c-57e5-4616-8497-04d0dbc54cf8 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:31.289607 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1184/2361] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:21:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:21:31.293625 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d32eb9-c72b-4464-af97-0171e3847bea admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:31.304262 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d32eb9-c72b-4464-af97-0171e3847bea admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:31.311247 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1179ccaa-1328-48b2-8ba9-7621575040dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:31.312494 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1179ccaa-1328-48b2-8ba9-7621575040dc admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:31.312922 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1179ccaa-1328-48b2-8ba9-7621575040dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:31.313215 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1179ccaa-1328-48b2-8ba9-7621575040dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:31.314015 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1179ccaa-1328-48b2-8ba9-7621575040dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:31.316096 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1179ccaa-1328-48b2-8ba9-7621575040dc admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:31.326941 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1178/2362] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:21:31 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:21:31.331154 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aab39c-57e5-4616-8497-04d0dbc54cf8 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:31.342117 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aab39c-57e5-4616-8497-04d0dbc54cf8 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:31.347281 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6cb7ea-1577-4509-933d-f6aa4cba86eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:31.348274 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6cb7ea-1577-4509-933d-f6aa4cba86eb admin admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:31.348567 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6cb7ea-1577-4509-933d-f6aa4cba86eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:31.348853 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6cb7ea-1577-4509-933d-f6aa4cba86eb admin admin] PATH_INFO: `/v3/projects/20419b2121d640749f1eece50db32a81/users/af75e3f969f04912a21e7bf44227c4c8/roles/9f88c83743f745a9a785a2f454753f06` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:31.359162 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:31.368741 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6cb7ea-1577-4509-933d-f6aa4cba86eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=20419b2121d640749f1eece50db32a81, user_id=af75e3f969f04912a21e7bf44227c4c8, role_id=9f88c83743f745a9a785a2f454753f06)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:31.371643 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6cb7ea-1577-4509-933d-f6aa4cba86eb admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:31.387438 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1185/2363] 10.222.0.43 () {60 vars in 1482 bytes} [Wed Jun 22 10:21:31 2022] PUT /identity/v3/projects/20419b2121d640749f1eece50db32a81/users/af75e3f969f04912a21e7bf44227c4c8/roles/9f88c83743f745a9a785a2f454753f06 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:21:31.406824 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af926f3-e747-4f7a-8462-0ce9053c742d None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:31.407154 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af926f3-e747-4f7a-8462-0ce9053c742d None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:31.407443 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af926f3-e747-4f7a-8462-0ce9053c742d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:31.441741 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-7af926f3-e747-4f7a-8462-0ce9053c742d None None] MFA Rules not processed for user `af75e3f969f04912a21e7bf44227c4c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:21:31.442896 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-7af926f3-e747-4f7a-8462-0ce9053c742d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:31.456258 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:31.465910 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6cb7ea-1577-4509-933d-f6aa4cba86eb admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:31.468308 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-df6cb7ea-1577-4509-933d-f6aa4cba86eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:31.512315 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1179/2364] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:21:31 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:21:31.517007 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af926f3-e747-4f7a-8462-0ce9053c742d None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:31.528360 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6cb7ea-1577-4509-933d-f6aa4cba86eb admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:31.533472 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d5ee07-57e2-439b-bfbe-29a5e583a19b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe93d4c0737249fd8623bb5ce188e34e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:31.534318 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d5ee07-57e2-439b-bfbe-29a5e583a19b service neutron] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:31.534607 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d5ee07-57e2-439b-bfbe-29a5e583a19b service neutron] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:31.534888 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d5ee07-57e2-439b-bfbe-29a5e583a19b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:31.536879 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-40d5ee07-57e2-439b-bfbe-29a5e583a19b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:31.547348 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d5ee07-57e2-439b-bfbe-29a5e583a19b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:31.548810 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d5ee07-57e2-439b-bfbe-29a5e583a19b service neutron] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:31.556815 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1186/2365] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:21:31 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 10:21:31.590178 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af926f3-e747-4f7a-8462-0ce9053c742d None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:31.595390 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a271b4-2ae2-4552-9494-d2dc8708c30b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:31.596054 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a271b4-2ae2-4552-9494-d2dc8708c30b admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:31.596339 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a271b4-2ae2-4552-9494-d2dc8708c30b admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:31.596617 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a271b4-2ae2-4552-9494-d2dc8708c30b admin admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:31.597308 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a271b4-2ae2-4552-9494-d2dc8708c30b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:31.599259 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a271b4-2ae2-4552-9494-d2dc8708c30b admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:31.627531 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1180/2366] 10.222.0.43 () {60 vars in 1152 bytes} [Wed Jun 22 10:21:31 2022] POST /identity/v3/projects => generated 399 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 10:21:31.628860 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d5ee07-57e2-439b-bfbe-29a5e583a19b service neutron] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:31.641096 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d5ee07-57e2-439b-bfbe-29a5e583a19b service neutron] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:31.669589 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e32cf2-4d0a-4da8-b0de-143555444f89 None None] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:31.670956 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e32cf2-4d0a-4da8-b0de-143555444f89 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:31.671294 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e32cf2-4d0a-4da8-b0de-143555444f89 None None] PATH_INFO: `/` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:31.673291 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1181/2367] 10.222.0.43 () {54 vars in 921 bytes} [Wed Jun 22 10:21:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 10:21:31.679714 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5bf9cd-3b1f-4561-be22-f1534653854b None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:31.680032 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5bf9cd-3b1f-4561-be22-f1534653854b None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:31.680324 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5bf9cd-3b1f-4561-be22-f1534653854b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:31.707224 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbd3e26-3ade-4ad6-9d54-b6ec361fb229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:31.707789 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbd3e26-3ade-4ad6-9d54-b6ec361fb229 admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:31.708150 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbd3e26-3ade-4ad6-9d54-b6ec361fb229 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:31.708429 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbd3e26-3ade-4ad6-9d54-b6ec361fb229 admin admin] PATH_INFO: `/v3/users` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:31.709124 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbd3e26-3ade-4ad6-9d54-b6ec361fb229 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:31.711259 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbd3e26-3ade-4ad6-9d54-b6ec361fb229 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:31.726483 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-8c5bf9cd-3b1f-4561-be22-f1534653854b None None] MFA Rules not processed for user `158a49aa3750478a84bf71b9aad24397`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:21:31.728189 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-8c5bf9cd-3b1f-4561-be22-f1534653854b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:31.734829 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1187/2368] 10.222.0.43 () {60 vars in 1143 bytes} [Wed Jun 22 10:21:31 2022] POST /identity/v3/users => generated 306 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:21:31.738732 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbd3e26-3ade-4ad6-9d54-b6ec361fb229 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:31.750911 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbd3e26-3ade-4ad6-9d54-b6ec361fb229 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:31.756150 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0268bec-699d-4ffa-b33d-cb8cc067db74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:31.756847 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0268bec-699d-4ffa-b33d-cb8cc067db74 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:31.757137 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0268bec-699d-4ffa-b33d-cb8cc067db74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:31.757424 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0268bec-699d-4ffa-b33d-cb8cc067db74 admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:31.758828 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0268bec-699d-4ffa-b33d-cb8cc067db74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:31.760471 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0268bec-699d-4ffa-b33d-cb8cc067db74 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:31.772281 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1188/2369] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:21:31 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 10:21:31.776428 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0268bec-699d-4ffa-b33d-cb8cc067db74 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:31.788087 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0268bec-699d-4ffa-b33d-cb8cc067db74 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:31.793405 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab93f828-a3fe-4db5-9f8c-faa871f650cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:31.794336 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab93f828-a3fe-4db5-9f8c-faa871f650cc admin admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:31.794630 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab93f828-a3fe-4db5-9f8c-faa871f650cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:31.794940 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab93f828-a3fe-4db5-9f8c-faa871f650cc admin admin] PATH_INFO: `/v3/projects/fbf00ed346114322b68314e5a6aa53df/users/5f031d758aed4cabb1287830225b0dbb/roles/26d9c2ab5dfc4e6d9ca80c6014123906` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:31.812726 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab93f828-a3fe-4db5-9f8c-faa871f650cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbf00ed346114322b68314e5a6aa53df, user_id=5f031d758aed4cabb1287830225b0dbb, role_id=26d9c2ab5dfc4e6d9ca80c6014123906)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:31.814326 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1182/2370] 10.222.0.43 () {58 vars in 1018 bytes} [Wed Jun 22 10:21:31 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:21:31.819522 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab93f828-a3fe-4db5-9f8c-faa871f650cc admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:31.829956 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5bf9cd-3b1f-4561-be22-f1534653854b None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:31.832023 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-8c5bf9cd-3b1f-4561-be22-f1534653854b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:31.838970 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1189/2371] 10.222.0.43 () {60 vars in 1482 bytes} [Wed Jun 22 10:21:31 2022] PUT /identity/v3/projects/fbf00ed346114322b68314e5a6aa53df/users/5f031d758aed4cabb1287830225b0dbb/roles/26d9c2ab5dfc4e6d9ca80c6014123906 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:21:31.843304 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab93f828-a3fe-4db5-9f8c-faa871f650cc admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:31.859008 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:31.906323 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:31.929353 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5bf9cd-3b1f-4561-be22-f1534653854b None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:31.930650 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab93f828-a3fe-4db5-9f8c-faa871f650cc admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:31.936812 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5460a0c-e658-4aac-b898-38549d03c50a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:31.937485 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5460a0c-e658-4aac-b898-38549d03c50a admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:31.937804 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5460a0c-e658-4aac-b898-38549d03c50a admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:31.938088 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5460a0c-e658-4aac-b898-38549d03c50a admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:31.938881 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5460a0c-e658-4aac-b898-38549d03c50a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:31.940561 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5460a0c-e658-4aac-b898-38549d03c50a admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:31.950863 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1190/2372] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:21:31 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:21:31.951777 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5460a0c-e658-4aac-b898-38549d03c50a admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:31.953526 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-c5460a0c-e658-4aac-b898-38549d03c50a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:31.983066 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f39aa58-6b5c-4c93-8050-aa88aaa514b8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2418acec46b4db48346129004827853', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:31.983941 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f39aa58-6b5c-4c93-8050-aa88aaa514b8 service glance] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:31.984323 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f39aa58-6b5c-4c93-8050-aa88aaa514b8 service glance] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:31.984702 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f39aa58-6b5c-4c93-8050-aa88aaa514b8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:32.027468 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5460a0c-e658-4aac-b898-38549d03c50a admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:32.032924 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d2f7b6-04b0-48e9-a3e0-03a290c47148 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '158a49aa3750478a84bf71b9aad24397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:32.033631 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d2f7b6-04b0-48e9-a3e0-03a290c47148 service nova] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:32.033960 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d2f7b6-04b0-48e9-a3e0-03a290c47148 service nova] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:32.034245 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d2f7b6-04b0-48e9-a3e0-03a290c47148 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:32.036034 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-d0d2f7b6-04b0-48e9-a3e0-03a290c47148 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:32.048785 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d2f7b6-04b0-48e9-a3e0-03a290c47148 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:32.050501 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d2f7b6-04b0-48e9-a3e0-03a290c47148 service nova] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:32.054288 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f39aa58-6b5c-4c93-8050-aa88aaa514b8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:32.057428 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f39aa58-6b5c-4c93-8050-aa88aaa514b8 service glance] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:32.061521 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1191/2373] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:21:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:21:32.062348 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d2f7b6-04b0-48e9-a3e0-03a290c47148 service nova] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:32.070275 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1183/2374] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:21:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 10:21:32.074794 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d2f7b6-04b0-48e9-a3e0-03a290c47148 service nova] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:32.080850 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb81235d-05fc-45ea-9c95-c2ab941a587e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:32.081795 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb81235d-05fc-45ea-9c95-c2ab941a587e admin admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:32.082080 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb81235d-05fc-45ea-9c95-c2ab941a587e admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:32.082368 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb81235d-05fc-45ea-9c95-c2ab941a587e admin admin] PATH_INFO: `/v3/projects/fbf00ed346114322b68314e5a6aa53df/users/5f031d758aed4cabb1287830225b0dbb/roles/26d9c2ab5dfc4e6d9ca80c6014123906` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:32.084657 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb81235d-05fc-45ea-9c95-c2ab941a587e admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbf00ed346114322b68314e5a6aa53df, user_id=5f031d758aed4cabb1287830225b0dbb, role_id=26d9c2ab5dfc4e6d9ca80c6014123906)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:32.090787 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb81235d-05fc-45ea-9c95-c2ab941a587e admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:32.101587 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1192/2375] 10.222.0.43 () {60 vars in 1482 bytes} [Wed Jun 22 10:21:32 2022] PUT /identity/v3/projects/fbf00ed346114322b68314e5a6aa53df/users/5f031d758aed4cabb1287830225b0dbb/roles/26d9c2ab5dfc4e6d9ca80c6014123906 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:21:32.112788 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a3a35d-9e88-4377-8c80-b343823e7913 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:32.113080 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a3a35d-9e88-4377-8c80-b343823e7913 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:32.113361 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a3a35d-9e88-4377-8c80-b343823e7913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:32.141867 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-a8a3a35d-9e88-4377-8c80-b343823e7913 None None] MFA Rules not processed for user `5f031d758aed4cabb1287830225b0dbb`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:21:32.143171 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-a8a3a35d-9e88-4377-8c80-b343823e7913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:32.146848 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfde940-8d3d-4d5c-a962-c8b345f56a39 None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:32.147137 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfde940-8d3d-4d5c-a962-c8b345f56a39 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:32.147419 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfde940-8d3d-4d5c-a962-c8b345f56a39 None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:32.148803 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1193/2376] 10.222.0.43 () {54 vars in 921 bytes} [Wed Jun 22 10:21:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:21:32.153351 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ae57c5-d913-41e4-9cb7-d2fabc16e446 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:32.153809 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ae57c5-d913-41e4-9cb7-d2fabc16e446 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:32.154798 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ae57c5-d913-41e4-9cb7-d2fabc16e446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:32.174514 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-d0ae57c5-d913-41e4-9cb7-d2fabc16e446 None None] MFA Rules not processed for user `fe93d4c0737249fd8623bb5ce188e34e`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:21:32.175762 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-d0ae57c5-d913-41e4-9cb7-d2fabc16e446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:32.190429 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:32.218049 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1184/2377] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:21:32 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:21:32.228896 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a3a35d-9e88-4377-8c80-b343823e7913 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:32.229374 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1194/2378] 10.222.0.43 () {58 vars in 1018 bytes} [Wed Jun 22 10:21:32 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:21:32.230615 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-a8a3a35d-9e88-4377-8c80-b343823e7913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:32.241514 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ae57c5-d913-41e4-9cb7-d2fabc16e446 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:32.243025 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-d0ae57c5-d913-41e4-9cb7-d2fabc16e446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:32.254431 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ae57c5-d913-41e4-9cb7-d2fabc16e446 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:32.258078 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73c6be8-1dcb-4292-b0b0-8cbea795e7e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe93d4c0737249fd8623bb5ce188e34e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:32.258714 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73c6be8-1dcb-4292-b0b0-8cbea795e7e3 service neutron] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:32.258998 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73c6be8-1dcb-4292-b0b0-8cbea795e7e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:32.259275 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73c6be8-1dcb-4292-b0b0-8cbea795e7e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:32.267013 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73c6be8-1dcb-4292-b0b0-8cbea795e7e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:32.268474 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73c6be8-1dcb-4292-b0b0-8cbea795e7e3 service neutron] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:32.276291 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1195/2379] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:21:32 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 10:21:32.290479 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a3a35d-9e88-4377-8c80-b343823e7913 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:32.294061 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23614a27-8f21-4f46-b9b7-11ac8e20c88f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bbcb3d4dc704dfdb0097abc594ca855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:32.294736 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23614a27-8f21-4f46-b9b7-11ac8e20c88f service cinder] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:32.295028 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23614a27-8f21-4f46-b9b7-11ac8e20c88f service cinder] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:32.295291 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23614a27-8f21-4f46-b9b7-11ac8e20c88f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:32.304516 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23614a27-8f21-4f46-b9b7-11ac8e20c88f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:32.305964 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23614a27-8f21-4f46-b9b7-11ac8e20c88f service cinder] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:32.316147 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1185/2380] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:21:32 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 10:21:32.364022 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa0ef0b-f03e-45d8-ab14-e42c2d0e1941 None None] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:32.364465 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa0ef0b-f03e-45d8-ab14-e42c2d0e1941 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:32.364810 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa0ef0b-f03e-45d8-ab14-e42c2d0e1941 None None] PATH_INFO: `/` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:32.366296 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1196/2381] 10.222.0.43 () {54 vars in 921 bytes} [Wed Jun 22 10:21:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 10:21:32.372145 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdeaba0-1a95-433a-8138-83b52c220f2e None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:32.372434 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdeaba0-1a95-433a-8138-83b52c220f2e None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:32.372712 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdeaba0-1a95-433a-8138-83b52c220f2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:32.391431 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa0ef0b-f03e-45d8-ab14-e42c2d0e1941 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:32.391908 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-4bdeaba0-1a95-433a-8138-83b52c220f2e None None] MFA Rules not processed for user `158a49aa3750478a84bf71b9aad24397`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:21:32.393109 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-4bdeaba0-1a95-433a-8138-83b52c220f2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:32.402953 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa0ef0b-f03e-45d8-ab14-e42c2d0e1941 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:32.407969 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0342a7c7-52eb-446b-860b-6a48082dce00 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bbcb3d4dc704dfdb0097abc594ca855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:32.408724 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0342a7c7-52eb-446b-860b-6a48082dce00 service cinder] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:32.409081 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0342a7c7-52eb-446b-860b-6a48082dce00 service cinder] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:32.409427 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0342a7c7-52eb-446b-860b-6a48082dce00 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:32.458055 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:32.462115 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1186/2382] 10.222.0.43 () {58 vars in 1018 bytes} [Wed Jun 22 10:21:32 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:21:32.473548 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0342a7c7-52eb-446b-860b-6a48082dce00 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:32.473668 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdeaba0-1a95-433a-8138-83b52c220f2e None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:32.475142 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0342a7c7-52eb-446b-860b-6a48082dce00 service cinder] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:32.483289 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdeaba0-1a95-433a-8138-83b52c220f2e None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:32.484728 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1197/2383] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:21:32 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 10:21:32.487152 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974710fa-720b-4ec4-aea7-ce6fa81ab3d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe93d4c0737249fd8623bb5ce188e34e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:32.487746 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974710fa-720b-4ec4-aea7-ce6fa81ab3d5 service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:32.488035 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974710fa-720b-4ec4-aea7-ce6fa81ab3d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:32.488319 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974710fa-720b-4ec4-aea7-ce6fa81ab3d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:32.499630 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974710fa-720b-4ec4-aea7-ce6fa81ab3d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:32.501101 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974710fa-720b-4ec4-aea7-ce6fa81ab3d5 service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:32.511943 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1187/2384] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:21:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 10:21:32.578331 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0342a7c7-52eb-446b-860b-6a48082dce00 service cinder] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:32.579786 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-0342a7c7-52eb-446b-860b-6a48082dce00 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:32.657853 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0342a7c7-52eb-446b-860b-6a48082dce00 service cinder] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:32.663678 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab5110d-0beb-48cb-a768-f0671a1fbd79 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '341ec95408c94dae8539ccff7225e3ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:32.664344 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab5110d-0beb-48cb-a768-f0671a1fbd79 service placement] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:32.664628 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab5110d-0beb-48cb-a768-f0671a1fbd79 service placement] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:32.664926 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab5110d-0beb-48cb-a768-f0671a1fbd79 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:32.666870 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-3ab5110d-0beb-48cb-a768-f0671a1fbd79 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:32.679360 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab5110d-0beb-48cb-a768-f0671a1fbd79 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:32.681124 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab5110d-0beb-48cb-a768-f0671a1fbd79 service placement] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:32.693461 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1198/2385] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:21:32 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:21:34.342828 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2b438a-4e95-43ad-9b83-b14484cdf0d1 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:34.343333 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2b438a-4e95-43ad-9b83-b14484cdf0d1 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:34.343437 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2b438a-4e95-43ad-9b83-b14484cdf0d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:34.361599 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-8d2b438a-4e95-43ad-9b83-b14484cdf0d1 None None] MFA Rules not processed for user `317e7e7dd5c741d49d34a1fd949a7c07`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:21:34.362756 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-8d2b438a-4e95-43ad-9b83-b14484cdf0d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:34.417781 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1188/2386] 10.222.0.43 () {58 vars in 1009 bytes} [Wed Jun 22 10:21:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:21:34.430514 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab5110d-0beb-48cb-a768-f0671a1fbd79 service placement] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:34.431891 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-3ab5110d-0beb-48cb-a768-f0671a1fbd79 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:34.507881 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab5110d-0beb-48cb-a768-f0671a1fbd79 service placement] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:34.512799 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cea3a6c-ee9a-4a3f-870b-ef529ec252ec service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9566f8cca2574f4cb5edcbf384f368a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:34.513518 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cea3a6c-ee9a-4a3f-870b-ef529ec252ec service swift] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:34.513830 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cea3a6c-ee9a-4a3f-870b-ef529ec252ec service swift] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:34.514111 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cea3a6c-ee9a-4a3f-870b-ef529ec252ec service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:34.522103 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cea3a6c-ee9a-4a3f-870b-ef529ec252ec service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:34.523703 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cea3a6c-ee9a-4a3f-870b-ef529ec252ec service swift] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:34.532870 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1199/2387] 10.222.0.43 () {60 vars in 1384 bytes} [Wed Jun 22 10:21:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 22 10:21:36.725521 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2b438a-4e95-43ad-9b83-b14484cdf0d1 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:36.736729 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:36.807362 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2b438a-4e95-43ad-9b83-b14484cdf0d1 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:36.813198 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcbff6a-29a6-49fe-9cd3-5f7a4bed471b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:36.816381 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcbff6a-29a6-49fe-9cd3-5f7a4bed471b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:36.816381 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcbff6a-29a6-49fe-9cd3-5f7a4bed471b admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:36.816381 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcbff6a-29a6-49fe-9cd3-5f7a4bed471b admin admin] PATH_INFO: `/v3/users/af75e3f969f04912a21e7bf44227c4c8` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:36.816672 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcbff6a-29a6-49fe-9cd3-5f7a4bed471b admin admin] RBAC: Authorizing `identity:delete_user(user_id=af75e3f969f04912a21e7bf44227c4c8)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:36.818471 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcbff6a-29a6-49fe-9cd3-5f7a4bed471b admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:36.875109 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-dfcbff6a-29a6-49fe-9cd3-5f7a4bed471b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af75e3f969f04912a21e7bf44227c4c8'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:36.887350 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-dfcbff6a-29a6-49fe-9cd3-5f7a4bed471b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af75e3f969f04912a21e7bf44227c4c8'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:36.895865 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-dfcbff6a-29a6-49fe-9cd3-5f7a4bed471b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af75e3f969f04912a21e7bf44227c4c8'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:36.896494 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-dfcbff6a-29a6-49fe-9cd3-5f7a4bed471b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af75e3f969f04912a21e7bf44227c4c8'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:36.905034 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-dfcbff6a-29a6-49fe-9cd3-5f7a4bed471b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af75e3f969f04912a21e7bf44227c4c8'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:36.914600 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1189/2388] 10.222.0.43 () {58 vars in 1223 bytes} [Wed Jun 22 10:21:36 2022] DELETE /identity/v3/users/af75e3f969f04912a21e7bf44227c4c8 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:21:36.916484 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e335427-a788-4b0a-881d-a8a904f25a95 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:36.916975 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e335427-a788-4b0a-881d-a8a904f25a95 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:36.917093 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e335427-a788-4b0a-881d-a8a904f25a95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:36.940065 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-1e335427-a788-4b0a-881d-a8a904f25a95 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:21:36.941522 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-1e335427-a788-4b0a-881d-a8a904f25a95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:37.017643 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1200/2389] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:21:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:21:37.027344 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcbff6a-29a6-49fe-9cd3-5f7a4bed471b admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:37.029461 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-dfcbff6a-29a6-49fe-9cd3-5f7a4bed471b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:37.104643 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcbff6a-29a6-49fe-9cd3-5f7a4bed471b admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:37.109296 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7268743c-4c29-4b8c-a5e1-237a0c348acc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe93d4c0737249fd8623bb5ce188e34e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:37.109991 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7268743c-4c29-4b8c-a5e1-237a0c348acc service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:37.110275 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7268743c-4c29-4b8c-a5e1-237a0c348acc service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:37.110549 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7268743c-4c29-4b8c-a5e1-237a0c348acc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:37.121669 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7268743c-4c29-4b8c-a5e1-237a0c348acc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:37.123715 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7268743c-4c29-4b8c-a5e1-237a0c348acc service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:37.135951 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1190/2390] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:21:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 10:21:37.563925 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e335427-a788-4b0a-881d-a8a904f25a95 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:37.565530 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-1e335427-a788-4b0a-881d-a8a904f25a95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:37.580536 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e335427-a788-4b0a-881d-a8a904f25a95 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:37.591610 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ca91ae-711e-4e7f-83dd-e57c2d504ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:37.591610 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ca91ae-711e-4e7f-83dd-e57c2d504ba4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:37.591610 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ca91ae-711e-4e7f-83dd-e57c2d504ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:37.591610 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ca91ae-711e-4e7f-83dd-e57c2d504ba4 admin admin] PATH_INFO: `/v3/projects/20419b2121d640749f1eece50db32a81` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:37.592068 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ca91ae-711e-4e7f-83dd-e57c2d504ba4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=20419b2121d640749f1eece50db32a81)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:37.592496 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ca91ae-711e-4e7f-83dd-e57c2d504ba4 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:37.594659 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:37.658810 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-a8ca91ae-711e-4e7f-83dd-e57c2d504ba4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20419b2121d640749f1eece50db32a81', 'request_id': 'req-a8ca91ae-711e-4e7f-83dd-e57c2d504ba4'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:37.665905 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-a8ca91ae-711e-4e7f-83dd-e57c2d504ba4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20419b2121d640749f1eece50db32a81', 'request_id': 'req-a8ca91ae-711e-4e7f-83dd-e57c2d504ba4'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:37.672271 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-a8ca91ae-711e-4e7f-83dd-e57c2d504ba4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20419b2121d640749f1eece50db32a81', 'request_id': 'req-a8ca91ae-711e-4e7f-83dd-e57c2d504ba4'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:37.688124 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-a8ca91ae-711e-4e7f-83dd-e57c2d504ba4 admin admin] The token cache is being invalidate because project 20419b2121d640749f1eece50db32a81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:21:37.688437 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-a8ca91ae-711e-4e7f-83dd-e57c2d504ba4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:37.689091 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-a8ca91ae-711e-4e7f-83dd-e57c2d504ba4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:37.690690 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1201/2391] 10.222.0.43 () {58 vars in 1232 bytes} [Wed Jun 22 10:21:37 2022] DELETE /identity/v3/projects/20419b2121d640749f1eece50db32a81 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:21:37.694653 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7268743c-4c29-4b8c-a5e1-237a0c348acc service neutron] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:37.706326 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7268743c-4c29-4b8c-a5e1-237a0c348acc service neutron] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:37.739876 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:37.779529 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93528537-5652-4a31-a40a-3ab9b5bcc2cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:37.780762 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93528537-5652-4a31-a40a-3ab9b5bcc2cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:37.781131 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93528537-5652-4a31-a40a-3ab9b5bcc2cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:37.781452 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93528537-5652-4a31-a40a-3ab9b5bcc2cf admin admin] PATH_INFO: `/v3/users/5f031d758aed4cabb1287830225b0dbb` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:37.783091 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93528537-5652-4a31-a40a-3ab9b5bcc2cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f031d758aed4cabb1287830225b0dbb)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:37.785779 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93528537-5652-4a31-a40a-3ab9b5bcc2cf admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:37.866694 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-93528537-5652-4a31-a40a-3ab9b5bcc2cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f031d758aed4cabb1287830225b0dbb'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:37.898430 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-93528537-5652-4a31-a40a-3ab9b5bcc2cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f031d758aed4cabb1287830225b0dbb'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:37.907703 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-93528537-5652-4a31-a40a-3ab9b5bcc2cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f031d758aed4cabb1287830225b0dbb'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:37.908432 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-93528537-5652-4a31-a40a-3ab9b5bcc2cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f031d758aed4cabb1287830225b0dbb'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:37.916224 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-93528537-5652-4a31-a40a-3ab9b5bcc2cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f031d758aed4cabb1287830225b0dbb'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:37.926876 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1191/2392] 10.222.0.43 () {58 vars in 1223 bytes} [Wed Jun 22 10:21:37 2022] DELETE /identity/v3/users/5f031d758aed4cabb1287830225b0dbb => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:21:38.291897 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ca91ae-711e-4e7f-83dd-e57c2d504ba4 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:38.294411 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-a8ca91ae-711e-4e7f-83dd-e57c2d504ba4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:38.310961 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ca91ae-711e-4e7f-83dd-e57c2d504ba4 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:38.381491 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8d0fcb-b576-4072-96df-e0da6e63ec29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:38.382409 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8d0fcb-b576-4072-96df-e0da6e63ec29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:38.382699 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8d0fcb-b576-4072-96df-e0da6e63ec29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:38.382976 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8d0fcb-b576-4072-96df-e0da6e63ec29 admin admin] PATH_INFO: `/v3/projects/fbf00ed346114322b68314e5a6aa53df` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:38.384225 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8d0fcb-b576-4072-96df-e0da6e63ec29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbf00ed346114322b68314e5a6aa53df)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:38.386225 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8d0fcb-b576-4072-96df-e0da6e63ec29 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:38.451980 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-7b8d0fcb-b576-4072-96df-e0da6e63ec29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbf00ed346114322b68314e5a6aa53df', 'request_id': 'req-7b8d0fcb-b576-4072-96df-e0da6e63ec29'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:38.460831 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-7b8d0fcb-b576-4072-96df-e0da6e63ec29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbf00ed346114322b68314e5a6aa53df', 'request_id': 'req-7b8d0fcb-b576-4072-96df-e0da6e63ec29'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:38.474477 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-7b8d0fcb-b576-4072-96df-e0da6e63ec29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbf00ed346114322b68314e5a6aa53df', 'request_id': 'req-7b8d0fcb-b576-4072-96df-e0da6e63ec29'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:38.496035 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-7b8d0fcb-b576-4072-96df-e0da6e63ec29 admin admin] The token cache is being invalidate because project fbf00ed346114322b68314e5a6aa53df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:21:38.496722 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-7b8d0fcb-b576-4072-96df-e0da6e63ec29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:38.498179 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-7b8d0fcb-b576-4072-96df-e0da6e63ec29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:38.501785 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1202/2393] 10.222.0.43 () {58 vars in 1232 bytes} [Wed Jun 22 10:21:38 2022] DELETE /identity/v3/projects/fbf00ed346114322b68314e5a6aa53df => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:21:38.506110 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822c81cf-40ed-48f4-b67c-be9e6cc9d8b8 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:38.506416 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822c81cf-40ed-48f4-b67c-be9e6cc9d8b8 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:38.506701 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822c81cf-40ed-48f4-b67c-be9e6cc9d8b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:38.539650 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-822c81cf-40ed-48f4-b67c-be9e6cc9d8b8 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:21:38.553138 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-822c81cf-40ed-48f4-b67c-be9e6cc9d8b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:38.638890 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1192/2394] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:21:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:21:38.647458 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca17e51-8505-48bb-9ffb-bd67a64af25f None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:38.647753 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca17e51-8505-48bb-9ffb-bd67a64af25f None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:38.648119 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca17e51-8505-48bb-9ffb-bd67a64af25f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:38.668452 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-8ca17e51-8505-48bb-9ffb-bd67a64af25f None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:21:38.670455 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-8ca17e51-8505-48bb-9ffb-bd67a64af25f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:38.678837 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1203/2395] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:21:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:21:38.683101 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822c81cf-40ed-48f4-b67c-be9e6cc9d8b8 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:38.694094 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822c81cf-40ed-48f4-b67c-be9e6cc9d8b8 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:38.698837 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0019733-abc1-48c5-b066-2a689a7263aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:38.699555 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0019733-abc1-48c5-b066-2a689a7263aa admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:38.699801 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0019733-abc1-48c5-b066-2a689a7263aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:38.700084 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0019733-abc1-48c5-b066-2a689a7263aa admin admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:38.700864 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0019733-abc1-48c5-b066-2a689a7263aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:21:38.701179 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0019733-abc1-48c5-b066-2a689a7263aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:38.702957 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0019733-abc1-48c5-b066-2a689a7263aa admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:38.720617 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca17e51-8505-48bb-9ffb-bd67a64af25f None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:38.720916 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1193/2396] 10.222.0.43 () {58 vars in 1152 bytes} [Wed Jun 22 10:21:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:21:38.730494 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca17e51-8505-48bb-9ffb-bd67a64af25f None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:38.736161 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fc1a0a-af75-4b02-8b5f-bc33aeb29832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:38.736844 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fc1a0a-af75-4b02-8b5f-bc33aeb29832 admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:38.737134 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fc1a0a-af75-4b02-8b5f-bc33aeb29832 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:38.737416 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fc1a0a-af75-4b02-8b5f-bc33aeb29832 admin admin] PATH_INFO: `/v3/projects` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:38.738156 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fc1a0a-af75-4b02-8b5f-bc33aeb29832 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:38.740131 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fc1a0a-af75-4b02-8b5f-bc33aeb29832 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:38.751922 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:38.775833 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1204/2397] 10.222.0.43 () {60 vars in 1152 bytes} [Wed Jun 22 10:21:38 2022] POST /identity/v3/projects => generated 371 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:21:38.776842 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0019733-abc1-48c5-b066-2a689a7263aa admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:38.788905 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0019733-abc1-48c5-b066-2a689a7263aa admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:38.828636 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:38.878015 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d089d1e-b9de-4483-9fe8-abdf3a65335a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:38.878664 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d089d1e-b9de-4483-9fe8-abdf3a65335a admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:38.878955 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d089d1e-b9de-4483-9fe8-abdf3a65335a admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:38.879237 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d089d1e-b9de-4483-9fe8-abdf3a65335a admin admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:38.879944 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d089d1e-b9de-4483-9fe8-abdf3a65335a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:38.881914 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d089d1e-b9de-4483-9fe8-abdf3a65335a admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:38.919950 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1194/2398] 10.222.0.43 () {60 vars in 1143 bytes} [Wed Jun 22 10:21:38 2022] POST /identity/v3/users => generated 286 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:21:38.924794 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fc1a0a-af75-4b02-8b5f-bc33aeb29832 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:38.937605 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fc1a0a-af75-4b02-8b5f-bc33aeb29832 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:38.944777 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8778d7-e25c-489d-9dc1-daaccc83601f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:38.945542 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8778d7-e25c-489d-9dc1-daaccc83601f admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:38.945950 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8778d7-e25c-489d-9dc1-daaccc83601f admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:38.946242 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8778d7-e25c-489d-9dc1-daaccc83601f admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:38.947141 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8778d7-e25c-489d-9dc1-daaccc83601f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:38.949111 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8778d7-e25c-489d-9dc1-daaccc83601f admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:38.962526 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1205/2399] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:21:38 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:21:38.967590 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d089d1e-b9de-4483-9fe8-abdf3a65335a admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:38.978748 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d089d1e-b9de-4483-9fe8-abdf3a65335a admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:38.984562 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13326873-9013-492b-b598-d4f63f530b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:38.985496 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13326873-9013-492b-b598-d4f63f530b99 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:38.985814 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13326873-9013-492b-b598-d4f63f530b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:38.986093 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13326873-9013-492b-b598-d4f63f530b99 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:38.986916 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13326873-9013-492b-b598-d4f63f530b99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:38.988550 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13326873-9013-492b-b598-d4f63f530b99 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:39.003247 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1195/2400] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:21:38 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:21:39.004446 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8778d7-e25c-489d-9dc1-daaccc83601f admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:39.015315 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8778d7-e25c-489d-9dc1-daaccc83601f admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:39.021029 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4d4133-8525-420f-838d-f553c012012b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:39.022161 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4d4133-8525-420f-838d-f553c012012b admin admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:39.022608 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4d4133-8525-420f-838d-f553c012012b admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:39.023029 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4d4133-8525-420f-838d-f553c012012b admin admin] PATH_INFO: `/v3/projects/ce0b47444e084467abca218c09487f32/users/66dfb838c75d4394856be91b7beffee2/roles/9f88c83743f745a9a785a2f454753f06` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:39.043048 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4d4133-8525-420f-838d-f553c012012b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce0b47444e084467abca218c09487f32, user_id=66dfb838c75d4394856be91b7beffee2, role_id=9f88c83743f745a9a785a2f454753f06)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:39.046840 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4d4133-8525-420f-838d-f553c012012b admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:39.062998 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1206/2401] 10.222.0.43 () {60 vars in 1482 bytes} [Wed Jun 22 10:21:39 2022] PUT /identity/v3/projects/ce0b47444e084467abca218c09487f32/users/66dfb838c75d4394856be91b7beffee2/roles/9f88c83743f745a9a785a2f454753f06 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:21:39.074457 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d59da7-d925-4606-adbd-e7b6d0cba47d None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:39.075085 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d59da7-d925-4606-adbd-e7b6d0cba47d None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:39.075545 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d59da7-d925-4606-adbd-e7b6d0cba47d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:39.121611 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-64d59da7-d925-4606-adbd-e7b6d0cba47d None None] MFA Rules not processed for user `66dfb838c75d4394856be91b7beffee2`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:21:39.122359 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-64d59da7-d925-4606-adbd-e7b6d0cba47d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:39.191359 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1196/2402] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:21:39 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:21:39.203453 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4d4133-8525-420f-838d-f553c012012b admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:39.205134 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-ed4d4133-8525-420f-838d-f553c012012b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:39.266345 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4d4133-8525-420f-838d-f553c012012b admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:39.270019 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cd9ff4-7e20-4284-8fc2-25333630815e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bbcb3d4dc704dfdb0097abc594ca855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:39.270681 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cd9ff4-7e20-4284-8fc2-25333630815e service cinder] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:39.270985 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cd9ff4-7e20-4284-8fc2-25333630815e service cinder] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:39.271249 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cd9ff4-7e20-4284-8fc2-25333630815e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:39.280933 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cd9ff4-7e20-4284-8fc2-25333630815e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:39.282432 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cd9ff4-7e20-4284-8fc2-25333630815e service cinder] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:39.291789 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1207/2403] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:21:39 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:21:39.317940 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d59da7-d925-4606-adbd-e7b6d0cba47d None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:39.403830 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d59da7-d925-4606-adbd-e7b6d0cba47d None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:39.409516 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b57c4b-1ab3-4834-9ef7-f25fc9f92f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:39.410592 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b57c4b-1ab3-4834-9ef7-f25fc9f92f70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:39.411033 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b57c4b-1ab3-4834-9ef7-f25fc9f92f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:39.411417 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b57c4b-1ab3-4834-9ef7-f25fc9f92f70 admin admin] PATH_INFO: `/v3/users/66dfb838c75d4394856be91b7beffee2` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:39.412751 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b57c4b-1ab3-4834-9ef7-f25fc9f92f70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=66dfb838c75d4394856be91b7beffee2)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:39.415086 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b57c4b-1ab3-4834-9ef7-f25fc9f92f70 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:39.479048 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-d5b57c4b-1ab3-4834-9ef7-f25fc9f92f70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66dfb838c75d4394856be91b7beffee2'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:39.480127 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:39.493850 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-d5b57c4b-1ab3-4834-9ef7-f25fc9f92f70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66dfb838c75d4394856be91b7beffee2'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:39.503875 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-d5b57c4b-1ab3-4834-9ef7-f25fc9f92f70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66dfb838c75d4394856be91b7beffee2'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:39.505361 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-d5b57c4b-1ab3-4834-9ef7-f25fc9f92f70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66dfb838c75d4394856be91b7beffee2'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:39.513586 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-d5b57c4b-1ab3-4834-9ef7-f25fc9f92f70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66dfb838c75d4394856be91b7beffee2'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:39.519988 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1197/2404] 10.222.0.43 () {58 vars in 1223 bytes} [Wed Jun 22 10:21:39 2022] DELETE /identity/v3/users/66dfb838c75d4394856be91b7beffee2 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:21:39.524517 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d72082-1955-404e-b900-68b617cf9204 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:39.525044 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d72082-1955-404e-b900-68b617cf9204 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:39.525155 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d72082-1955-404e-b900-68b617cf9204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:39.543289 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-a9d72082-1955-404e-b900-68b617cf9204 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:21:39.544971 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-a9d72082-1955-404e-b900-68b617cf9204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:39.633447 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1208/2405] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:21:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:21:39.645125 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b57c4b-1ab3-4834-9ef7-f25fc9f92f70 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:39.646673 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-d5b57c4b-1ab3-4834-9ef7-f25fc9f92f70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:39.716433 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b57c4b-1ab3-4834-9ef7-f25fc9f92f70 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:39.723735 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1868d4ca-9524-4d48-b132-aa9792dfe82e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe93d4c0737249fd8623bb5ce188e34e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:39.724673 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1868d4ca-9524-4d48-b132-aa9792dfe82e service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:39.725121 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1868d4ca-9524-4d48-b132-aa9792dfe82e service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:39.725551 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1868d4ca-9524-4d48-b132-aa9792dfe82e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:39.736890 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1868d4ca-9524-4d48-b132-aa9792dfe82e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:39.739038 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1868d4ca-9524-4d48-b132-aa9792dfe82e service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:39.750584 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1198/2406] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:21:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 10:21:40.065278 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d72082-1955-404e-b900-68b617cf9204 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:40.067420 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-a9d72082-1955-404e-b900-68b617cf9204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:40.084436 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d72082-1955-404e-b900-68b617cf9204 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:40.091748 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3181c95-90e9-41e1-9c0e-b885d42e1e63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:40.093182 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3181c95-90e9-41e1-9c0e-b885d42e1e63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:40.093839 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3181c95-90e9-41e1-9c0e-b885d42e1e63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:40.094863 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3181c95-90e9-41e1-9c0e-b885d42e1e63 admin admin] PATH_INFO: `/v3/projects/ce0b47444e084467abca218c09487f32` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:40.106174 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3181c95-90e9-41e1-9c0e-b885d42e1e63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce0b47444e084467abca218c09487f32)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:40.108730 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3181c95-90e9-41e1-9c0e-b885d42e1e63 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:40.191877 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-a3181c95-90e9-41e1-9c0e-b885d42e1e63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce0b47444e084467abca218c09487f32', 'request_id': 'req-a3181c95-90e9-41e1-9c0e-b885d42e1e63'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:40.199171 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-a3181c95-90e9-41e1-9c0e-b885d42e1e63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce0b47444e084467abca218c09487f32', 'request_id': 'req-a3181c95-90e9-41e1-9c0e-b885d42e1e63'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:40.200726 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:40.211920 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-a3181c95-90e9-41e1-9c0e-b885d42e1e63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce0b47444e084467abca218c09487f32', 'request_id': 'req-a3181c95-90e9-41e1-9c0e-b885d42e1e63'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:40.271547 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-a3181c95-90e9-41e1-9c0e-b885d42e1e63 admin admin] The token cache is being invalidate because project ce0b47444e084467abca218c09487f32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:21:40.271844 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-a3181c95-90e9-41e1-9c0e-b885d42e1e63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:40.272432 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-a3181c95-90e9-41e1-9c0e-b885d42e1e63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:21:40.274352 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1209/2407] 10.222.0.43 () {58 vars in 1232 bytes} [Wed Jun 22 10:21:40 2022] DELETE /identity/v3/projects/ce0b47444e084467abca218c09487f32 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:21:46.183911 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1868d4ca-9524-4d48-b132-aa9792dfe82e service neutron] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:46.185465 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-1868d4ca-9524-4d48-b132-aa9792dfe82e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:46.284538 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1868d4ca-9524-4d48-b132-aa9792dfe82e service neutron] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:46.353232 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:46.362273 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405dd298-9fd1-4163-8679-49d33995c4ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '158a49aa3750478a84bf71b9aad24397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:46.362908 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405dd298-9fd1-4163-8679-49d33995c4ec service nova] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:46.363364 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405dd298-9fd1-4163-8679-49d33995c4ec service nova] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:46.363876 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405dd298-9fd1-4163-8679-49d33995c4ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:46.365833 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-405dd298-9fd1-4163-8679-49d33995c4ec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:46.426476 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405dd298-9fd1-4163-8679-49d33995c4ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:46.428107 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405dd298-9fd1-4163-8679-49d33995c4ec service nova] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:46.437910 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1199/2408] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:21:46 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:21:49.364823 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efa9cb0-593f-41e9-b567-58233d1c62bc None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:49.365378 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efa9cb0-593f-41e9-b567-58233d1c62bc None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:49.365378 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efa9cb0-593f-41e9-b567-58233d1c62bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:49.383909 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-2efa9cb0-593f-41e9-b567-58233d1c62bc None None] MFA Rules not processed for user `317e7e7dd5c741d49d34a1fd949a7c07`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:21:49.385148 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-2efa9cb0-593f-41e9-b567-58233d1c62bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:49.450096 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1210/2409] 10.222.0.43 () {58 vars in 967 bytes} [Wed Jun 22 10:21:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:21:49.462453 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405dd298-9fd1-4163-8679-49d33995c4ec service nova] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:21:49.463865 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-405dd298-9fd1-4163-8679-49d33995c4ec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:21:49.535106 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405dd298-9fd1-4163-8679-49d33995c4ec service nova] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:21:49.540108 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db163382-35f7-45cd-b5fe-c10ae4361661 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9566f8cca2574f4cb5edcbf384f368a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:21:49.540762 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db163382-35f7-45cd-b5fe-c10ae4361661 service swift] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:21:49.541047 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db163382-35f7-45cd-b5fe-c10ae4361661 service swift] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:21:49.541326 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db163382-35f7-45cd-b5fe-c10ae4361661 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:21:49.550231 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db163382-35f7-45cd-b5fe-c10ae4361661 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:21:49.551830 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db163382-35f7-45cd-b5fe-c10ae4361661 service swift] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:21:49.560805 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1200/2410] 10.222.0.43 () {60 vars in 1384 bytes} [Wed Jun 22 10:21:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 22 10:21:59.440534 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:DELETE=3,keystone:SELECT=29,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:59.557006 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=58 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:22:00.714044 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efa9cb0-593f-41e9-b567-58233d1c62bc None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:00.715921 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-2efa9cb0-593f-41e9-b567-58233d1c62bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:00.736198 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efa9cb0-593f-41e9-b567-58233d1c62bc None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:00.743097 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07d83d6-d4e6-420c-aa71-308659fec22c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '158a49aa3750478a84bf71b9aad24397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:00.743826 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07d83d6-d4e6-420c-aa71-308659fec22c service nova] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:00.744250 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07d83d6-d4e6-420c-aa71-308659fec22c service nova] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:00.744365 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07d83d6-d4e6-420c-aa71-308659fec22c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:00.746371 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-d07d83d6-d4e6-420c-aa71-308659fec22c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:00.784341 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07d83d6-d4e6-420c-aa71-308659fec22c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:00.785807 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07d83d6-d4e6-420c-aa71-308659fec22c service nova] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:00.808241 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1211/2411] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:22:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:22:06.148747 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db163382-35f7-45cd-b5fe-c10ae4361661 service swift] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:06.150225 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-db163382-35f7-45cd-b5fe-c10ae4361661 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:06.212470 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db163382-35f7-45cd-b5fe-c10ae4361661 service swift] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:06.216334 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac70c469-d3f5-4e27-a893-589df58d74e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe93d4c0737249fd8623bb5ce188e34e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:06.217003 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac70c469-d3f5-4e27-a893-589df58d74e5 service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:06.217265 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac70c469-d3f5-4e27-a893-589df58d74e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:06.217587 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac70c469-d3f5-4e27-a893-589df58d74e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:06.219706 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-ac70c469-d3f5-4e27-a893-589df58d74e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:06.287565 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac70c469-d3f5-4e27-a893-589df58d74e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:06.289016 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac70c469-d3f5-4e27-a893-589df58d74e5 service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:06.300260 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1201/2412] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:22:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:22:09.470246 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07d83d6-d4e6-420c-aa71-308659fec22c service nova] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:09.472894 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-d07d83d6-d4e6-420c-aa71-308659fec22c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:09.540072 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac70c469-d3f5-4e27-a893-589df58d74e5 service neutron] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:09.541633 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-ac70c469-d3f5-4e27-a893-589df58d74e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:09.560289 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07d83d6-d4e6-420c-aa71-308659fec22c service nova] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:09.563697 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac70c469-d3f5-4e27-a893-589df58d74e5 service neutron] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:09.566417 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6311ced9-cb64-41d7-840e-0c29df4c40a9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '341ec95408c94dae8539ccff7225e3ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:09.567076 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6311ced9-cb64-41d7-840e-0c29df4c40a9 service placement] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:09.567360 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6311ced9-cb64-41d7-840e-0c29df4c40a9 service placement] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:09.567639 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6311ced9-cb64-41d7-840e-0c29df4c40a9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:09.568917 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea918901-fbd5-40b2-9839-922ed10c630a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:09.569371 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-6311ced9-cb64-41d7-840e-0c29df4c40a9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:09.570035 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea918901-fbd5-40b2-9839-922ed10c630a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:09.570526 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea918901-fbd5-40b2-9839-922ed10c630a admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:09.570993 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea918901-fbd5-40b2-9839-922ed10c630a admin admin] PATH_INFO: `/v3/users/7be3d844dcee4d19966fc7944463a0bc` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:09.572199 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea918901-fbd5-40b2-9839-922ed10c630a admin admin] RBAC: Authorizing `identity:delete_user(user_id=7be3d844dcee4d19966fc7944463a0bc)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:09.574219 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea918901-fbd5-40b2-9839-922ed10c630a admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:09.582303 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6311ced9-cb64-41d7-840e-0c29df4c40a9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:09.583887 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6311ced9-cb64-41d7-840e-0c29df4c40a9 service placement] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:09.594263 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1212/2413] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:22:09 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:22:09.622444 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-ea918901-fbd5-40b2-9839-922ed10c630a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7be3d844dcee4d19966fc7944463a0bc'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:09.635446 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-ea918901-fbd5-40b2-9839-922ed10c630a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7be3d844dcee4d19966fc7944463a0bc'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:09.642516 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-ea918901-fbd5-40b2-9839-922ed10c630a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7be3d844dcee4d19966fc7944463a0bc'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:09.643122 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-ea918901-fbd5-40b2-9839-922ed10c630a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7be3d844dcee4d19966fc7944463a0bc'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:09.650237 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-ea918901-fbd5-40b2-9839-922ed10c630a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7be3d844dcee4d19966fc7944463a0bc'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:09.657887 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1202/2414] 10.222.0.43 () {58 vars in 1223 bytes} [Wed Jun 22 10:22:09 2022] DELETE /identity/v3/users/7be3d844dcee4d19966fc7944463a0bc => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:22:09.842849 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6311ced9-cb64-41d7-840e-0c29df4c40a9 service placement] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:09.853876 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6311ced9-cb64-41d7-840e-0c29df4c40a9 service placement] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:09.913411 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85eb05b5-c930-4330-b989-3a315533f8df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:09.914324 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eb05b5-c930-4330-b989-3a315533f8df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:09.914614 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eb05b5-c930-4330-b989-3a315533f8df admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:09.914895 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eb05b5-c930-4330-b989-3a315533f8df admin admin] PATH_INFO: `/v3/projects/78629282e2b74418a2c1cdac32576ef1` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:09.916077 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85eb05b5-c930-4330-b989-3a315533f8df admin admin] RBAC: Authorizing `identity:delete_project(project_id=78629282e2b74418a2c1cdac32576ef1)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:09.918044 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85eb05b5-c930-4330-b989-3a315533f8df admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:09.964748 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-85eb05b5-c930-4330-b989-3a315533f8df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78629282e2b74418a2c1cdac32576ef1', 'request_id': 'req-85eb05b5-c930-4330-b989-3a315533f8df'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:09.970985 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-85eb05b5-c930-4330-b989-3a315533f8df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78629282e2b74418a2c1cdac32576ef1', 'request_id': 'req-85eb05b5-c930-4330-b989-3a315533f8df'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:09.976387 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-85eb05b5-c930-4330-b989-3a315533f8df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78629282e2b74418a2c1cdac32576ef1', 'request_id': 'req-85eb05b5-c930-4330-b989-3a315533f8df'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:09.989873 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-85eb05b5-c930-4330-b989-3a315533f8df admin admin] The token cache is being invalidate because project 78629282e2b74418a2c1cdac32576ef1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:22:09.990158 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-85eb05b5-c930-4330-b989-3a315533f8df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:09.990887 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-85eb05b5-c930-4330-b989-3a315533f8df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:09.992473 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1213/2415] 10.222.0.43 () {58 vars in 1232 bytes} [Wed Jun 22 10:22:09 2022] DELETE /identity/v3/projects/78629282e2b74418a2c1cdac32576ef1 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:22:09.997390 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dda422-5065-4840-ba4f-9a224a349d7c None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:09.997707 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dda422-5065-4840-ba4f-9a224a349d7c None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:09.997998 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dda422-5065-4840-ba4f-9a224a349d7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:10.017891 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-39dda422-5065-4840-ba4f-9a224a349d7c None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:22:10.019092 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-39dda422-5065-4840-ba4f-9a224a349d7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:10.036418 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:22:10.081681 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1203/2416] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:22:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:22:10.089809 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a10f5b9-946a-4e1a-a667-96c16baa3e85 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:10.090104 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a10f5b9-946a-4e1a-a667-96c16baa3e85 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:10.090382 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a10f5b9-946a-4e1a-a667-96c16baa3e85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:10.103711 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:22:10.110773 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-3a10f5b9-946a-4e1a-a667-96c16baa3e85 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:22:10.113141 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-3a10f5b9-946a-4e1a-a667-96c16baa3e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:10.122797 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1214/2417] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:22:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:22:10.127858 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dda422-5065-4840-ba4f-9a224a349d7c None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:10.137463 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dda422-5065-4840-ba4f-9a224a349d7c None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:10.142637 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40edd45-f52f-42f0-a9ac-5e2a23ee7752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:10.143296 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40edd45-f52f-42f0-a9ac-5e2a23ee7752 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:10.143585 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40edd45-f52f-42f0-a9ac-5e2a23ee7752 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:10.143879 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40edd45-f52f-42f0-a9ac-5e2a23ee7752 admin admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:10.144732 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40edd45-f52f-42f0-a9ac-5e2a23ee7752 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:22:10.145050 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40edd45-f52f-42f0-a9ac-5e2a23ee7752 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:10.146684 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40edd45-f52f-42f0-a9ac-5e2a23ee7752 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:10.162239 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1204/2418] 10.222.0.43 () {58 vars in 1152 bytes} [Wed Jun 22 10:22:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:22:10.163805 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a10f5b9-946a-4e1a-a667-96c16baa3e85 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:10.173905 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a10f5b9-946a-4e1a-a667-96c16baa3e85 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:10.178668 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f441ed47-e2aa-4a9e-bf8d-3526ed556815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:10.179260 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f441ed47-e2aa-4a9e-bf8d-3526ed556815 admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:10.179545 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f441ed47-e2aa-4a9e-bf8d-3526ed556815 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:10.179848 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f441ed47-e2aa-4a9e-bf8d-3526ed556815 admin admin] PATH_INFO: `/v3/projects` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:10.180540 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f441ed47-e2aa-4a9e-bf8d-3526ed556815 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:10.182463 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f441ed47-e2aa-4a9e-bf8d-3526ed556815 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:10.220489 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1215/2419] 10.222.0.43 () {60 vars in 1152 bytes} [Wed Jun 22 10:22:10 2022] POST /identity/v3/projects => generated 365 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:22:10.224864 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40edd45-f52f-42f0-a9ac-5e2a23ee7752 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:10.236163 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40edd45-f52f-42f0-a9ac-5e2a23ee7752 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:10.297434 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38a5cde-7ec5-44ae-b5f3-0072d1912c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:10.298169 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38a5cde-7ec5-44ae-b5f3-0072d1912c4f admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:10.298456 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38a5cde-7ec5-44ae-b5f3-0072d1912c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:10.298739 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38a5cde-7ec5-44ae-b5f3-0072d1912c4f admin admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:10.299429 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38a5cde-7ec5-44ae-b5f3-0072d1912c4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:10.301351 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38a5cde-7ec5-44ae-b5f3-0072d1912c4f admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:10.327524 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1205/2420] 10.222.0.43 () {60 vars in 1143 bytes} [Wed Jun 22 10:22:10 2022] POST /identity/v3/users => generated 283 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:22:10.328709 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f441ed47-e2aa-4a9e-bf8d-3526ed556815 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:10.339526 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f441ed47-e2aa-4a9e-bf8d-3526ed556815 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:10.344610 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80040afe-9772-4021-bc44-d66ff5693669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:10.345271 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80040afe-9772-4021-bc44-d66ff5693669 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:10.345555 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80040afe-9772-4021-bc44-d66ff5693669 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:10.345860 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80040afe-9772-4021-bc44-d66ff5693669 admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:10.346635 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80040afe-9772-4021-bc44-d66ff5693669 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:10.348318 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80040afe-9772-4021-bc44-d66ff5693669 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:10.362854 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1216/2421] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:22:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:22:10.364360 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38a5cde-7ec5-44ae-b5f3-0072d1912c4f admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:10.375462 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38a5cde-7ec5-44ae-b5f3-0072d1912c4f admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:10.380350 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33701d82-6331-476d-9257-303d75d4361f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:10.381082 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33701d82-6331-476d-9257-303d75d4361f admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:10.381431 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33701d82-6331-476d-9257-303d75d4361f admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:10.381831 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33701d82-6331-476d-9257-303d75d4361f admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:10.382635 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33701d82-6331-476d-9257-303d75d4361f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:10.384282 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33701d82-6331-476d-9257-303d75d4361f admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:10.395272 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1206/2422] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:22:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 10:22:10.400337 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80040afe-9772-4021-bc44-d66ff5693669 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:10.411641 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80040afe-9772-4021-bc44-d66ff5693669 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:10.416451 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8968078c-794b-4292-96ff-874f674c9231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:10.417326 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8968078c-794b-4292-96ff-874f674c9231 admin admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:10.417609 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8968078c-794b-4292-96ff-874f674c9231 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:10.417915 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8968078c-794b-4292-96ff-874f674c9231 admin admin] PATH_INFO: `/v3/projects/4f6800c2e0944924a9768cd4dfffac14/users/0ca73352d15d4380a8cae8a0cd627287/roles/9f88c83743f745a9a785a2f454753f06` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:10.433512 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8968078c-794b-4292-96ff-874f674c9231 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f6800c2e0944924a9768cd4dfffac14, user_id=0ca73352d15d4380a8cae8a0cd627287, role_id=9f88c83743f745a9a785a2f454753f06)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:10.436303 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8968078c-794b-4292-96ff-874f674c9231 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:10.451862 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1217/2423] 10.222.0.43 () {60 vars in 1482 bytes} [Wed Jun 22 10:22:10 2022] PUT /identity/v3/projects/4f6800c2e0944924a9768cd4dfffac14/users/0ca73352d15d4380a8cae8a0cd627287/roles/9f88c83743f745a9a785a2f454753f06 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:22:10.461929 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc42734-52a1-4fe7-aa1a-1f1c277f6aaf None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:10.462224 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc42734-52a1-4fe7-aa1a-1f1c277f6aaf None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:10.462508 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc42734-52a1-4fe7-aa1a-1f1c277f6aaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:10.491595 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-9bc42734-52a1-4fe7-aa1a-1f1c277f6aaf None None] MFA Rules not processed for user `0ca73352d15d4380a8cae8a0cd627287`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:22:10.492881 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-9bc42734-52a1-4fe7-aa1a-1f1c277f6aaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:10.570679 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1207/2424] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:22:10 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:22:10.575085 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8968078c-794b-4292-96ff-874f674c9231 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:10.654247 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8968078c-794b-4292-96ff-874f674c9231 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:10.660365 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19547def-b097-4e64-bfd6-3a001ce4d27b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:10.661108 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19547def-b097-4e64-bfd6-3a001ce4d27b admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:10.661392 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19547def-b097-4e64-bfd6-3a001ce4d27b admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:10.661666 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19547def-b097-4e64-bfd6-3a001ce4d27b admin admin] PATH_INFO: `/v3/projects` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:10.662378 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19547def-b097-4e64-bfd6-3a001ce4d27b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:10.664278 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19547def-b097-4e64-bfd6-3a001ce4d27b admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:10.713723 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1218/2425] 10.222.0.43 () {60 vars in 1152 bytes} [Wed Jun 22 10:22:10 2022] POST /identity/v3/projects => generated 363 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:22:10.717774 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc42734-52a1-4fe7-aa1a-1f1c277f6aaf None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:10.729184 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc42734-52a1-4fe7-aa1a-1f1c277f6aaf None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:10.746724 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:22:10.801984 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1641d1d3-a6c0-45a9-b276-f2bcf7899157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:10.802672 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1641d1d3-a6c0-45a9-b276-f2bcf7899157 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:10.802953 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1641d1d3-a6c0-45a9-b276-f2bcf7899157 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:10.803228 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1641d1d3-a6c0-45a9-b276-f2bcf7899157 admin admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:10.804015 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1641d1d3-a6c0-45a9-b276-f2bcf7899157 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:10.806032 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1641d1d3-a6c0-45a9-b276-f2bcf7899157 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:10.829743 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1208/2426] 10.222.0.43 () {60 vars in 1143 bytes} [Wed Jun 22 10:22:10 2022] POST /identity/v3/users => generated 288 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:22:10.832792 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19547def-b097-4e64-bfd6-3a001ce4d27b admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:10.843637 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19547def-b097-4e64-bfd6-3a001ce4d27b admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:10.848321 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd157c5-77d6-4431-abac-0323fcd92fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:10.849039 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd157c5-77d6-4431-abac-0323fcd92fe6 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:10.849273 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd157c5-77d6-4431-abac-0323fcd92fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:10.849552 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd157c5-77d6-4431-abac-0323fcd92fe6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:10.850320 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd157c5-77d6-4431-abac-0323fcd92fe6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:10.852179 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd157c5-77d6-4431-abac-0323fcd92fe6 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:10.864442 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1219/2427] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:22:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:22:10.868665 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1641d1d3-a6c0-45a9-b276-f2bcf7899157 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:10.879865 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1641d1d3-a6c0-45a9-b276-f2bcf7899157 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:10.884611 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3d5d17-b18a-45cd-8006-8f35e7294527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:10.885505 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3d5d17-b18a-45cd-8006-8f35e7294527 admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:10.885815 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3d5d17-b18a-45cd-8006-8f35e7294527 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:10.886090 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3d5d17-b18a-45cd-8006-8f35e7294527 admin admin] PATH_INFO: `/v3/projects/c9cdd69966bb434fa52b449f1004bebe/users/2ae7dd4c392a48859bce80480466c882/roles/26d9c2ab5dfc4e6d9ca80c6014123906` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:10.901318 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3d5d17-b18a-45cd-8006-8f35e7294527 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9cdd69966bb434fa52b449f1004bebe, user_id=2ae7dd4c392a48859bce80480466c882, role_id=26d9c2ab5dfc4e6d9ca80c6014123906)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:10.903996 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3d5d17-b18a-45cd-8006-8f35e7294527 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:10.917798 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1209/2428] 10.222.0.43 () {60 vars in 1482 bytes} [Wed Jun 22 10:22:10 2022] PUT /identity/v3/projects/c9cdd69966bb434fa52b449f1004bebe/users/2ae7dd4c392a48859bce80480466c882/roles/26d9c2ab5dfc4e6d9ca80c6014123906 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:22:10.922860 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd157c5-77d6-4431-abac-0323fcd92fe6 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:10.932848 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd157c5-77d6-4431-abac-0323fcd92fe6 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:10.992932 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59584f21-ac9f-4fa0-a663-5a61a63ba16f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:10.993630 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59584f21-ac9f-4fa0-a663-5a61a63ba16f admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:10.993945 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59584f21-ac9f-4fa0-a663-5a61a63ba16f admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:10.994230 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59584f21-ac9f-4fa0-a663-5a61a63ba16f admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:10.994954 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59584f21-ac9f-4fa0-a663-5a61a63ba16f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:10.996557 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59584f21-ac9f-4fa0-a663-5a61a63ba16f admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:11.007905 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1220/2429] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:22:10 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:22:11.012185 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3d5d17-b18a-45cd-8006-8f35e7294527 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:11.023000 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3d5d17-b18a-45cd-8006-8f35e7294527 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:11.027604 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50f64ad-a688-4ae0-ad2b-c48622b877c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:11.028546 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50f64ad-a688-4ae0-ad2b-c48622b877c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:11.028800 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50f64ad-a688-4ae0-ad2b-c48622b877c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:11.029079 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50f64ad-a688-4ae0-ad2b-c48622b877c0 admin admin] PATH_INFO: `/v3/projects/c9cdd69966bb434fa52b449f1004bebe/users/2ae7dd4c392a48859bce80480466c882/roles/26d9c2ab5dfc4e6d9ca80c6014123906` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:11.031582 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50f64ad-a688-4ae0-ad2b-c48622b877c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9cdd69966bb434fa52b449f1004bebe, user_id=2ae7dd4c392a48859bce80480466c882, role_id=26d9c2ab5dfc4e6d9ca80c6014123906)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:11.034269 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50f64ad-a688-4ae0-ad2b-c48622b877c0 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:11.044545 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1210/2430] 10.222.0.43 () {60 vars in 1482 bytes} [Wed Jun 22 10:22:11 2022] PUT /identity/v3/projects/c9cdd69966bb434fa52b449f1004bebe/users/2ae7dd4c392a48859bce80480466c882/roles/26d9c2ab5dfc4e6d9ca80c6014123906 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:22:11.056480 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d290c08b-9789-4be3-abb3-e17f5e9a082b None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:11.056802 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d290c08b-9789-4be3-abb3-e17f5e9a082b None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:11.057112 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d290c08b-9789-4be3-abb3-e17f5e9a082b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:11.064486 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:22:11.084691 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-d290c08b-9789-4be3-abb3-e17f5e9a082b None None] MFA Rules not processed for user `2ae7dd4c392a48859bce80480466c882`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:22:11.085930 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-d290c08b-9789-4be3-abb3-e17f5e9a082b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:11.153202 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1221/2431] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:22:11 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:22:11.165339 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50f64ad-a688-4ae0-ad2b-c48622b877c0 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:11.167064 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-a50f64ad-a688-4ae0-ad2b-c48622b877c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:11.224263 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50f64ad-a688-4ae0-ad2b-c48622b877c0 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:11.228228 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b336859c-0b61-4952-817c-8122d3f1d72e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bbcb3d4dc704dfdb0097abc594ca855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:11.228875 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b336859c-0b61-4952-817c-8122d3f1d72e service cinder] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:11.229169 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b336859c-0b61-4952-817c-8122d3f1d72e service cinder] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:11.229443 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b336859c-0b61-4952-817c-8122d3f1d72e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:11.239750 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b336859c-0b61-4952-817c-8122d3f1d72e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:11.241167 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b336859c-0b61-4952-817c-8122d3f1d72e service cinder] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:11.250640 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1211/2432] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:22:11 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:22:11.320011 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d290c08b-9789-4be3-abb3-e17f5e9a082b None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:11.329892 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d290c08b-9789-4be3-abb3-e17f5e9a082b None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:11.333495 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16f6a18-ef28-4d46-a41c-e088c11e7890 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bbcb3d4dc704dfdb0097abc594ca855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:11.334173 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16f6a18-ef28-4d46-a41c-e088c11e7890 service cinder] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:11.334460 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16f6a18-ef28-4d46-a41c-e088c11e7890 service cinder] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:11.334744 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16f6a18-ef28-4d46-a41c-e088c11e7890 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:11.397272 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16f6a18-ef28-4d46-a41c-e088c11e7890 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:11.398665 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16f6a18-ef28-4d46-a41c-e088c11e7890 service cinder] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:11.408213 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1222/2433] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:22:11 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:22:20.484998 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b336859c-0b61-4952-817c-8122d3f1d72e service cinder] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:20.486373 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-b336859c-0b61-4952-817c-8122d3f1d72e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:20.553898 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b336859c-0b61-4952-817c-8122d3f1d72e service cinder] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:20.557795 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34acf83-dd53-446a-9b26-071b53347253 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe93d4c0737249fd8623bb5ce188e34e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:20.558459 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34acf83-dd53-446a-9b26-071b53347253 service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:20.558746 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34acf83-dd53-446a-9b26-071b53347253 service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:20.559026 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34acf83-dd53-446a-9b26-071b53347253 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:20.560819 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-d34acf83-dd53-446a-9b26-071b53347253 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:20.592318 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:22:20.631529 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34acf83-dd53-446a-9b26-071b53347253 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:20.632974 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34acf83-dd53-446a-9b26-071b53347253 service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:20.642582 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16f6a18-ef28-4d46-a41c-e088c11e7890 service cinder] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:20.646183 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1212/2434] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:22:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:22:20.653564 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16f6a18-ef28-4d46-a41c-e088c11e7890 service cinder] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:20.659697 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d68e8ea-1030-430b-a144-e49d5d8fd51f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:20.660607 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d68e8ea-1030-430b-a144-e49d5d8fd51f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:20.660934 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d68e8ea-1030-430b-a144-e49d5d8fd51f admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:20.661215 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d68e8ea-1030-430b-a144-e49d5d8fd51f admin admin] PATH_INFO: `/v3/users/0ca73352d15d4380a8cae8a0cd627287` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:20.662419 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d68e8ea-1030-430b-a144-e49d5d8fd51f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ca73352d15d4380a8cae8a0cd627287)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:20.664366 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d68e8ea-1030-430b-a144-e49d5d8fd51f admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:20.712838 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-0d68e8ea-1030-430b-a144-e49d5d8fd51f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ca73352d15d4380a8cae8a0cd627287'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:20.726997 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-0d68e8ea-1030-430b-a144-e49d5d8fd51f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ca73352d15d4380a8cae8a0cd627287'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:20.734854 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-0d68e8ea-1030-430b-a144-e49d5d8fd51f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ca73352d15d4380a8cae8a0cd627287'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:20.742522 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-0d68e8ea-1030-430b-a144-e49d5d8fd51f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ca73352d15d4380a8cae8a0cd627287'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:20.743187 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-0d68e8ea-1030-430b-a144-e49d5d8fd51f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ca73352d15d4380a8cae8a0cd627287'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:20.745307 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:22:20.751137 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1223/2435] 10.222.0.43 () {58 vars in 1223 bytes} [Wed Jun 22 10:22:20 2022] DELETE /identity/v3/users/0ca73352d15d4380a8cae8a0cd627287 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:22:20.755761 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a26e76-fc26-4242-b4e8-48023183553b None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:20.756056 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a26e76-fc26-4242-b4e8-48023183553b None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:20.756393 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a26e76-fc26-4242-b4e8-48023183553b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:20.774809 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-a3a26e76-fc26-4242-b4e8-48023183553b None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:22:20.776141 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-a3a26e76-fc26-4242-b4e8-48023183553b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:20.835974 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1213/2436] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:22:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:22:20.847248 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d68e8ea-1030-430b-a144-e49d5d8fd51f admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:20.848346 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-0d68e8ea-1030-430b-a144-e49d5d8fd51f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:20.909515 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d68e8ea-1030-430b-a144-e49d5d8fd51f admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:20.913829 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6152bc7d-9eb8-4b21-90ce-e9a457df1583 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe93d4c0737249fd8623bb5ce188e34e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:20.914486 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6152bc7d-9eb8-4b21-90ce-e9a457df1583 service neutron] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:20.914769 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6152bc7d-9eb8-4b21-90ce-e9a457df1583 service neutron] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:20.915047 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6152bc7d-9eb8-4b21-90ce-e9a457df1583 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:20.925239 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6152bc7d-9eb8-4b21-90ce-e9a457df1583 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:20.926728 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6152bc7d-9eb8-4b21-90ce-e9a457df1583 service neutron] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:20.936519 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1224/2437] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:22:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:22:21.224054 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a26e76-fc26-4242-b4e8-48023183553b None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:21.226188 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-a3a26e76-fc26-4242-b4e8-48023183553b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:21.239192 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a26e76-fc26-4242-b4e8-48023183553b None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:21.244382 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9ffa90-5425-4c35-9962-052276d31ce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:21.245440 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9ffa90-5425-4c35-9962-052276d31ce3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:21.246047 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9ffa90-5425-4c35-9962-052276d31ce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:21.246524 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9ffa90-5425-4c35-9962-052276d31ce3 admin admin] PATH_INFO: `/v3/projects/4f6800c2e0944924a9768cd4dfffac14` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:21.247998 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9ffa90-5425-4c35-9962-052276d31ce3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f6800c2e0944924a9768cd4dfffac14)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:21.251891 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9ffa90-5425-4c35-9962-052276d31ce3 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:21.303930 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-ed9ffa90-5425-4c35-9962-052276d31ce3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f6800c2e0944924a9768cd4dfffac14', 'request_id': 'req-ed9ffa90-5425-4c35-9962-052276d31ce3'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:21.309870 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-ed9ffa90-5425-4c35-9962-052276d31ce3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f6800c2e0944924a9768cd4dfffac14', 'request_id': 'req-ed9ffa90-5425-4c35-9962-052276d31ce3'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:21.318011 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-ed9ffa90-5425-4c35-9962-052276d31ce3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f6800c2e0944924a9768cd4dfffac14', 'request_id': 'req-ed9ffa90-5425-4c35-9962-052276d31ce3'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:21.329251 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-ed9ffa90-5425-4c35-9962-052276d31ce3 admin admin] The token cache is being invalidate because project 4f6800c2e0944924a9768cd4dfffac14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:22:21.329543 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-ed9ffa90-5425-4c35-9962-052276d31ce3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:21.330209 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-ed9ffa90-5425-4c35-9962-052276d31ce3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:21.331764 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1214/2438] 10.222.0.43 () {58 vars in 1232 bytes} [Wed Jun 22 10:22:21 2022] DELETE /identity/v3/projects/4f6800c2e0944924a9768cd4dfffac14 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:22:21.335634 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6152bc7d-9eb8-4b21-90ce-e9a457df1583 service neutron] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:21.345438 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6152bc7d-9eb8-4b21-90ce-e9a457df1583 service neutron] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:21.402310 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e3e405-5077-425d-aa67-c252b17d70a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:21.403182 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e3e405-5077-425d-aa67-c252b17d70a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:21.403469 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e3e405-5077-425d-aa67-c252b17d70a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:21.403744 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e3e405-5077-425d-aa67-c252b17d70a3 admin admin] PATH_INFO: `/v3/users/2ae7dd4c392a48859bce80480466c882` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:21.404925 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e3e405-5077-425d-aa67-c252b17d70a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ae7dd4c392a48859bce80480466c882)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:21.407169 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e3e405-5077-425d-aa67-c252b17d70a3 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:21.459544 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-b2e3e405-5077-425d-aa67-c252b17d70a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ae7dd4c392a48859bce80480466c882'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:21.472957 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-b2e3e405-5077-425d-aa67-c252b17d70a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ae7dd4c392a48859bce80480466c882'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:21.481843 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-b2e3e405-5077-425d-aa67-c252b17d70a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ae7dd4c392a48859bce80480466c882'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:21.489151 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-b2e3e405-5077-425d-aa67-c252b17d70a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ae7dd4c392a48859bce80480466c882'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:21.490012 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-b2e3e405-5077-425d-aa67-c252b17d70a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ae7dd4c392a48859bce80480466c882'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:21.496983 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1225/2439] 10.222.0.43 () {58 vars in 1223 bytes} [Wed Jun 22 10:22:21 2022] DELETE /identity/v3/users/2ae7dd4c392a48859bce80480466c882 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:22:21.986345 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9ffa90-5425-4c35-9962-052276d31ce3 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:21.988229 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-ed9ffa90-5425-4c35-9962-052276d31ce3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:22.020203 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9ffa90-5425-4c35-9962-052276d31ce3 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:22.075391 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:22:22.095847 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410b2f3d-fa64-4647-91d9-400f5fb703c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:22.096802 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410b2f3d-fa64-4647-91d9-400f5fb703c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:22.097092 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410b2f3d-fa64-4647-91d9-400f5fb703c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:22.097379 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410b2f3d-fa64-4647-91d9-400f5fb703c3 admin admin] PATH_INFO: `/v3/projects/c9cdd69966bb434fa52b449f1004bebe` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:22.098664 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410b2f3d-fa64-4647-91d9-400f5fb703c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9cdd69966bb434fa52b449f1004bebe)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:22.102236 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410b2f3d-fa64-4647-91d9-400f5fb703c3 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:22.151408 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-410b2f3d-fa64-4647-91d9-400f5fb703c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9cdd69966bb434fa52b449f1004bebe', 'request_id': 'req-410b2f3d-fa64-4647-91d9-400f5fb703c3'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:22.158112 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-410b2f3d-fa64-4647-91d9-400f5fb703c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9cdd69966bb434fa52b449f1004bebe', 'request_id': 'req-410b2f3d-fa64-4647-91d9-400f5fb703c3'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:22.166259 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-410b2f3d-fa64-4647-91d9-400f5fb703c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9cdd69966bb434fa52b449f1004bebe', 'request_id': 'req-410b2f3d-fa64-4647-91d9-400f5fb703c3'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:22.178521 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-410b2f3d-fa64-4647-91d9-400f5fb703c3 admin admin] The token cache is being invalidate because project c9cdd69966bb434fa52b449f1004bebe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:22:22.178810 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-410b2f3d-fa64-4647-91d9-400f5fb703c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:22.179569 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-410b2f3d-fa64-4647-91d9-400f5fb703c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:22.181195 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1215/2440] 10.222.0.43 () {58 vars in 1232 bytes} [Wed Jun 22 10:22:21 2022] DELETE /identity/v3/projects/c9cdd69966bb434fa52b449f1004bebe => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:22:22.186279 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9bc3ad-4e3d-4808-abf8-9700783728b1 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:22.186800 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9bc3ad-4e3d-4808-abf8-9700783728b1 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:22.187456 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9bc3ad-4e3d-4808-abf8-9700783728b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:22.207375 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-fa9bc3ad-4e3d-4808-abf8-9700783728b1 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:22:22.208597 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-fa9bc3ad-4e3d-4808-abf8-9700783728b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:22.229225 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:22:22.284465 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1226/2441] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:22:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:22:22.286335 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a1b3fa-2aca-4b1c-8780-4327c53478ef None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:22.286625 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a1b3fa-2aca-4b1c-8780-4327c53478ef None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:22.286906 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a1b3fa-2aca-4b1c-8780-4327c53478ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:22.305889 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-97a1b3fa-2aca-4b1c-8780-4327c53478ef None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:22:22.307104 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-97a1b3fa-2aca-4b1c-8780-4327c53478ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:22.315678 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1216/2442] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:22:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:22:22.320044 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9bc3ad-4e3d-4808-abf8-9700783728b1 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:22.330940 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9bc3ad-4e3d-4808-abf8-9700783728b1 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:22.335634 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b011b5a-1df8-4f22-8774-93265565d3bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:22.336401 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b011b5a-1df8-4f22-8774-93265565d3bf admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:22.336781 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b011b5a-1df8-4f22-8774-93265565d3bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:22.337068 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b011b5a-1df8-4f22-8774-93265565d3bf admin admin] PATH_INFO: `/v3/domains` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:22.337842 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b011b5a-1df8-4f22-8774-93265565d3bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:22:22.338157 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b011b5a-1df8-4f22-8774-93265565d3bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:22.339784 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b011b5a-1df8-4f22-8774-93265565d3bf admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:22.355798 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1227/2443] 10.222.0.43 () {58 vars in 1152 bytes} [Wed Jun 22 10:22:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:22:22.357195 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a1b3fa-2aca-4b1c-8780-4327c53478ef None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:22.371291 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a1b3fa-2aca-4b1c-8780-4327c53478ef None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:22.377936 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d70818-29b9-4a5c-881f-e0cda6e1023e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:22.378614 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d70818-29b9-4a5c-881f-e0cda6e1023e admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:22.378896 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d70818-29b9-4a5c-881f-e0cda6e1023e admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:22.379172 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d70818-29b9-4a5c-881f-e0cda6e1023e admin admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:22.380016 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d70818-29b9-4a5c-881f-e0cda6e1023e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:22.381986 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d70818-29b9-4a5c-881f-e0cda6e1023e admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:22.411457 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1217/2444] 10.222.0.43 () {60 vars in 1152 bytes} [Wed Jun 22 10:22:22 2022] POST /identity/v3/projects => generated 383 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:22:22.415479 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b011b5a-1df8-4f22-8774-93265565d3bf admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:22.426746 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b011b5a-1df8-4f22-8774-93265565d3bf admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:22.508689 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832b78a6-9a47-4789-ad3d-609b3e1fc80a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:22.509242 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832b78a6-9a47-4789-ad3d-609b3e1fc80a admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:22.509531 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832b78a6-9a47-4789-ad3d-609b3e1fc80a admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:22.509889 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832b78a6-9a47-4789-ad3d-609b3e1fc80a admin admin] PATH_INFO: `/v3/users` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:22.510607 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832b78a6-9a47-4789-ad3d-609b3e1fc80a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:22.512641 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832b78a6-9a47-4789-ad3d-609b3e1fc80a admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:22.542181 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1228/2445] 10.222.0.43 () {60 vars in 1143 bytes} [Wed Jun 22 10:22:22 2022] POST /identity/v3/users => generated 292 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:22:22.546842 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d70818-29b9-4a5c-881f-e0cda6e1023e admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:22.559270 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d70818-29b9-4a5c-881f-e0cda6e1023e admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:22.566126 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebce11d6-9c59-4e32-bd43-790068ccb610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:22.566450 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebce11d6-9c59-4e32-bd43-790068ccb610 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:22.566819 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebce11d6-9c59-4e32-bd43-790068ccb610 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:22.567173 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebce11d6-9c59-4e32-bd43-790068ccb610 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:22.568151 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebce11d6-9c59-4e32-bd43-790068ccb610 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:22.569952 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebce11d6-9c59-4e32-bd43-790068ccb610 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:22.584041 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1218/2446] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:22:22 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:22:22.587975 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832b78a6-9a47-4789-ad3d-609b3e1fc80a admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:22.602855 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832b78a6-9a47-4789-ad3d-609b3e1fc80a admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:22.610866 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b337d4-bf85-403c-bc47-877ee118b90a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:22.612018 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b337d4-bf85-403c-bc47-877ee118b90a admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:22.612524 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b337d4-bf85-403c-bc47-877ee118b90a admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:22.613462 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b337d4-bf85-403c-bc47-877ee118b90a admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:22.614363 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b337d4-bf85-403c-bc47-877ee118b90a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:22.617444 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b337d4-bf85-403c-bc47-877ee118b90a admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:22.637843 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1229/2447] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:22:22 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:22:22.643099 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebce11d6-9c59-4e32-bd43-790068ccb610 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:22.654711 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebce11d6-9c59-4e32-bd43-790068ccb610 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:22.660171 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee50632a-d104-4dcb-9de7-a7db5bcc9d9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:22.661259 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee50632a-d104-4dcb-9de7-a7db5bcc9d9e admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:22.662018 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee50632a-d104-4dcb-9de7-a7db5bcc9d9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:22.662018 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee50632a-d104-4dcb-9de7-a7db5bcc9d9e admin admin] PATH_INFO: `/v3/projects/378ffa71cdc94fa39436144dda8a87c9/users/18d0db9353984f51a6bc4c74ce715375/roles/9f88c83743f745a9a785a2f454753f06` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:22.678815 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee50632a-d104-4dcb-9de7-a7db5bcc9d9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=378ffa71cdc94fa39436144dda8a87c9, user_id=18d0db9353984f51a6bc4c74ce715375, role_id=9f88c83743f745a9a785a2f454753f06)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:22.681663 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee50632a-d104-4dcb-9de7-a7db5bcc9d9e admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:22.697911 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1219/2448] 10.222.0.43 () {60 vars in 1482 bytes} [Wed Jun 22 10:22:22 2022] PUT /identity/v3/projects/378ffa71cdc94fa39436144dda8a87c9/users/18d0db9353984f51a6bc4c74ce715375/roles/9f88c83743f745a9a785a2f454753f06 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:22:22.709525 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f95ad2-2979-4ced-a79e-f60112a5c368 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:22.710004 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f95ad2-2979-4ced-a79e-f60112a5c368 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:22.710385 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f95ad2-2979-4ced-a79e-f60112a5c368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:22.739713 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-72f95ad2-2979-4ced-a79e-f60112a5c368 None None] MFA Rules not processed for user `18d0db9353984f51a6bc4c74ce715375`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:22:22.741264 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-72f95ad2-2979-4ced-a79e-f60112a5c368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:22.815125 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1230/2449] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:22:22 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:22:22.819382 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee50632a-d104-4dcb-9de7-a7db5bcc9d9e admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:22.893146 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee50632a-d104-4dcb-9de7-a7db5bcc9d9e admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:22.898773 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4356fca1-5aae-44a0-b4dd-4046f4fb2790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:22.899551 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4356fca1-5aae-44a0-b4dd-4046f4fb2790 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:22.899909 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4356fca1-5aae-44a0-b4dd-4046f4fb2790 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:22.900260 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4356fca1-5aae-44a0-b4dd-4046f4fb2790 admin admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:22.901034 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4356fca1-5aae-44a0-b4dd-4046f4fb2790 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:22.903075 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4356fca1-5aae-44a0-b4dd-4046f4fb2790 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:22.931816 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:22:22.943551 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1220/2450] 10.222.0.43 () {60 vars in 1152 bytes} [Wed Jun 22 10:22:22 2022] POST /identity/v3/projects => generated 383 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:22:22.944877 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f95ad2-2979-4ced-a79e-f60112a5c368 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:22.959698 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f95ad2-2979-4ced-a79e-f60112a5c368 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:22.973433 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:22:23.021473 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af714f26-7b67-4fdf-8ef4-ceff2a462326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:23.022175 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af714f26-7b67-4fdf-8ef4-ceff2a462326 admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:23.022458 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af714f26-7b67-4fdf-8ef4-ceff2a462326 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:23.022733 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af714f26-7b67-4fdf-8ef4-ceff2a462326 admin admin] PATH_INFO: `/v3/users` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:23.023417 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af714f26-7b67-4fdf-8ef4-ceff2a462326 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:23.025349 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af714f26-7b67-4fdf-8ef4-ceff2a462326 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:23.046879 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1231/2451] 10.222.0.43 () {60 vars in 1143 bytes} [Wed Jun 22 10:22:22 2022] POST /identity/v3/users => generated 298 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 10:22:23.050651 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4356fca1-5aae-44a0-b4dd-4046f4fb2790 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:23.064111 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4356fca1-5aae-44a0-b4dd-4046f4fb2790 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:23.069106 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d907b684-27b4-40c2-84a9-d3ac4949e102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:23.069812 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d907b684-27b4-40c2-84a9-d3ac4949e102 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:23.070102 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d907b684-27b4-40c2-84a9-d3ac4949e102 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:23.070386 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d907b684-27b4-40c2-84a9-d3ac4949e102 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:23.071118 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d907b684-27b4-40c2-84a9-d3ac4949e102 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:23.072752 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d907b684-27b4-40c2-84a9-d3ac4949e102 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:23.084330 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1221/2452] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:22:23 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:22:23.092163 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af714f26-7b67-4fdf-8ef4-ceff2a462326 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:23.108096 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af714f26-7b67-4fdf-8ef4-ceff2a462326 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:23.113128 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4638e0b6-a127-422f-8128-0e266eded0e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:23.114163 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4638e0b6-a127-422f-8128-0e266eded0e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:23.114513 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4638e0b6-a127-422f-8128-0e266eded0e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:23.114866 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4638e0b6-a127-422f-8128-0e266eded0e8 admin admin] PATH_INFO: `/v3/projects/7f7778b32a8d40c2b9802def1a64609b/users/909a7f10c3bb4bacbbb140c10cf5a324/roles/26d9c2ab5dfc4e6d9ca80c6014123906` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:23.132441 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4638e0b6-a127-422f-8128-0e266eded0e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f7778b32a8d40c2b9802def1a64609b, user_id=909a7f10c3bb4bacbbb140c10cf5a324, role_id=26d9c2ab5dfc4e6d9ca80c6014123906)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:23.135166 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4638e0b6-a127-422f-8128-0e266eded0e8 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:23.150308 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1232/2453] 10.222.0.43 () {60 vars in 1482 bytes} [Wed Jun 22 10:22:23 2022] PUT /identity/v3/projects/7f7778b32a8d40c2b9802def1a64609b/users/909a7f10c3bb4bacbbb140c10cf5a324/roles/26d9c2ab5dfc4e6d9ca80c6014123906 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:22:23.154322 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d907b684-27b4-40c2-84a9-d3ac4949e102 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:23.165447 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d907b684-27b4-40c2-84a9-d3ac4949e102 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:23.233063 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc128837-f08c-4fee-9be4-0c94ac2a083b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:23.234224 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc128837-f08c-4fee-9be4-0c94ac2a083b admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:23.234537 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc128837-f08c-4fee-9be4-0c94ac2a083b admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:23.234786 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc128837-f08c-4fee-9be4-0c94ac2a083b admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:23.235536 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc128837-f08c-4fee-9be4-0c94ac2a083b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:23.237175 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc128837-f08c-4fee-9be4-0c94ac2a083b admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:23.252803 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1222/2454] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:22:23 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:22:23.255107 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4638e0b6-a127-422f-8128-0e266eded0e8 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:23.270037 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4638e0b6-a127-422f-8128-0e266eded0e8 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:23.275219 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546ff622-d777-4182-a065-3efd24880a3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:23.277070 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546ff622-d777-4182-a065-3efd24880a3c admin admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:23.277275 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546ff622-d777-4182-a065-3efd24880a3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:23.277509 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546ff622-d777-4182-a065-3efd24880a3c admin admin] PATH_INFO: `/v3/projects/7f7778b32a8d40c2b9802def1a64609b/users/909a7f10c3bb4bacbbb140c10cf5a324/roles/26d9c2ab5dfc4e6d9ca80c6014123906` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:23.279727 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546ff622-d777-4182-a065-3efd24880a3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f7778b32a8d40c2b9802def1a64609b, user_id=909a7f10c3bb4bacbbb140c10cf5a324, role_id=26d9c2ab5dfc4e6d9ca80c6014123906)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:23.282488 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546ff622-d777-4182-a065-3efd24880a3c admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:23.294468 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1233/2455] 10.222.0.43 () {60 vars in 1482 bytes} [Wed Jun 22 10:22:23 2022] PUT /identity/v3/projects/7f7778b32a8d40c2b9802def1a64609b/users/909a7f10c3bb4bacbbb140c10cf5a324/roles/26d9c2ab5dfc4e6d9ca80c6014123906 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:22:23.305983 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf66110-5853-4bfd-b5ce-222b9db1fdf1 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:23.306284 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf66110-5853-4bfd-b5ce-222b9db1fdf1 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:23.306572 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf66110-5853-4bfd-b5ce-222b9db1fdf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:23.336613 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-1cf66110-5853-4bfd-b5ce-222b9db1fdf1 None None] MFA Rules not processed for user `909a7f10c3bb4bacbbb140c10cf5a324`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:22:23.337911 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-1cf66110-5853-4bfd-b5ce-222b9db1fdf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:23.416380 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1223/2456] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:22:23 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:22:23.429989 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546ff622-d777-4182-a065-3efd24880a3c admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:23.431689 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-546ff622-d777-4182-a065-3efd24880a3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:23.502355 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546ff622-d777-4182-a065-3efd24880a3c admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:23.506767 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef30f75-6bfb-4a59-8d34-af40d1816b42 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bbcb3d4dc704dfdb0097abc594ca855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:23.507474 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef30f75-6bfb-4a59-8d34-af40d1816b42 service cinder] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:23.507800 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef30f75-6bfb-4a59-8d34-af40d1816b42 service cinder] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:23.508089 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef30f75-6bfb-4a59-8d34-af40d1816b42 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:23.519346 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef30f75-6bfb-4a59-8d34-af40d1816b42 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:23.520835 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef30f75-6bfb-4a59-8d34-af40d1816b42 service cinder] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:23.532868 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1234/2457] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:22:23 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:22:23.659000 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf66110-5853-4bfd-b5ce-222b9db1fdf1 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:23.673773 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf66110-5853-4bfd-b5ce-222b9db1fdf1 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:23.678166 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deac655-451f-49b6-baa7-0470c558cd95 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bbcb3d4dc704dfdb0097abc594ca855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:23.678836 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deac655-451f-49b6-baa7-0470c558cd95 service cinder] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:23.679122 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deac655-451f-49b6-baa7-0470c558cd95 service cinder] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:23.680003 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deac655-451f-49b6-baa7-0470c558cd95 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:23.761951 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1deac655-451f-49b6-baa7-0470c558cd95 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:23.764001 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1deac655-451f-49b6-baa7-0470c558cd95 service cinder] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:23.782160 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1224/2458] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:22:23 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:22:24.078926 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef30f75-6bfb-4a59-8d34-af40d1816b42 service cinder] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:24.094914 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-0ef30f75-6bfb-4a59-8d34-af40d1816b42 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:24.190116 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef30f75-6bfb-4a59-8d34-af40d1816b42 service cinder] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:24.195888 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c762ce-0b46-4903-85fa-2e5e257d8730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:24.196803 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c762ce-0b46-4903-85fa-2e5e257d8730 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:24.197083 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c762ce-0b46-4903-85fa-2e5e257d8730 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:24.197363 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c762ce-0b46-4903-85fa-2e5e257d8730 admin admin] PATH_INFO: `/v3/users/78fe3fc4334c43d7a5ef6d70f9f57523` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:24.198564 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c762ce-0b46-4903-85fa-2e5e257d8730 admin admin] RBAC: Authorizing `identity:delete_user(user_id=78fe3fc4334c43d7a5ef6d70f9f57523)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:24.200753 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c762ce-0b46-4903-85fa-2e5e257d8730 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:24.216110 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:22:24.260576 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-92c762ce-0b46-4903-85fa-2e5e257d8730 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78fe3fc4334c43d7a5ef6d70f9f57523'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:24.275655 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-92c762ce-0b46-4903-85fa-2e5e257d8730 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78fe3fc4334c43d7a5ef6d70f9f57523'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:24.284047 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-92c762ce-0b46-4903-85fa-2e5e257d8730 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78fe3fc4334c43d7a5ef6d70f9f57523'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:24.292119 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-92c762ce-0b46-4903-85fa-2e5e257d8730 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78fe3fc4334c43d7a5ef6d70f9f57523'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:24.292765 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-92c762ce-0b46-4903-85fa-2e5e257d8730 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78fe3fc4334c43d7a5ef6d70f9f57523'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:24.299527 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1235/2459] 10.222.0.43 () {58 vars in 1223 bytes} [Wed Jun 22 10:22:24 2022] DELETE /identity/v3/users/78fe3fc4334c43d7a5ef6d70f9f57523 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:22:24.479875 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deac655-451f-49b6-baa7-0470c558cd95 service cinder] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:24.494345 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deac655-451f-49b6-baa7-0470c558cd95 service cinder] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:24.498423 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:22:24.570034 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c0af65-4a7c-4363-96df-7325cff92867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:24.570914 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c0af65-4a7c-4363-96df-7325cff92867 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:24.571201 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c0af65-4a7c-4363-96df-7325cff92867 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:24.571479 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c0af65-4a7c-4363-96df-7325cff92867 admin admin] PATH_INFO: `/v3/projects/ad52333bcbec425089c44c3e55df97ff` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:24.572690 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c0af65-4a7c-4363-96df-7325cff92867 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad52333bcbec425089c44c3e55df97ff)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:24.575079 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c0af65-4a7c-4363-96df-7325cff92867 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:24.634860 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-f1c0af65-4a7c-4363-96df-7325cff92867 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad52333bcbec425089c44c3e55df97ff', 'request_id': 'req-f1c0af65-4a7c-4363-96df-7325cff92867'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:24.640690 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-f1c0af65-4a7c-4363-96df-7325cff92867 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad52333bcbec425089c44c3e55df97ff', 'request_id': 'req-f1c0af65-4a7c-4363-96df-7325cff92867'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:24.650348 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-f1c0af65-4a7c-4363-96df-7325cff92867 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad52333bcbec425089c44c3e55df97ff', 'request_id': 'req-f1c0af65-4a7c-4363-96df-7325cff92867'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:24.662227 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-f1c0af65-4a7c-4363-96df-7325cff92867 admin admin] The token cache is being invalidate because project ad52333bcbec425089c44c3e55df97ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:22:24.662522 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-f1c0af65-4a7c-4363-96df-7325cff92867 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:24.663179 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-f1c0af65-4a7c-4363-96df-7325cff92867 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:24.664748 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1225/2460] 10.222.0.43 () {58 vars in 1232 bytes} [Wed Jun 22 10:22:24 2022] DELETE /identity/v3/projects/ad52333bcbec425089c44c3e55df97ff => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:22:24.670052 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515016ed-3977-41f9-8e9c-23bd646ff5fb None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:24.670350 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515016ed-3977-41f9-8e9c-23bd646ff5fb None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:24.670624 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515016ed-3977-41f9-8e9c-23bd646ff5fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:24.689155 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-515016ed-3977-41f9-8e9c-23bd646ff5fb None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:22:24.690390 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-515016ed-3977-41f9-8e9c-23bd646ff5fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:24.750046 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1236/2461] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:22:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:22:24.757680 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c495d998-168e-47a0-9c57-e046a74fdf3f None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:24.757999 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c495d998-168e-47a0-9c57-e046a74fdf3f None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:24.758282 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c495d998-168e-47a0-9c57-e046a74fdf3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:24.776033 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-c495d998-168e-47a0-9c57-e046a74fdf3f None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:22:24.777222 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-c495d998-168e-47a0-9c57-e046a74fdf3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:24.785520 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1226/2462] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:22:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:22:24.789592 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515016ed-3977-41f9-8e9c-23bd646ff5fb None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:24.799727 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515016ed-3977-41f9-8e9c-23bd646ff5fb None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:24.804285 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a94afd-d950-4e79-84e0-0186ba8c57ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:24.804932 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a94afd-d950-4e79-84e0-0186ba8c57ac admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:24.805213 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a94afd-d950-4e79-84e0-0186ba8c57ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:24.805488 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a94afd-d950-4e79-84e0-0186ba8c57ac admin admin] PATH_INFO: `/v3/domains` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:24.806242 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a94afd-d950-4e79-84e0-0186ba8c57ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:22:24.806546 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a94afd-d950-4e79-84e0-0186ba8c57ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:24.808182 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a94afd-d950-4e79-84e0-0186ba8c57ac admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:24.819663 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1237/2463] 10.222.0.43 () {58 vars in 1152 bytes} [Wed Jun 22 10:22:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:22:24.823774 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c495d998-168e-47a0-9c57-e046a74fdf3f None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:24.832811 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c495d998-168e-47a0-9c57-e046a74fdf3f None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:24.837333 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62197ca1-db98-4b10-a047-4f917c9f4b7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:24.838007 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62197ca1-db98-4b10-a047-4f917c9f4b7a admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:24.838291 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62197ca1-db98-4b10-a047-4f917c9f4b7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:24.838566 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62197ca1-db98-4b10-a047-4f917c9f4b7a admin admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:24.839260 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62197ca1-db98-4b10-a047-4f917c9f4b7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:24.841116 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62197ca1-db98-4b10-a047-4f917c9f4b7a admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:24.867369 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1227/2464] 10.222.0.43 () {60 vars in 1152 bytes} [Wed Jun 22 10:22:24 2022] POST /identity/v3/projects => generated 371 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:22:24.871490 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a94afd-d950-4e79-84e0-0186ba8c57ac admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:24.882600 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a94afd-d950-4e79-84e0-0186ba8c57ac admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:24.940085 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891c8b17-21ca-4226-9aaf-0f7105ba8129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:24.940753 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891c8b17-21ca-4226-9aaf-0f7105ba8129 admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:24.941045 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891c8b17-21ca-4226-9aaf-0f7105ba8129 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:24.941322 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891c8b17-21ca-4226-9aaf-0f7105ba8129 admin admin] PATH_INFO: `/v3/users` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:24.942051 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891c8b17-21ca-4226-9aaf-0f7105ba8129 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:24.943974 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891c8b17-21ca-4226-9aaf-0f7105ba8129 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:24.963515 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1238/2465] 10.222.0.43 () {60 vars in 1143 bytes} [Wed Jun 22 10:22:24 2022] POST /identity/v3/users => generated 286 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:22:24.967632 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62197ca1-db98-4b10-a047-4f917c9f4b7a admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:24.978580 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62197ca1-db98-4b10-a047-4f917c9f4b7a admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:24.983076 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83112372-04e0-40d8-88b4-9908f0854d92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:24.984560 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83112372-04e0-40d8-88b4-9908f0854d92 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:24.984560 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83112372-04e0-40d8-88b4-9908f0854d92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:24.984844 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83112372-04e0-40d8-88b4-9908f0854d92 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:24.985560 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83112372-04e0-40d8-88b4-9908f0854d92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:24.987192 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83112372-04e0-40d8-88b4-9908f0854d92 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:24.997400 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1228/2466] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:22:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:22:25.001384 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891c8b17-21ca-4226-9aaf-0f7105ba8129 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:25.011268 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891c8b17-21ca-4226-9aaf-0f7105ba8129 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:25.016532 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74bbb75-0f2b-4e66-ab0e-c90f304f9ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:25.017183 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74bbb75-0f2b-4e66-ab0e-c90f304f9ffc admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:25.017469 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74bbb75-0f2b-4e66-ab0e-c90f304f9ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:25.017790 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74bbb75-0f2b-4e66-ab0e-c90f304f9ffc admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:25.018518 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74bbb75-0f2b-4e66-ab0e-c90f304f9ffc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:25.020120 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74bbb75-0f2b-4e66-ab0e-c90f304f9ffc admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:25.022170 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:22:25.032839 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1239/2467] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:22:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:22:25.036767 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83112372-04e0-40d8-88b4-9908f0854d92 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:25.046767 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83112372-04e0-40d8-88b4-9908f0854d92 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:25.051315 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef6bddb-d8ee-4827-b5c9-e7561ac87c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:25.052187 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef6bddb-d8ee-4827-b5c9-e7561ac87c6a admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:25.052467 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef6bddb-d8ee-4827-b5c9-e7561ac87c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:25.052744 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef6bddb-d8ee-4827-b5c9-e7561ac87c6a admin admin] PATH_INFO: `/v3/projects/0918be4c0b0e4614866a98f94a9149d2/users/1a5c54464be448c6b1023f3a6530947a/roles/9f88c83743f745a9a785a2f454753f06` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:25.067214 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef6bddb-d8ee-4827-b5c9-e7561ac87c6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0918be4c0b0e4614866a98f94a9149d2, user_id=1a5c54464be448c6b1023f3a6530947a, role_id=9f88c83743f745a9a785a2f454753f06)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:25.069885 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef6bddb-d8ee-4827-b5c9-e7561ac87c6a admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:25.084030 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1229/2468] 10.222.0.43 () {60 vars in 1482 bytes} [Wed Jun 22 10:22:25 2022] PUT /identity/v3/projects/0918be4c0b0e4614866a98f94a9149d2/users/1a5c54464be448c6b1023f3a6530947a/roles/9f88c83743f745a9a785a2f454753f06 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:22:25.095598 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b47e845-e751-4aa9-945b-5d4b77a1b719 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:25.095891 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b47e845-e751-4aa9-945b-5d4b77a1b719 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:25.096175 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b47e845-e751-4aa9-945b-5d4b77a1b719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:25.122429 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-2b47e845-e751-4aa9-945b-5d4b77a1b719 None None] MFA Rules not processed for user `1a5c54464be448c6b1023f3a6530947a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:22:25.123661 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-2b47e845-e751-4aa9-945b-5d4b77a1b719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:25.191878 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1240/2469] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:22:25 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:22:25.198883 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef6bddb-d8ee-4827-b5c9-e7561ac87c6a admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:25.235902 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:22:25.266336 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef6bddb-d8ee-4827-b5c9-e7561ac87c6a admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:25.271144 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d4393e-3783-4bf1-8240-7eefcf4a0b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:25.271809 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d4393e-3783-4bf1-8240-7eefcf4a0b3e admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:25.272088 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d4393e-3783-4bf1-8240-7eefcf4a0b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:25.272360 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d4393e-3783-4bf1-8240-7eefcf4a0b3e admin admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:25.273052 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d4393e-3783-4bf1-8240-7eefcf4a0b3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:25.274967 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d4393e-3783-4bf1-8240-7eefcf4a0b3e admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:25.301194 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1230/2470] 10.222.0.43 () {60 vars in 1152 bytes} [Wed Jun 22 10:22:25 2022] POST /identity/v3/projects => generated 371 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:22:25.306408 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b47e845-e751-4aa9-945b-5d4b77a1b719 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:25.318487 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b47e845-e751-4aa9-945b-5d4b77a1b719 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:25.381542 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfef25e8-9bc8-4d05-9968-403e1ba45ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:25.382252 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfef25e8-9bc8-4d05-9968-403e1ba45ad0 admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:25.382568 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfef25e8-9bc8-4d05-9968-403e1ba45ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:25.382851 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfef25e8-9bc8-4d05-9968-403e1ba45ad0 admin admin] PATH_INFO: `/v3/users` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:25.383539 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfef25e8-9bc8-4d05-9968-403e1ba45ad0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:25.385555 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfef25e8-9bc8-4d05-9968-403e1ba45ad0 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:25.406350 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1241/2471] 10.222.0.43 () {60 vars in 1143 bytes} [Wed Jun 22 10:22:25 2022] POST /identity/v3/users => generated 292 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:22:25.410267 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d4393e-3783-4bf1-8240-7eefcf4a0b3e admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:25.420359 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d4393e-3783-4bf1-8240-7eefcf4a0b3e admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:25.425956 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e54126-491e-404c-88d9-9644f52d0f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:25.426611 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e54126-491e-404c-88d9-9644f52d0f06 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:25.426894 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e54126-491e-404c-88d9-9644f52d0f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:25.427170 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e54126-491e-404c-88d9-9644f52d0f06 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:25.427890 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e54126-491e-404c-88d9-9644f52d0f06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:25.429476 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e54126-491e-404c-88d9-9644f52d0f06 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:25.439964 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1231/2472] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:22:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:22:25.444037 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfef25e8-9bc8-4d05-9968-403e1ba45ad0 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:25.454117 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfef25e8-9bc8-4d05-9968-403e1ba45ad0 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:25.459164 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c99dfc-fbef-45b2-9688-f114fa73aaf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:25.460086 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c99dfc-fbef-45b2-9688-f114fa73aaf6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:25.460371 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c99dfc-fbef-45b2-9688-f114fa73aaf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:25.460650 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c99dfc-fbef-45b2-9688-f114fa73aaf6 admin admin] PATH_INFO: `/v3/projects/a58b97418e5a4c75ab766878059b9cea/users/f3e7d198d93f4906ae9fb414537d1a1f/roles/26d9c2ab5dfc4e6d9ca80c6014123906` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:25.476821 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c99dfc-fbef-45b2-9688-f114fa73aaf6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a58b97418e5a4c75ab766878059b9cea, user_id=f3e7d198d93f4906ae9fb414537d1a1f, role_id=26d9c2ab5dfc4e6d9ca80c6014123906)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:25.479640 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c99dfc-fbef-45b2-9688-f114fa73aaf6 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:25.494712 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1242/2473] 10.222.0.43 () {60 vars in 1482 bytes} [Wed Jun 22 10:22:25 2022] PUT /identity/v3/projects/a58b97418e5a4c75ab766878059b9cea/users/f3e7d198d93f4906ae9fb414537d1a1f/roles/26d9c2ab5dfc4e6d9ca80c6014123906 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:22:25.498672 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e54126-491e-404c-88d9-9644f52d0f06 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:25.510568 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e54126-491e-404c-88d9-9644f52d0f06 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:25.572943 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2230d510-a200-4189-8fbb-98de46195bb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:25.573663 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2230d510-a200-4189-8fbb-98de46195bb2 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:25.573930 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2230d510-a200-4189-8fbb-98de46195bb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:25.574214 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2230d510-a200-4189-8fbb-98de46195bb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:25.574944 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2230d510-a200-4189-8fbb-98de46195bb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:25.576661 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2230d510-a200-4189-8fbb-98de46195bb2 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:25.586998 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1232/2474] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:22:25 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:22:25.591129 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c99dfc-fbef-45b2-9688-f114fa73aaf6 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:25.602041 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c99dfc-fbef-45b2-9688-f114fa73aaf6 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:25.606598 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96d8518-2d45-4374-8229-5dbd65f69276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:25.607460 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96d8518-2d45-4374-8229-5dbd65f69276 admin admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:25.607743 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96d8518-2d45-4374-8229-5dbd65f69276 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:25.608019 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96d8518-2d45-4374-8229-5dbd65f69276 admin admin] PATH_INFO: `/v3/projects/a58b97418e5a4c75ab766878059b9cea/users/f3e7d198d93f4906ae9fb414537d1a1f/roles/26d9c2ab5dfc4e6d9ca80c6014123906` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:25.610593 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96d8518-2d45-4374-8229-5dbd65f69276 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a58b97418e5a4c75ab766878059b9cea, user_id=f3e7d198d93f4906ae9fb414537d1a1f, role_id=26d9c2ab5dfc4e6d9ca80c6014123906)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:25.613240 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96d8518-2d45-4374-8229-5dbd65f69276 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:25.623318 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1243/2475] 10.222.0.43 () {60 vars in 1482 bytes} [Wed Jun 22 10:22:25 2022] PUT /identity/v3/projects/a58b97418e5a4c75ab766878059b9cea/users/f3e7d198d93f4906ae9fb414537d1a1f/roles/26d9c2ab5dfc4e6d9ca80c6014123906 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:22:25.633818 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b8e2da-56fa-4c55-a2ba-f70d7a42c36a None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:25.634045 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b8e2da-56fa-4c55-a2ba-f70d7a42c36a None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:25.634313 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b8e2da-56fa-4c55-a2ba-f70d7a42c36a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:25.662968 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-a5b8e2da-56fa-4c55-a2ba-f70d7a42c36a None None] MFA Rules not processed for user `f3e7d198d93f4906ae9fb414537d1a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:22:25.664196 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-a5b8e2da-56fa-4c55-a2ba-f70d7a42c36a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:25.738035 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1233/2476] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:22:25 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:22:25.749342 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96d8518-2d45-4374-8229-5dbd65f69276 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:25.751044 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-d96d8518-2d45-4374-8229-5dbd65f69276 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:25.796802 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:22:25.816690 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96d8518-2d45-4374-8229-5dbd65f69276 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:25.820686 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c832b10-0e3c-4fd3-a28d-2037242a886f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bbcb3d4dc704dfdb0097abc594ca855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:25.821420 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c832b10-0e3c-4fd3-a28d-2037242a886f service cinder] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:25.821810 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c832b10-0e3c-4fd3-a28d-2037242a886f service cinder] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:25.822160 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c832b10-0e3c-4fd3-a28d-2037242a886f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:25.832309 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c832b10-0e3c-4fd3-a28d-2037242a886f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:25.833795 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c832b10-0e3c-4fd3-a28d-2037242a886f service cinder] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:25.844937 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1244/2477] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:22:25 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:22:26.244290 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b8e2da-56fa-4c55-a2ba-f70d7a42c36a None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:26.276069 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:22:26.311059 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b8e2da-56fa-4c55-a2ba-f70d7a42c36a None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:26.315616 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295ed1e0-f85b-41f3-bcc3-58ae3d4f5969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:26.316515 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295ed1e0-f85b-41f3-bcc3-58ae3d4f5969 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:26.316796 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295ed1e0-f85b-41f3-bcc3-58ae3d4f5969 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:26.317072 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295ed1e0-f85b-41f3-bcc3-58ae3d4f5969 admin admin] PATH_INFO: `/v3/users/1a5c54464be448c6b1023f3a6530947a` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:26.318951 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295ed1e0-f85b-41f3-bcc3-58ae3d4f5969 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a5c54464be448c6b1023f3a6530947a)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:26.320335 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295ed1e0-f85b-41f3-bcc3-58ae3d4f5969 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:26.371266 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-295ed1e0-f85b-41f3-bcc3-58ae3d4f5969 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a5c54464be448c6b1023f3a6530947a'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:26.391911 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-295ed1e0-f85b-41f3-bcc3-58ae3d4f5969 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a5c54464be448c6b1023f3a6530947a'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:26.409563 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-295ed1e0-f85b-41f3-bcc3-58ae3d4f5969 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a5c54464be448c6b1023f3a6530947a'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:26.410323 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-295ed1e0-f85b-41f3-bcc3-58ae3d4f5969 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a5c54464be448c6b1023f3a6530947a'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:26.419220 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-295ed1e0-f85b-41f3-bcc3-58ae3d4f5969 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a5c54464be448c6b1023f3a6530947a'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:26.426117 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c832b10-0e3c-4fd3-a28d-2037242a886f service cinder] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:26.428431 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-4c832b10-0e3c-4fd3-a28d-2037242a886f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:26.432186 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1234/2478] 10.222.0.43 () {58 vars in 1223 bytes} [Wed Jun 22 10:22:26 2022] DELETE /identity/v3/users/1a5c54464be448c6b1023f3a6530947a => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:22:26.436316 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa2c6b3-f92a-4e41-befe-d7cd08594ca4 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:26.437224 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa2c6b3-f92a-4e41-befe-d7cd08594ca4 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:26.437501 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa2c6b3-f92a-4e41-befe-d7cd08594ca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:26.460221 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-eaa2c6b3-f92a-4e41-befe-d7cd08594ca4 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:22:26.461462 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-eaa2c6b3-f92a-4e41-befe-d7cd08594ca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:26.463325 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c832b10-0e3c-4fd3-a28d-2037242a886f service cinder] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:26.549050 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6678d9d8-5e9f-4ea8-b3ec-e612181b0c94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:26.550270 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6678d9d8-5e9f-4ea8-b3ec-e612181b0c94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:26.550669 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6678d9d8-5e9f-4ea8-b3ec-e612181b0c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:26.551056 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6678d9d8-5e9f-4ea8-b3ec-e612181b0c94 admin admin] PATH_INFO: `/v3/users/18d0db9353984f51a6bc4c74ce715375` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:26.552660 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6678d9d8-5e9f-4ea8-b3ec-e612181b0c94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=18d0db9353984f51a6bc4c74ce715375)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:26.555024 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6678d9d8-5e9f-4ea8-b3ec-e612181b0c94 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:26.579662 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1235/2479] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:22:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:22:26.592009 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa2c6b3-f92a-4e41-befe-d7cd08594ca4 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:26.594008 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-eaa2c6b3-f92a-4e41-befe-d7cd08594ca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:26.630039 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-6678d9d8-5e9f-4ea8-b3ec-e612181b0c94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18d0db9353984f51a6bc4c74ce715375'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:26.645539 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-6678d9d8-5e9f-4ea8-b3ec-e612181b0c94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18d0db9353984f51a6bc4c74ce715375'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:26.658254 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-6678d9d8-5e9f-4ea8-b3ec-e612181b0c94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18d0db9353984f51a6bc4c74ce715375'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:26.672195 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:22:26.674369 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-6678d9d8-5e9f-4ea8-b3ec-e612181b0c94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18d0db9353984f51a6bc4c74ce715375'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:26.675005 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-6678d9d8-5e9f-4ea8-b3ec-e612181b0c94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18d0db9353984f51a6bc4c74ce715375'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:26.679160 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa2c6b3-f92a-4e41-befe-d7cd08594ca4 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:26.684541 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed319c59-610b-43f5-8fa0-e13410b19833 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe93d4c0737249fd8623bb5ce188e34e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:26.685429 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed319c59-610b-43f5-8fa0-e13410b19833 service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:26.686020 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed319c59-610b-43f5-8fa0-e13410b19833 service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:26.686353 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed319c59-610b-43f5-8fa0-e13410b19833 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:26.688124 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1245/2480] 10.222.0.43 () {58 vars in 1223 bytes} [Wed Jun 22 10:22:26 2022] DELETE /identity/v3/users/18d0db9353984f51a6bc4c74ce715375 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:22:26.690046 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-ed319c59-610b-43f5-8fa0-e13410b19833 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:26.693146 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48968fa8-6b22-46ad-9eb3-81819d4586ee None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:26.693439 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48968fa8-6b22-46ad-9eb3-81819d4586ee None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:26.693739 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48968fa8-6b22-46ad-9eb3-81819d4586ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:26.716909 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed319c59-610b-43f5-8fa0-e13410b19833 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:26.717627 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-48968fa8-6b22-46ad-9eb3-81819d4586ee None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:22:26.718987 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-48968fa8-6b22-46ad-9eb3-81819d4586ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:26.719641 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed319c59-610b-43f5-8fa0-e13410b19833 service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:26.742197 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1236/2481] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:22:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 10:22:26.801191 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1246/2482] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:22:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:22:26.811134 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed319c59-610b-43f5-8fa0-e13410b19833 service neutron] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:26.812358 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-ed319c59-610b-43f5-8fa0-e13410b19833 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:26.831300 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed319c59-610b-43f5-8fa0-e13410b19833 service neutron] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:26.977479 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba873428-206c-4cb6-b724-3c2396c46d9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe93d4c0737249fd8623bb5ce188e34e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:26.978369 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba873428-206c-4cb6-b724-3c2396c46d9e service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:26.978793 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba873428-206c-4cb6-b724-3c2396c46d9e service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:26.979082 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba873428-206c-4cb6-b724-3c2396c46d9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:27.011357 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba873428-206c-4cb6-b724-3c2396c46d9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:27.012852 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba873428-206c-4cb6-b724-3c2396c46d9e service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:27.037921 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1237/2483] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:22:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:22:27.336883 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48968fa8-6b22-46ad-9eb3-81819d4586ee None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:27.339136 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-48968fa8-6b22-46ad-9eb3-81819d4586ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:27.350566 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:22:27.357941 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48968fa8-6b22-46ad-9eb3-81819d4586ee None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:27.364381 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8814329-94ab-4fb9-85cf-12a2daf938ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:27.365394 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8814329-94ab-4fb9-85cf-12a2daf938ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:27.365833 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8814329-94ab-4fb9-85cf-12a2daf938ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:27.366184 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8814329-94ab-4fb9-85cf-12a2daf938ce admin admin] PATH_INFO: `/v3/projects/0918be4c0b0e4614866a98f94a9149d2` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:27.367721 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8814329-94ab-4fb9-85cf-12a2daf938ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=0918be4c0b0e4614866a98f94a9149d2)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:27.370173 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8814329-94ab-4fb9-85cf-12a2daf938ce admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:27.426924 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-d8814329-94ab-4fb9-85cf-12a2daf938ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0918be4c0b0e4614866a98f94a9149d2', 'request_id': 'req-d8814329-94ab-4fb9-85cf-12a2daf938ce'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:27.435084 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-d8814329-94ab-4fb9-85cf-12a2daf938ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0918be4c0b0e4614866a98f94a9149d2', 'request_id': 'req-d8814329-94ab-4fb9-85cf-12a2daf938ce'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:27.442698 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-d8814329-94ab-4fb9-85cf-12a2daf938ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0918be4c0b0e4614866a98f94a9149d2', 'request_id': 'req-d8814329-94ab-4fb9-85cf-12a2daf938ce'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:27.479332 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-d8814329-94ab-4fb9-85cf-12a2daf938ce admin admin] The token cache is being invalidate because project 0918be4c0b0e4614866a98f94a9149d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:22:27.479696 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-d8814329-94ab-4fb9-85cf-12a2daf938ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:27.481455 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-d8814329-94ab-4fb9-85cf-12a2daf938ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:27.493264 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1247/2484] 10.222.0.43 () {58 vars in 1232 bytes} [Wed Jun 22 10:22:27 2022] DELETE /identity/v3/projects/0918be4c0b0e4614866a98f94a9149d2 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:22:27.497158 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba873428-206c-4cb6-b724-3c2396c46d9e service neutron] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:27.507321 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba873428-206c-4cb6-b724-3c2396c46d9e service neutron] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:27.587655 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3421507e-2dec-49c4-bcce-9f566772f71f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:27.588649 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3421507e-2dec-49c4-bcce-9f566772f71f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:27.589007 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3421507e-2dec-49c4-bcce-9f566772f71f admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:27.589364 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3421507e-2dec-49c4-bcce-9f566772f71f admin admin] PATH_INFO: `/v3/users/f3e7d198d93f4906ae9fb414537d1a1f` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:27.590755 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3421507e-2dec-49c4-bcce-9f566772f71f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3e7d198d93f4906ae9fb414537d1a1f)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:27.593405 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3421507e-2dec-49c4-bcce-9f566772f71f admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:27.633419 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8814329-94ab-4fb9-85cf-12a2daf938ce admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:27.635242 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-d8814329-94ab-4fb9-85cf-12a2daf938ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:27.658717 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8814329-94ab-4fb9-85cf-12a2daf938ce admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:27.667769 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-3421507e-2dec-49c4-bcce-9f566772f71f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3e7d198d93f4906ae9fb414537d1a1f'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:27.677487 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579ef119-48d1-4072-a99d-e2b2ae58c067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:27.678428 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579ef119-48d1-4072-a99d-e2b2ae58c067 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:27.678675 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579ef119-48d1-4072-a99d-e2b2ae58c067 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:27.678939 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579ef119-48d1-4072-a99d-e2b2ae58c067 admin admin] PATH_INFO: `/v3/projects/378ffa71cdc94fa39436144dda8a87c9` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:27.682264 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579ef119-48d1-4072-a99d-e2b2ae58c067 admin admin] RBAC: Authorizing `identity:delete_project(project_id=378ffa71cdc94fa39436144dda8a87c9)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:27.684697 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579ef119-48d1-4072-a99d-e2b2ae58c067 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:27.689083 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-3421507e-2dec-49c4-bcce-9f566772f71f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3e7d198d93f4906ae9fb414537d1a1f'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:27.698642 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-3421507e-2dec-49c4-bcce-9f566772f71f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3e7d198d93f4906ae9fb414537d1a1f'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:27.699358 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-3421507e-2dec-49c4-bcce-9f566772f71f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3e7d198d93f4906ae9fb414537d1a1f'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:27.707949 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-3421507e-2dec-49c4-bcce-9f566772f71f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3e7d198d93f4906ae9fb414537d1a1f'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:27.717722 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1238/2485] 10.222.0.43 () {58 vars in 1223 bytes} [Wed Jun 22 10:22:27 2022] DELETE /identity/v3/users/f3e7d198d93f4906ae9fb414537d1a1f => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:22:27.749375 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-579ef119-48d1-4072-a99d-e2b2ae58c067 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '378ffa71cdc94fa39436144dda8a87c9', 'request_id': 'req-579ef119-48d1-4072-a99d-e2b2ae58c067'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:27.757363 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-579ef119-48d1-4072-a99d-e2b2ae58c067 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '378ffa71cdc94fa39436144dda8a87c9', 'request_id': 'req-579ef119-48d1-4072-a99d-e2b2ae58c067'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:27.764510 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-579ef119-48d1-4072-a99d-e2b2ae58c067 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '378ffa71cdc94fa39436144dda8a87c9', 'request_id': 'req-579ef119-48d1-4072-a99d-e2b2ae58c067'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:27.779190 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-579ef119-48d1-4072-a99d-e2b2ae58c067 admin admin] The token cache is being invalidate because project 378ffa71cdc94fa39436144dda8a87c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:22:27.779566 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-579ef119-48d1-4072-a99d-e2b2ae58c067 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:27.781169 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-579ef119-48d1-4072-a99d-e2b2ae58c067 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:27.783546 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1248/2486] 10.222.0.43 () {58 vars in 1232 bytes} [Wed Jun 22 10:22:27 2022] DELETE /identity/v3/projects/378ffa71cdc94fa39436144dda8a87c9 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:22:27.788102 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3421507e-2dec-49c4-bcce-9f566772f71f admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:27.789852 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-3421507e-2dec-49c4-bcce-9f566772f71f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:27.813159 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:22:27.883494 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3421507e-2dec-49c4-bcce-9f566772f71f admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:27.950535 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc9c272-cc95-4e76-8949-baf2b3466d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:27.951560 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc9c272-cc95-4e76-8949-baf2b3466d67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:27.951845 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc9c272-cc95-4e76-8949-baf2b3466d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:27.952173 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc9c272-cc95-4e76-8949-baf2b3466d67 admin admin] PATH_INFO: `/v3/users/909a7f10c3bb4bacbbb140c10cf5a324` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:27.954015 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc9c272-cc95-4e76-8949-baf2b3466d67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=909a7f10c3bb4bacbbb140c10cf5a324)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:27.955969 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc9c272-cc95-4e76-8949-baf2b3466d67 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:28.015824 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-cbc9c272-cc95-4e76-8949-baf2b3466d67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '909a7f10c3bb4bacbbb140c10cf5a324'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:28.045166 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579ef119-48d1-4072-a99d-e2b2ae58c067 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:28.048833 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-579ef119-48d1-4072-a99d-e2b2ae58c067 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:28.063729 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-cbc9c272-cc95-4e76-8949-baf2b3466d67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '909a7f10c3bb4bacbbb140c10cf5a324'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:28.073195 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579ef119-48d1-4072-a99d-e2b2ae58c067 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:28.075180 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-cbc9c272-cc95-4e76-8949-baf2b3466d67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '909a7f10c3bb4bacbbb140c10cf5a324'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:28.075836 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-cbc9c272-cc95-4e76-8949-baf2b3466d67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '909a7f10c3bb4bacbbb140c10cf5a324'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:28.093111 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43e24a0-7b4a-405a-b70b-f1441ddbb61b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:28.095282 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43e24a0-7b4a-405a-b70b-f1441ddbb61b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:28.095581 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43e24a0-7b4a-405a-b70b-f1441ddbb61b admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:28.097315 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43e24a0-7b4a-405a-b70b-f1441ddbb61b admin admin] PATH_INFO: `/v3/projects/a58b97418e5a4c75ab766878059b9cea` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:28.103876 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43e24a0-7b4a-405a-b70b-f1441ddbb61b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a58b97418e5a4c75ab766878059b9cea)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:28.103876 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43e24a0-7b4a-405a-b70b-f1441ddbb61b admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:28.106317 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-cbc9c272-cc95-4e76-8949-baf2b3466d67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '909a7f10c3bb4bacbbb140c10cf5a324'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:28.114728 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1239/2487] 10.222.0.43 () {58 vars in 1223 bytes} [Wed Jun 22 10:22:27 2022] DELETE /identity/v3/users/909a7f10c3bb4bacbbb140c10cf5a324 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:22:28.168002 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-e43e24a0-7b4a-405a-b70b-f1441ddbb61b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a58b97418e5a4c75ab766878059b9cea', 'request_id': 'req-e43e24a0-7b4a-405a-b70b-f1441ddbb61b'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:28.175875 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-e43e24a0-7b4a-405a-b70b-f1441ddbb61b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a58b97418e5a4c75ab766878059b9cea', 'request_id': 'req-e43e24a0-7b4a-405a-b70b-f1441ddbb61b'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:28.182411 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-e43e24a0-7b4a-405a-b70b-f1441ddbb61b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a58b97418e5a4c75ab766878059b9cea', 'request_id': 'req-e43e24a0-7b4a-405a-b70b-f1441ddbb61b'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:28.184216 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:22:28.199019 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-e43e24a0-7b4a-405a-b70b-f1441ddbb61b admin admin] The token cache is being invalidate because project a58b97418e5a4c75ab766878059b9cea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:22:28.199328 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-e43e24a0-7b4a-405a-b70b-f1441ddbb61b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:28.200339 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-e43e24a0-7b4a-405a-b70b-f1441ddbb61b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:28.207713 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c82257d-a371-406c-9ed4-6fb1dec2ae67 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:28.208079 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c82257d-a371-406c-9ed4-6fb1dec2ae67 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:28.208378 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c82257d-a371-406c-9ed4-6fb1dec2ae67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:28.209775 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1249/2488] 10.222.0.43 () {58 vars in 1232 bytes} [Wed Jun 22 10:22:28 2022] DELETE /identity/v3/projects/a58b97418e5a4c75ab766878059b9cea => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:22:28.232192 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-8c82257d-a371-406c-9ed4-6fb1dec2ae67 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:22:28.234424 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-8c82257d-a371-406c-9ed4-6fb1dec2ae67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:28.275678 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:22:28.299621 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1240/2489] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:22:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:22:28.307215 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc2d269-3d30-4a38-a37c-97ae258cb715 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:28.307513 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc2d269-3d30-4a38-a37c-97ae258cb715 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:28.307793 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc2d269-3d30-4a38-a37c-97ae258cb715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:28.326910 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-5dc2d269-3d30-4a38-a37c-97ae258cb715 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:22:28.328244 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-5dc2d269-3d30-4a38-a37c-97ae258cb715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:28.336356 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1250/2490] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:22:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:22:28.340531 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c82257d-a371-406c-9ed4-6fb1dec2ae67 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:28.351449 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c82257d-a371-406c-9ed4-6fb1dec2ae67 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:28.356568 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa12e982-987e-49db-b867-df1bcc405dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:28.357226 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa12e982-987e-49db-b867-df1bcc405dad admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:28.357507 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa12e982-987e-49db-b867-df1bcc405dad admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:28.357819 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa12e982-987e-49db-b867-df1bcc405dad admin admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:28.359164 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa12e982-987e-49db-b867-df1bcc405dad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:22:28.359483 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa12e982-987e-49db-b867-df1bcc405dad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:28.361142 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa12e982-987e-49db-b867-df1bcc405dad admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:28.373846 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1241/2491] 10.222.0.43 () {58 vars in 1152 bytes} [Wed Jun 22 10:22:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:22:28.378218 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc2d269-3d30-4a38-a37c-97ae258cb715 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:28.387369 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc2d269-3d30-4a38-a37c-97ae258cb715 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:28.392059 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ab0619-34b8-4d38-b8aa-020aaa635cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:28.392716 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ab0619-34b8-4d38-b8aa-020aaa635cd9 admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:28.393017 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ab0619-34b8-4d38-b8aa-020aaa635cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:28.393282 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ab0619-34b8-4d38-b8aa-020aaa635cd9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:28.394023 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ab0619-34b8-4d38-b8aa-020aaa635cd9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:28.395940 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ab0619-34b8-4d38-b8aa-020aaa635cd9 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:28.411537 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa12e982-987e-49db-b867-df1bcc405dad admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:28.413498 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-aa12e982-987e-49db-b867-df1bcc405dad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:28.430128 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa12e982-987e-49db-b867-df1bcc405dad admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:28.436500 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c717cb9b-00e8-4e0c-9be9-a8da3ca61091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:28.437448 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c717cb9b-00e8-4e0c-9be9-a8da3ca61091 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:28.437831 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c717cb9b-00e8-4e0c-9be9-a8da3ca61091 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:28.438034 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c717cb9b-00e8-4e0c-9be9-a8da3ca61091 admin admin] PATH_INFO: `/v3/projects/7f7778b32a8d40c2b9802def1a64609b` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:28.439251 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c717cb9b-00e8-4e0c-9be9-a8da3ca61091 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f7778b32a8d40c2b9802def1a64609b)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:28.441273 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c717cb9b-00e8-4e0c-9be9-a8da3ca61091 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:28.445196 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1251/2492] 10.222.0.43 () {60 vars in 1152 bytes} [Wed Jun 22 10:22:28 2022] POST /identity/v3/projects => generated 357 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:22:28.449067 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ab0619-34b8-4d38-b8aa-020aaa635cd9 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:28.491497 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-c717cb9b-00e8-4e0c-9be9-a8da3ca61091 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f7778b32a8d40c2b9802def1a64609b', 'request_id': 'req-c717cb9b-00e8-4e0c-9be9-a8da3ca61091'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:28.497032 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-c717cb9b-00e8-4e0c-9be9-a8da3ca61091 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f7778b32a8d40c2b9802def1a64609b', 'request_id': 'req-c717cb9b-00e8-4e0c-9be9-a8da3ca61091'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:28.507797 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-c717cb9b-00e8-4e0c-9be9-a8da3ca61091 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f7778b32a8d40c2b9802def1a64609b', 'request_id': 'req-c717cb9b-00e8-4e0c-9be9-a8da3ca61091'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:28.518880 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ab0619-34b8-4d38-b8aa-020aaa635cd9 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:28.525133 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-c717cb9b-00e8-4e0c-9be9-a8da3ca61091 admin admin] The token cache is being invalidate because project 7f7778b32a8d40c2b9802def1a64609b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:22:28.525432 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-c717cb9b-00e8-4e0c-9be9-a8da3ca61091 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:28.526134 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-c717cb9b-00e8-4e0c-9be9-a8da3ca61091 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:28.531426 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1242/2493] 10.222.0.43 () {58 vars in 1232 bytes} [Wed Jun 22 10:22:28 2022] DELETE /identity/v3/projects/7f7778b32a8d40c2b9802def1a64609b => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:22:28.533042 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1d8e9d-179e-472b-85ff-6e12778697a2 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:28.533332 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1d8e9d-179e-472b-85ff-6e12778697a2 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:28.533853 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1d8e9d-179e-472b-85ff-6e12778697a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:28.555328 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-bf1d8e9d-179e-472b-85ff-6e12778697a2 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:22:28.556560 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-bf1d8e9d-179e-472b-85ff-6e12778697a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:28.596674 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8e5459-7a99-4d2a-8a41-d01abdc29448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:28.597481 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8e5459-7a99-4d2a-8a41-d01abdc29448 admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:28.597870 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8e5459-7a99-4d2a-8a41-d01abdc29448 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:28.598153 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8e5459-7a99-4d2a-8a41-d01abdc29448 admin admin] PATH_INFO: `/v3/users` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:28.598903 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8e5459-7a99-4d2a-8a41-d01abdc29448 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:28.601239 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8e5459-7a99-4d2a-8a41-d01abdc29448 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:28.633975 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1252/2494] 10.222.0.43 () {60 vars in 1143 bytes} [Wed Jun 22 10:22:28 2022] POST /identity/v3/users => generated 279 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 10:22:28.636007 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8e5459-7a99-4d2a-8a41-d01abdc29448 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:28.637842 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-6a8e5459-7a99-4d2a-8a41-d01abdc29448 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:28.652776 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8e5459-7a99-4d2a-8a41-d01abdc29448 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:28.655673 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1243/2495] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:22:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:22:28.662050 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0423bb-2d9e-458c-87d3-dff82733fd31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:28.663029 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0423bb-2d9e-458c-87d3-dff82733fd31 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:28.663242 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0423bb-2d9e-458c-87d3-dff82733fd31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:28.663553 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eddaa11-820f-42f5-80da-f2bbf832d0d7 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:28.663553 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eddaa11-820f-42f5-80da-f2bbf832d0d7 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:28.663784 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0423bb-2d9e-458c-87d3-dff82733fd31 admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:28.663952 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eddaa11-820f-42f5-80da-f2bbf832d0d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:28.664793 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0423bb-2d9e-458c-87d3-dff82733fd31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:28.666522 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0423bb-2d9e-458c-87d3-dff82733fd31 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:28.680801 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1253/2496] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:22:28 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:22:28.681933 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0423bb-2d9e-458c-87d3-dff82733fd31 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:28.683668 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-6eddaa11-820f-42f5-80da-f2bbf832d0d7 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:22:28.685010 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-6eddaa11-820f-42f5-80da-f2bbf832d0d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:28.694150 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0423bb-2d9e-458c-87d3-dff82733fd31 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:28.694846 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1244/2497] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:22:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:22:28.698784 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eddaa11-820f-42f5-80da-f2bbf832d0d7 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:28.700549 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5291f157-f750-434e-9664-bff918d9d270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:28.701575 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5291f157-f750-434e-9664-bff918d9d270 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:28.703024 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5291f157-f750-434e-9664-bff918d9d270 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:28.703686 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5291f157-f750-434e-9664-bff918d9d270 admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:28.704317 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5291f157-f750-434e-9664-bff918d9d270 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:28.706217 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5291f157-f750-434e-9664-bff918d9d270 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:28.710059 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eddaa11-820f-42f5-80da-f2bbf832d0d7 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:28.716012 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67420156-1134-4b2a-a2e0-0c7c559d7203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:28.716685 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67420156-1134-4b2a-a2e0-0c7c559d7203 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:28.716971 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67420156-1134-4b2a-a2e0-0c7c559d7203 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:28.717250 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67420156-1134-4b2a-a2e0-0c7c559d7203 admin admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:28.718085 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67420156-1134-4b2a-a2e0-0c7c559d7203 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:22:28.718085 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67420156-1134-4b2a-a2e0-0c7c559d7203 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:28.719964 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67420156-1134-4b2a-a2e0-0c7c559d7203 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:28.721847 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1254/2498] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:22:28 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 10:22:28.725339 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5291f157-f750-434e-9664-bff918d9d270 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:28.737235 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1245/2499] 10.222.0.43 () {58 vars in 1152 bytes} [Wed Jun 22 10:22:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:22:28.737419 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5291f157-f750-434e-9664-bff918d9d270 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:28.738133 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67420156-1134-4b2a-a2e0-0c7c559d7203 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:28.742242 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad777a3-d415-4921-9c2e-ef5670489a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:28.743133 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad777a3-d415-4921-9c2e-ef5670489a36 admin admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:28.743552 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad777a3-d415-4921-9c2e-ef5670489a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:28.743839 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad777a3-d415-4921-9c2e-ef5670489a36 admin admin] PATH_INFO: `/v3/projects/3b67f9f93e2548278203482194425620/users/b4baec301969435e95fcf581b3056286/roles/9f88c83743f745a9a785a2f454753f06` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:28.747787 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67420156-1134-4b2a-a2e0-0c7c559d7203 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:28.753421 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917a1d70-9ef4-4542-b334-36afd3caf64c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:28.754189 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917a1d70-9ef4-4542-b334-36afd3caf64c admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:28.754545 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917a1d70-9ef4-4542-b334-36afd3caf64c admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:28.754898 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917a1d70-9ef4-4542-b334-36afd3caf64c admin admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:28.755706 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917a1d70-9ef4-4542-b334-36afd3caf64c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:28.757718 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917a1d70-9ef4-4542-b334-36afd3caf64c admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:28.760207 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad777a3-d415-4921-9c2e-ef5670489a36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b67f9f93e2548278203482194425620, user_id=b4baec301969435e95fcf581b3056286, role_id=9f88c83743f745a9a785a2f454753f06)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:28.763058 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad777a3-d415-4921-9c2e-ef5670489a36 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:28.780187 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1255/2500] 10.222.0.43 () {60 vars in 1482 bytes} [Wed Jun 22 10:22:28 2022] PUT /identity/v3/projects/3b67f9f93e2548278203482194425620/users/b4baec301969435e95fcf581b3056286/roles/9f88c83743f745a9a785a2f454753f06 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:22:28.791997 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0184d311-22b4-41a3-99f1-3d4b50b9b0ae None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:28.792365 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0184d311-22b4-41a3-99f1-3d4b50b9b0ae None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:28.792568 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0184d311-22b4-41a3-99f1-3d4b50b9b0ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:28.798089 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1246/2501] 10.222.0.43 () {60 vars in 1152 bytes} [Wed Jun 22 10:22:28 2022] POST /identity/v3/projects => generated 405 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:22:28.802817 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917a1d70-9ef4-4542-b334-36afd3caf64c admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:28.813442 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:22:28.820394 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:INSERT=6,keystone:DELETE=1,keystone:SELECT=93 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:22:28.824164 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-0184d311-22b4-41a3-99f1-3d4b50b9b0ae None None] MFA Rules not processed for user `b4baec301969435e95fcf581b3056286`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:22:28.825609 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-0184d311-22b4-41a3-99f1-3d4b50b9b0ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:28.879412 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917a1d70-9ef4-4542-b334-36afd3caf64c admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:28.884503 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3bab71-ab8c-4759-bcb3-aef71ae2800b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:28.885186 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3bab71-ab8c-4759-bcb3-aef71ae2800b admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:28.885479 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3bab71-ab8c-4759-bcb3-aef71ae2800b admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:28.885794 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3bab71-ab8c-4759-bcb3-aef71ae2800b admin admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:28.886502 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3bab71-ab8c-4759-bcb3-aef71ae2800b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:28.888707 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3bab71-ab8c-4759-bcb3-aef71ae2800b admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:28.903170 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1256/2502] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:22:28 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:22:28.908725 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0184d311-22b4-41a3-99f1-3d4b50b9b0ae None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:28.919135 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1247/2503] 10.222.0.43 () {60 vars in 1143 bytes} [Wed Jun 22 10:22:28 2022] POST /identity/v3/users => generated 303 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 10:22:28.924503 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3bab71-ab8c-4759-bcb3-aef71ae2800b admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:28.925919 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0184d311-22b4-41a3-99f1-3d4b50b9b0ae None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:28.930838 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431aa899-fce7-429b-9b8d-0f63aa135fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:28.931531 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431aa899-fce7-429b-9b8d-0f63aa135fde admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:28.931826 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431aa899-fce7-429b-9b8d-0f63aa135fde admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:28.932103 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431aa899-fce7-429b-9b8d-0f63aa135fde admin admin] PATH_INFO: `/v3/projects` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:28.932791 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431aa899-fce7-429b-9b8d-0f63aa135fde admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:28.935554 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3bab71-ab8c-4759-bcb3-aef71ae2800b admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:28.936232 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431aa899-fce7-429b-9b8d-0f63aa135fde admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:28.941144 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fb48e0-a638-48c2-8696-ca8a1c075b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:28.941869 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fb48e0-a638-48c2-8696-ca8a1c075b66 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:28.942156 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fb48e0-a638-48c2-8696-ca8a1c075b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:28.942433 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fb48e0-a638-48c2-8696-ca8a1c075b66 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:28.943167 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fb48e0-a638-48c2-8696-ca8a1c075b66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:28.944847 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fb48e0-a638-48c2-8696-ca8a1c075b66 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:28.957766 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1248/2504] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:22:28 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:22:28.960931 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fb48e0-a638-48c2-8696-ca8a1c075b66 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:28.972886 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fb48e0-a638-48c2-8696-ca8a1c075b66 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:28.974645 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1257/2505] 10.222.0.43 () {60 vars in 1152 bytes} [Wed Jun 22 10:22:28 2022] POST /identity/v3/projects => generated 355 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 10:22:28.978745 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431aa899-fce7-429b-9b8d-0f63aa135fde admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:29.042506 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19674524-ef30-45d4-859c-f04dbc184009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:29.043191 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19674524-ef30-45d4-859c-f04dbc184009 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:29.043479 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19674524-ef30-45d4-859c-f04dbc184009 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:29.043760 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19674524-ef30-45d4-859c-f04dbc184009 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:29.044613 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19674524-ef30-45d4-859c-f04dbc184009 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:29.047636 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19674524-ef30-45d4-859c-f04dbc184009 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:29.052240 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431aa899-fce7-429b-9b8d-0f63aa135fde admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:29.057302 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d13e46-b2ba-40f2-8bf3-b5a8914fe77b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:29.058129 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d13e46-b2ba-40f2-8bf3-b5a8914fe77b admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:29.061681 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d13e46-b2ba-40f2-8bf3-b5a8914fe77b admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:29.061681 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d13e46-b2ba-40f2-8bf3-b5a8914fe77b admin admin] PATH_INFO: `/v3/users` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:29.062030 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1249/2506] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:22:28 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:22:29.062120 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d13e46-b2ba-40f2-8bf3-b5a8914fe77b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:29.062120 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d13e46-b2ba-40f2-8bf3-b5a8914fe77b admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:29.063049 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19674524-ef30-45d4-859c-f04dbc184009 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:29.076251 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19674524-ef30-45d4-859c-f04dbc184009 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:29.081945 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b4c676-92d4-4f34-8fd0-8d3ba96f7408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:29.083037 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b4c676-92d4-4f34-8fd0-8d3ba96f7408 admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:29.083389 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b4c676-92d4-4f34-8fd0-8d3ba96f7408 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:29.083760 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b4c676-92d4-4f34-8fd0-8d3ba96f7408 admin admin] PATH_INFO: `/v3/projects/ba12e528403f4c128f36be8756372604/users/290832423c674230a936ab3308e0136e/roles/9f88c83743f745a9a785a2f454753f06` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:29.087028 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1258/2507] 10.222.0.43 () {60 vars in 1143 bytes} [Wed Jun 22 10:22:28 2022] POST /identity/v3/users => generated 284 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 10:22:29.090724 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d13e46-b2ba-40f2-8bf3-b5a8914fe77b admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:29.106870 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b4c676-92d4-4f34-8fd0-8d3ba96f7408 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba12e528403f4c128f36be8756372604, user_id=290832423c674230a936ab3308e0136e, role_id=9f88c83743f745a9a785a2f454753f06)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:29.107103 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d13e46-b2ba-40f2-8bf3-b5a8914fe77b admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:29.109620 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b4c676-92d4-4f34-8fd0-8d3ba96f7408 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:29.117935 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61f9f96-2cb6-40dd-b3dd-7094d8159b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:29.118710 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61f9f96-2cb6-40dd-b3dd-7094d8159b8d admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:29.119125 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61f9f96-2cb6-40dd-b3dd-7094d8159b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:29.119468 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61f9f96-2cb6-40dd-b3dd-7094d8159b8d admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:29.120395 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61f9f96-2cb6-40dd-b3dd-7094d8159b8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:29.122315 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61f9f96-2cb6-40dd-b3dd-7094d8159b8d admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:29.126611 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1250/2508] 10.222.0.43 () {60 vars in 1482 bytes} [Wed Jun 22 10:22:29 2022] PUT /identity/v3/projects/ba12e528403f4c128f36be8756372604/users/290832423c674230a936ab3308e0136e/roles/9f88c83743f745a9a785a2f454753f06 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:22:29.136146 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1259/2509] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:22:29 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 10:22:29.136858 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92f4135-2a10-4e47-9710-fa91c1ddf816 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:29.137156 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92f4135-2a10-4e47-9710-fa91c1ddf816 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:29.137442 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92f4135-2a10-4e47-9710-fa91c1ddf816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:29.140861 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61f9f96-2cb6-40dd-b3dd-7094d8159b8d admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:29.150954 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61f9f96-2cb6-40dd-b3dd-7094d8159b8d admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:29.167604 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-d92f4135-2a10-4e47-9710-fa91c1ddf816 None None] MFA Rules not processed for user `290832423c674230a936ab3308e0136e`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:22:29.168880 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-d92f4135-2a10-4e47-9710-fa91c1ddf816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:29.219915 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b724fda-a5c3-48fb-b9b3-0bca64611d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:29.220967 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b724fda-a5c3-48fb-b9b3-0bca64611d40 admin admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:29.221324 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b724fda-a5c3-48fb-b9b3-0bca64611d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:29.221675 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b724fda-a5c3-48fb-b9b3-0bca64611d40 admin admin] PATH_INFO: `/v3/projects/8e808aafee0a44e492a941b49bdd100c/users/377e8696784740e1bdae7adb0db29232/roles/26d9c2ab5dfc4e6d9ca80c6014123906` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:29.226311 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:22:29.243862 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b724fda-a5c3-48fb-b9b3-0bca64611d40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e808aafee0a44e492a941b49bdd100c, user_id=377e8696784740e1bdae7adb0db29232, role_id=26d9c2ab5dfc4e6d9ca80c6014123906)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:29.246901 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:22:29.247883 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b724fda-a5c3-48fb-b9b3-0bca64611d40 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:29.272113 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1260/2510] 10.222.0.43 () {60 vars in 1482 bytes} [Wed Jun 22 10:22:29 2022] PUT /identity/v3/projects/8e808aafee0a44e492a941b49bdd100c/users/377e8696784740e1bdae7adb0db29232/roles/26d9c2ab5dfc4e6d9ca80c6014123906 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:22:29.275724 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b724fda-a5c3-48fb-b9b3-0bca64611d40 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:29.279415 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1251/2511] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:22:29 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:22:29.284605 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92f4135-2a10-4e47-9710-fa91c1ddf816 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:29.300454 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92f4135-2a10-4e47-9710-fa91c1ddf816 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:29.370031 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b724fda-a5c3-48fb-b9b3-0bca64611d40 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:29.381341 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024de19e-df53-4a11-b18c-49597af56e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:29.382876 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024de19e-df53-4a11-b18c-49597af56e24 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:29.383208 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024de19e-df53-4a11-b18c-49597af56e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:29.383574 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024de19e-df53-4a11-b18c-49597af56e24 admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:29.384286 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024de19e-df53-4a11-b18c-49597af56e24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:29.386239 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024de19e-df53-4a11-b18c-49597af56e24 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:29.386747 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73997a70-49e6-4e7c-9205-b4114756cc85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:29.387639 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73997a70-49e6-4e7c-9205-b4114756cc85 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:29.388027 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73997a70-49e6-4e7c-9205-b4114756cc85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:29.388473 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73997a70-49e6-4e7c-9205-b4114756cc85 admin admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:29.389302 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73997a70-49e6-4e7c-9205-b4114756cc85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:29.392609 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73997a70-49e6-4e7c-9205-b4114756cc85 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:29.406493 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1261/2512] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:22:29 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:22:29.408074 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024de19e-df53-4a11-b18c-49597af56e24 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:29.430149 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024de19e-df53-4a11-b18c-49597af56e24 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:29.445294 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceefc82-1b29-4b59-831a-767a22118b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:29.446274 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceefc82-1b29-4b59-831a-767a22118b34 admin admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:29.446585 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceefc82-1b29-4b59-831a-767a22118b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:29.446895 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceefc82-1b29-4b59-831a-767a22118b34 admin admin] PATH_INFO: `/v3/projects/8e808aafee0a44e492a941b49bdd100c/users/377e8696784740e1bdae7adb0db29232/roles/26d9c2ab5dfc4e6d9ca80c6014123906` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:29.447687 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1252/2513] 10.222.0.43 () {60 vars in 1152 bytes} [Wed Jun 22 10:22:29 2022] POST /identity/v3/projects => generated 409 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 10:22:29.448913 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73997a70-49e6-4e7c-9205-b4114756cc85 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:29.449572 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ceefc82-1b29-4b59-831a-767a22118b34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e808aafee0a44e492a941b49bdd100c, user_id=377e8696784740e1bdae7adb0db29232, role_id=26d9c2ab5dfc4e6d9ca80c6014123906)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:29.454161 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ceefc82-1b29-4b59-831a-767a22118b34 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:29.469825 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1262/2514] 10.222.0.43 () {60 vars in 1482 bytes} [Wed Jun 22 10:22:29 2022] PUT /identity/v3/projects/8e808aafee0a44e492a941b49bdd100c/users/377e8696784740e1bdae7adb0db29232/roles/26d9c2ab5dfc4e6d9ca80c6014123906 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:22:29.484373 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a507a606-3e61-4ed3-a462-0f0ffdb68b62 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:29.485064 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a507a606-3e61-4ed3-a462-0f0ffdb68b62 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:29.485533 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a507a606-3e61-4ed3-a462-0f0ffdb68b62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:29.535724 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-a507a606-3e61-4ed3-a462-0f0ffdb68b62 None None] MFA Rules not processed for user `377e8696784740e1bdae7adb0db29232`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:22:29.537233 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-a507a606-3e61-4ed3-a462-0f0ffdb68b62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:29.540088 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73997a70-49e6-4e7c-9205-b4114756cc85 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:29.618675 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954077c1-35e9-4bae-bb44-5e02774eb765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:29.619617 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954077c1-35e9-4bae-bb44-5e02774eb765 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:29.620059 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954077c1-35e9-4bae-bb44-5e02774eb765 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:29.620644 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954077c1-35e9-4bae-bb44-5e02774eb765 admin admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:29.621346 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954077c1-35e9-4bae-bb44-5e02774eb765 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:29.623475 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954077c1-35e9-4bae-bb44-5e02774eb765 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:29.631475 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1263/2515] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:22:29 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:22:29.641669 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a507a606-3e61-4ed3-a462-0f0ffdb68b62 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:29.643865 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-a507a606-3e61-4ed3-a462-0f0ffdb68b62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:29.656100 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1253/2516] 10.222.0.43 () {60 vars in 1143 bytes} [Wed Jun 22 10:22:29 2022] POST /identity/v3/users => generated 311 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:22:29.662466 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954077c1-35e9-4bae-bb44-5e02774eb765 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:29.675072 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954077c1-35e9-4bae-bb44-5e02774eb765 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:29.680984 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd97ff3-aef0-4e4f-acee-0c70e7491616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:29.681957 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd97ff3-aef0-4e4f-acee-0c70e7491616 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:29.682531 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd97ff3-aef0-4e4f-acee-0c70e7491616 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:29.682986 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd97ff3-aef0-4e4f-acee-0c70e7491616 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:29.683959 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd97ff3-aef0-4e4f-acee-0c70e7491616 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:29.688029 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd97ff3-aef0-4e4f-acee-0c70e7491616 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:29.694518 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:22:29.706257 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1254/2517] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:22:29 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:22:29.708876 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd97ff3-aef0-4e4f-acee-0c70e7491616 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:29.722334 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd97ff3-aef0-4e4f-acee-0c70e7491616 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:29.727737 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dacb9b-f68d-406b-8162-39c528a86fd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:29.728903 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dacb9b-f68d-406b-8162-39c528a86fd9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:29.729429 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dacb9b-f68d-406b-8162-39c528a86fd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:29.729727 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dacb9b-f68d-406b-8162-39c528a86fd9 admin admin] PATH_INFO: `/v3/projects/624168a7e2464a97a4f03dbd95391178/users/0ab2e7e0d6ab4d0099b898e8f8fc80b6/roles/26d9c2ab5dfc4e6d9ca80c6014123906` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:29.736908 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a507a606-3e61-4ed3-a462-0f0ffdb68b62 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:29.742316 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d0d55d-ddf2-40a2-b50a-6968c1603806 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bbcb3d4dc704dfdb0097abc594ca855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:29.743290 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d0d55d-ddf2-40a2-b50a-6968c1603806 service cinder] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:29.743714 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d0d55d-ddf2-40a2-b50a-6968c1603806 service cinder] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:29.744145 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d0d55d-ddf2-40a2-b50a-6968c1603806 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:29.754851 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:22:29.764216 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d0d55d-ddf2-40a2-b50a-6968c1603806 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:29.767515 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d0d55d-ddf2-40a2-b50a-6968c1603806 service cinder] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:29.784796 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1264/2518] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:22:29 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 10:22:29.799937 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dacb9b-f68d-406b-8162-39c528a86fd9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=624168a7e2464a97a4f03dbd95391178, user_id=0ab2e7e0d6ab4d0099b898e8f8fc80b6, role_id=26d9c2ab5dfc4e6d9ca80c6014123906)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:29.809655 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dacb9b-f68d-406b-8162-39c528a86fd9 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:29.857382 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d0d55d-ddf2-40a2-b50a-6968c1603806 service cinder] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:29.868409 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1255/2519] 10.222.0.43 () {60 vars in 1482 bytes} [Wed Jun 22 10:22:29 2022] PUT /identity/v3/projects/624168a7e2464a97a4f03dbd95391178/users/0ab2e7e0d6ab4d0099b898e8f8fc80b6/roles/26d9c2ab5dfc4e6d9ca80c6014123906 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:22:29.888567 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d0d55d-ddf2-40a2-b50a-6968c1603806 service cinder] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:29.900730 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dacb9b-f68d-406b-8162-39c528a86fd9 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:30.044110 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dacb9b-f68d-406b-8162-39c528a86fd9 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:30.052797 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5101f2a7-5fbf-471f-a690-48da06630328 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bbcb3d4dc704dfdb0097abc594ca855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:30.053806 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5101f2a7-5fbf-471f-a690-48da06630328 service cinder] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:30.054286 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5101f2a7-5fbf-471f-a690-48da06630328 service cinder] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:30.054770 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5101f2a7-5fbf-471f-a690-48da06630328 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:30.086293 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cd920f-56df-4e2c-acb9-bf545c908ae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:30.092179 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cd920f-56df-4e2c-acb9-bf545c908ae9 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:30.092511 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cd920f-56df-4e2c-acb9-bf545c908ae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:30.092826 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cd920f-56df-4e2c-acb9-bf545c908ae9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:30.093929 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cd920f-56df-4e2c-acb9-bf545c908ae9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:30.095584 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cd920f-56df-4e2c-acb9-bf545c908ae9 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:30.136773 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1265/2520] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:22:29 2022] GET /identity/v3/roles => generated 1420 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:22:30.140861 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cd920f-56df-4e2c-acb9-bf545c908ae9 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:30.160361 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cd920f-56df-4e2c-acb9-bf545c908ae9 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:30.173607 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef99bb4e-2be2-4a61-98ec-6d7aa81def86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:30.174553 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef99bb4e-2be2-4a61-98ec-6d7aa81def86 admin admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:30.174833 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef99bb4e-2be2-4a61-98ec-6d7aa81def86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:30.175153 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef99bb4e-2be2-4a61-98ec-6d7aa81def86 admin admin] PATH_INFO: `/v3/projects/624168a7e2464a97a4f03dbd95391178/users/0ab2e7e0d6ab4d0099b898e8f8fc80b6/roles/26d9c2ab5dfc4e6d9ca80c6014123906` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:30.180864 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef99bb4e-2be2-4a61-98ec-6d7aa81def86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=624168a7e2464a97a4f03dbd95391178, user_id=0ab2e7e0d6ab4d0099b898e8f8fc80b6, role_id=26d9c2ab5dfc4e6d9ca80c6014123906)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:30.181958 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5101f2a7-5fbf-471f-a690-48da06630328 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:30.183956 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5101f2a7-5fbf-471f-a690-48da06630328 service cinder] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:30.187358 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef99bb4e-2be2-4a61-98ec-6d7aa81def86 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:30.197763 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1256/2521] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:22:29 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:22:30.216161 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1266/2522] 10.222.0.43 () {60 vars in 1482 bytes} [Wed Jun 22 10:22:30 2022] PUT /identity/v3/projects/624168a7e2464a97a4f03dbd95391178/users/0ab2e7e0d6ab4d0099b898e8f8fc80b6/roles/26d9c2ab5dfc4e6d9ca80c6014123906 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:22:30.229865 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d429e139-9b97-432b-a423-2bee5ad9f076 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:30.230425 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d429e139-9b97-432b-a423-2bee5ad9f076 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:30.230796 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d429e139-9b97-432b-a423-2bee5ad9f076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:30.281797 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-d429e139-9b97-432b-a423-2bee5ad9f076 None None] MFA Rules not processed for user `0ab2e7e0d6ab4d0099b898e8f8fc80b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:22:30.283145 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-d429e139-9b97-432b-a423-2bee5ad9f076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:30.422249 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1257/2523] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:22:30 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:22:30.435716 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef99bb4e-2be2-4a61-98ec-6d7aa81def86 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:30.438842 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-ef99bb4e-2be2-4a61-98ec-6d7aa81def86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:30.532344 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef99bb4e-2be2-4a61-98ec-6d7aa81def86 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:30.537103 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0f4f34-1bd8-4ce5-b977-42a68d95aaa9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bbcb3d4dc704dfdb0097abc594ca855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:30.537983 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0f4f34-1bd8-4ce5-b977-42a68d95aaa9 service cinder] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:30.538307 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0f4f34-1bd8-4ce5-b977-42a68d95aaa9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:30.538666 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0f4f34-1bd8-4ce5-b977-42a68d95aaa9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:30.550744 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0f4f34-1bd8-4ce5-b977-42a68d95aaa9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:30.552256 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0f4f34-1bd8-4ce5-b977-42a68d95aaa9 service cinder] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:30.564981 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1267/2524] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:22:30 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 10:22:30.740179 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d429e139-9b97-432b-a423-2bee5ad9f076 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:30.750067 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d429e139-9b97-432b-a423-2bee5ad9f076 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:30.753581 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dffbb8-cb45-424b-a753-0eefe469c656 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bbcb3d4dc704dfdb0097abc594ca855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:30.754261 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dffbb8-cb45-424b-a753-0eefe469c656 service cinder] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:30.754542 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dffbb8-cb45-424b-a753-0eefe469c656 service cinder] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:30.754816 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dffbb8-cb45-424b-a753-0eefe469c656 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:30.768260 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:22:30.820536 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dffbb8-cb45-424b-a753-0eefe469c656 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:30.822065 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dffbb8-cb45-424b-a753-0eefe469c656 service cinder] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:30.832044 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1258/2525] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:22:30 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:22:30.990954 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6065095c-14c3-44db-96d3-36e27183b573 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:30.991298 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6065095c-14c3-44db-96d3-36e27183b573 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:30.991563 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6065095c-14c3-44db-96d3-36e27183b573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:31.011528 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-6065095c-14c3-44db-96d3-36e27183b573 None None] MFA Rules not processed for user `b2d3aa18a0a146808f584127411a1cf5`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:22:31.012743 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-6065095c-14c3-44db-96d3-36e27183b573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:31.080369 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1268/2526] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:22:30 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:22:31.437054 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dffbb8-cb45-424b-a753-0eefe469c656 service cinder] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:31.440582 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-78dffbb8-cb45-424b-a753-0eefe469c656 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:31.505896 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dffbb8-cb45-424b-a753-0eefe469c656 service cinder] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:31.509825 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c412b1-d935-4a28-b6c6-778b99709263 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe93d4c0737249fd8623bb5ce188e34e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:31.510732 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c412b1-d935-4a28-b6c6-778b99709263 service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:31.511160 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c412b1-d935-4a28-b6c6-778b99709263 service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:31.511520 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c412b1-d935-4a28-b6c6-778b99709263 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:31.513970 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-b0c412b1-d935-4a28-b6c6-778b99709263 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:31.527810 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c412b1-d935-4a28-b6c6-778b99709263 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:31.529285 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c412b1-d935-4a28-b6c6-778b99709263 service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:31.538209 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1259/2527] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:22:31 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:22:32.873013 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6065095c-14c3-44db-96d3-36e27183b573 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:32.875482 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-6065095c-14c3-44db-96d3-36e27183b573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:32.888332 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6065095c-14c3-44db-96d3-36e27183b573 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:32.893269 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58268da7-fd8e-4cd7-8252-2ad40d807d7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe93d4c0737249fd8623bb5ce188e34e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:32.893951 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58268da7-fd8e-4cd7-8252-2ad40d807d7f service neutron] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:32.894239 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58268da7-fd8e-4cd7-8252-2ad40d807d7f service neutron] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:32.894518 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58268da7-fd8e-4cd7-8252-2ad40d807d7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:32.896334 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-58268da7-fd8e-4cd7-8252-2ad40d807d7f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:32.923601 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:22:32.975006 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58268da7-fd8e-4cd7-8252-2ad40d807d7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:32.976481 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58268da7-fd8e-4cd7-8252-2ad40d807d7f service neutron] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:32.988381 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1269/2528] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:22:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:22:36.984361 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c412b1-d935-4a28-b6c6-778b99709263 service neutron] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:36.985873 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-b0c412b1-d935-4a28-b6c6-778b99709263 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:37.079570 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58268da7-fd8e-4cd7-8252-2ad40d807d7f service neutron] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:37.081233 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-58268da7-fd8e-4cd7-8252-2ad40d807d7f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:37.095675 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58268da7-fd8e-4cd7-8252-2ad40d807d7f service neutron] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:37.108296 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6bd5e4-895c-48ee-ba0d-c2ee4a26e3fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:37.109480 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6bd5e4-895c-48ee-ba0d-c2ee4a26e3fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:37.109878 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6bd5e4-895c-48ee-ba0d-c2ee4a26e3fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:37.110102 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6bd5e4-895c-48ee-ba0d-c2ee4a26e3fc admin admin] PATH_INFO: `/v3/users/75753b29a78640df9622d4e2655baf9b` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:37.111501 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6bd5e4-895c-48ee-ba0d-c2ee4a26e3fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=75753b29a78640df9622d4e2655baf9b)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:37.113972 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6bd5e4-895c-48ee-ba0d-c2ee4a26e3fc admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:37.143788 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c412b1-d935-4a28-b6c6-778b99709263 service neutron] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:37.151898 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2ef4b8-320a-44ba-8b41-aca333db7822 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '341ec95408c94dae8539ccff7225e3ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:37.152612 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2ef4b8-320a-44ba-8b41-aca333db7822 service placement] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:37.152864 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2ef4b8-320a-44ba-8b41-aca333db7822 service placement] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:37.153190 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2ef4b8-320a-44ba-8b41-aca333db7822 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:37.158739 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-4c2ef4b8-320a-44ba-8b41-aca333db7822 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:37.185802 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2ef4b8-320a-44ba-8b41-aca333db7822 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:37.189570 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2ef4b8-320a-44ba-8b41-aca333db7822 service placement] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:37.193005 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-ae6bd5e4-895c-48ee-ba0d-c2ee4a26e3fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75753b29a78640df9622d4e2655baf9b'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:37.212436 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1260/2529] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:22:36 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:22:37.218752 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-ae6bd5e4-895c-48ee-ba0d-c2ee4a26e3fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75753b29a78640df9622d4e2655baf9b'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:37.236298 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-ae6bd5e4-895c-48ee-ba0d-c2ee4a26e3fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75753b29a78640df9622d4e2655baf9b'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:37.254295 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-ae6bd5e4-895c-48ee-ba0d-c2ee4a26e3fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75753b29a78640df9622d4e2655baf9b'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:37.256200 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-ae6bd5e4-895c-48ee-ba0d-c2ee4a26e3fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75753b29a78640df9622d4e2655baf9b'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:37.268147 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1270/2530] 10.222.0.43 () {58 vars in 1223 bytes} [Wed Jun 22 10:22:37 2022] DELETE /identity/v3/users/75753b29a78640df9622d4e2655baf9b => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:22:37.645225 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2ef4b8-320a-44ba-8b41-aca333db7822 service placement] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:37.656976 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2ef4b8-320a-44ba-8b41-aca333db7822 service placement] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:37.718605 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:22:37.737038 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a8b463-0db1-479f-9c56-c1dc2caabb00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:37.738132 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a8b463-0db1-479f-9c56-c1dc2caabb00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:37.738415 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a8b463-0db1-479f-9c56-c1dc2caabb00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:37.738692 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a8b463-0db1-479f-9c56-c1dc2caabb00 admin admin] PATH_INFO: `/v3/projects/5ee9d603d9cc4a8797f55d544f189720` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:37.739884 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a8b463-0db1-479f-9c56-c1dc2caabb00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ee9d603d9cc4a8797f55d544f189720)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:37.741826 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a8b463-0db1-479f-9c56-c1dc2caabb00 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:37.803935 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-d3a8b463-0db1-479f-9c56-c1dc2caabb00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ee9d603d9cc4a8797f55d544f189720', 'request_id': 'req-d3a8b463-0db1-479f-9c56-c1dc2caabb00'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:37.809843 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-d3a8b463-0db1-479f-9c56-c1dc2caabb00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ee9d603d9cc4a8797f55d544f189720', 'request_id': 'req-d3a8b463-0db1-479f-9c56-c1dc2caabb00'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:37.818005 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-d3a8b463-0db1-479f-9c56-c1dc2caabb00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ee9d603d9cc4a8797f55d544f189720', 'request_id': 'req-d3a8b463-0db1-479f-9c56-c1dc2caabb00'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:37.831011 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-d3a8b463-0db1-479f-9c56-c1dc2caabb00 admin admin] The token cache is being invalidate because project 5ee9d603d9cc4a8797f55d544f189720 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:22:37.831355 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-d3a8b463-0db1-479f-9c56-c1dc2caabb00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:37.832481 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-d3a8b463-0db1-479f-9c56-c1dc2caabb00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:37.836739 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1261/2531] 10.222.0.43 () {58 vars in 1232 bytes} [Wed Jun 22 10:22:37 2022] DELETE /identity/v3/projects/5ee9d603d9cc4a8797f55d544f189720 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:22:37.838525 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c51fa91-2269-4088-8293-bdd368efdaba None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:37.838814 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c51fa91-2269-4088-8293-bdd368efdaba None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:37.839090 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c51fa91-2269-4088-8293-bdd368efdaba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:37.858657 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-3c51fa91-2269-4088-8293-bdd368efdaba None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:22:37.859876 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-3c51fa91-2269-4088-8293-bdd368efdaba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:37.935544 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1271/2532] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:22:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:22:37.943122 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3bdd8d-84eb-4aef-9b34-a560a8bdc945 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:37.943414 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3bdd8d-84eb-4aef-9b34-a560a8bdc945 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:37.943695 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3bdd8d-84eb-4aef-9b34-a560a8bdc945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:37.963323 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-0a3bdd8d-84eb-4aef-9b34-a560a8bdc945 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:22:37.964566 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-0a3bdd8d-84eb-4aef-9b34-a560a8bdc945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:37.974263 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1262/2533] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:22:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:22:37.978857 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c51fa91-2269-4088-8293-bdd368efdaba None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:37.989352 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c51fa91-2269-4088-8293-bdd368efdaba None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:37.994517 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d522236-3bf7-4138-b060-7e6ced135ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:37.995191 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d522236-3bf7-4138-b060-7e6ced135ab7 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:37.995479 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d522236-3bf7-4138-b060-7e6ced135ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:37.995757 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d522236-3bf7-4138-b060-7e6ced135ab7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:37.996492 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d522236-3bf7-4138-b060-7e6ced135ab7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:22:37.996799 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d522236-3bf7-4138-b060-7e6ced135ab7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:37.998525 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d522236-3bf7-4138-b060-7e6ced135ab7 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:38.012349 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1272/2534] 10.222.0.43 () {58 vars in 1152 bytes} [Wed Jun 22 10:22:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:22:38.017577 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3bdd8d-84eb-4aef-9b34-a560a8bdc945 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:38.026960 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3bdd8d-84eb-4aef-9b34-a560a8bdc945 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:38.032558 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d14a15-c945-4639-b5fa-864d33db7316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:38.033241 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d14a15-c945-4639-b5fa-864d33db7316 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:38.033510 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d14a15-c945-4639-b5fa-864d33db7316 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:38.033839 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d14a15-c945-4639-b5fa-864d33db7316 admin admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:38.034542 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d14a15-c945-4639-b5fa-864d33db7316 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:38.036502 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d14a15-c945-4639-b5fa-864d33db7316 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:38.062231 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1263/2535] 10.222.0.43 () {60 vars in 1152 bytes} [Wed Jun 22 10:22:38 2022] POST /identity/v3/projects => generated 369 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:22:38.066516 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d522236-3bf7-4138-b060-7e6ced135ab7 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:38.076391 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d522236-3bf7-4138-b060-7e6ced135ab7 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:38.096535 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:22:38.146794 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cf8bfe-715d-49ec-9c09-c45b9ab27736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:38.147461 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cf8bfe-715d-49ec-9c09-c45b9ab27736 admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:38.147744 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cf8bfe-715d-49ec-9c09-c45b9ab27736 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:38.148022 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cf8bfe-715d-49ec-9c09-c45b9ab27736 admin admin] PATH_INFO: `/v3/users` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:38.148716 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cf8bfe-715d-49ec-9c09-c45b9ab27736 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:38.150747 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cf8bfe-715d-49ec-9c09-c45b9ab27736 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:38.171946 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1273/2536] 10.222.0.43 () {60 vars in 1143 bytes} [Wed Jun 22 10:22:38 2022] POST /identity/v3/users => generated 285 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:22:38.176369 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d14a15-c945-4639-b5fa-864d33db7316 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:38.190588 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d14a15-c945-4639-b5fa-864d33db7316 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:38.196733 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8433121c-1a9c-4425-8c92-ab0b73178835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:38.198026 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8433121c-1a9c-4425-8c92-ab0b73178835 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:38.198318 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8433121c-1a9c-4425-8c92-ab0b73178835 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:38.198606 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8433121c-1a9c-4425-8c92-ab0b73178835 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:38.199354 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8433121c-1a9c-4425-8c92-ab0b73178835 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:38.202243 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8433121c-1a9c-4425-8c92-ab0b73178835 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:38.215687 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1264/2537] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:22:38 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:22:38.220830 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cf8bfe-715d-49ec-9c09-c45b9ab27736 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:38.233286 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cf8bfe-715d-49ec-9c09-c45b9ab27736 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:38.238997 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be91f6f2-0f4a-4ad4-8061-71793e04dfa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:38.240311 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be91f6f2-0f4a-4ad4-8061-71793e04dfa5 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:38.240657 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be91f6f2-0f4a-4ad4-8061-71793e04dfa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:38.240947 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be91f6f2-0f4a-4ad4-8061-71793e04dfa5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:38.241767 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be91f6f2-0f4a-4ad4-8061-71793e04dfa5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:38.243511 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be91f6f2-0f4a-4ad4-8061-71793e04dfa5 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:38.255865 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1274/2538] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:22:38 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:22:38.260241 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8433121c-1a9c-4425-8c92-ab0b73178835 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:38.274423 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8433121c-1a9c-4425-8c92-ab0b73178835 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:38.281268 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920d22f1-6fe5-4577-b394-b15d20c1e9f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:38.282660 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920d22f1-6fe5-4577-b394-b15d20c1e9f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:38.283068 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920d22f1-6fe5-4577-b394-b15d20c1e9f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:38.283447 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920d22f1-6fe5-4577-b394-b15d20c1e9f5 admin admin] PATH_INFO: `/v3/projects/0dfa367fdc3c49e890e97a6aa299f77f/users/7ddd6142815c48b5b76f7f34984a59d5/roles/9f88c83743f745a9a785a2f454753f06` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:38.303168 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920d22f1-6fe5-4577-b394-b15d20c1e9f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0dfa367fdc3c49e890e97a6aa299f77f, user_id=7ddd6142815c48b5b76f7f34984a59d5, role_id=9f88c83743f745a9a785a2f454753f06)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:38.306801 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920d22f1-6fe5-4577-b394-b15d20c1e9f5 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:38.324987 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1265/2539] 10.222.0.43 () {60 vars in 1482 bytes} [Wed Jun 22 10:22:38 2022] PUT /identity/v3/projects/0dfa367fdc3c49e890e97a6aa299f77f/users/7ddd6142815c48b5b76f7f34984a59d5/roles/9f88c83743f745a9a785a2f454753f06 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:22:38.336525 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d50114-22e4-4f2f-8ee2-ffdd25da19bc None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:38.336814 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d50114-22e4-4f2f-8ee2-ffdd25da19bc None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:38.337336 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d50114-22e4-4f2f-8ee2-ffdd25da19bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:38.372309 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-74d50114-22e4-4f2f-8ee2-ffdd25da19bc None None] MFA Rules not processed for user `7ddd6142815c48b5b76f7f34984a59d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:22:38.373815 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-74d50114-22e4-4f2f-8ee2-ffdd25da19bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:38.441072 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920d22f1-6fe5-4577-b394-b15d20c1e9f5 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:38.442988 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-920d22f1-6fe5-4577-b394-b15d20c1e9f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:38.457377 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1275/2540] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:22:38 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:22:38.461586 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d50114-22e4-4f2f-8ee2-ffdd25da19bc None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:38.526267 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920d22f1-6fe5-4577-b394-b15d20c1e9f5 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:38.532249 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d7d117-a37f-4bf5-8ff9-b9b875d13944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:38.533139 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d7d117-a37f-4bf5-8ff9-b9b875d13944 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:38.533426 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d7d117-a37f-4bf5-8ff9-b9b875d13944 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:38.533750 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d7d117-a37f-4bf5-8ff9-b9b875d13944 admin admin] PATH_INFO: `/v3/users/290832423c674230a936ab3308e0136e` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:38.535745 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d7d117-a37f-4bf5-8ff9-b9b875d13944 admin admin] RBAC: Authorizing `identity:delete_user(user_id=290832423c674230a936ab3308e0136e)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:38.537751 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d7d117-a37f-4bf5-8ff9-b9b875d13944 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:38.539327 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d50114-22e4-4f2f-8ee2-ffdd25da19bc None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:38.544559 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb27e37-c23e-4bd4-9409-2e8ccbf4052d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:38.545132 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb27e37-c23e-4bd4-9409-2e8ccbf4052d admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:38.546342 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb27e37-c23e-4bd4-9409-2e8ccbf4052d admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:38.546641 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb27e37-c23e-4bd4-9409-2e8ccbf4052d admin admin] PATH_INFO: `/v3/projects` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:38.547501 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb27e37-c23e-4bd4-9409-2e8ccbf4052d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:38.549421 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb27e37-c23e-4bd4-9409-2e8ccbf4052d admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:38.554690 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=89,keystone:DELETE=8,keystone:INSERT=3 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:22:38.583697 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1276/2541] 10.222.0.43 () {60 vars in 1152 bytes} [Wed Jun 22 10:22:38 2022] POST /identity/v3/projects => generated 369 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 10:22:38.588775 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb27e37-c23e-4bd4-9409-2e8ccbf4052d admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:38.592978 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-27d7d117-a37f-4bf5-8ff9-b9b875d13944 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '290832423c674230a936ab3308e0136e'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:38.601856 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:22:38.606945 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-27d7d117-a37f-4bf5-8ff9-b9b875d13944 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '290832423c674230a936ab3308e0136e'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:38.617174 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-27d7d117-a37f-4bf5-8ff9-b9b875d13944 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '290832423c674230a936ab3308e0136e'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:38.617956 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-27d7d117-a37f-4bf5-8ff9-b9b875d13944 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '290832423c674230a936ab3308e0136e'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:38.625589 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-27d7d117-a37f-4bf5-8ff9-b9b875d13944 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '290832423c674230a936ab3308e0136e'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:38.633112 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1266/2542] 10.222.0.43 () {58 vars in 1223 bytes} [Wed Jun 22 10:22:38 2022] DELETE /identity/v3/users/290832423c674230a936ab3308e0136e => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:22:38.637929 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d203c0a-7768-42d1-a820-10049c8b25e8 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:38.638086 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d203c0a-7768-42d1-a820-10049c8b25e8 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:38.638470 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d203c0a-7768-42d1-a820-10049c8b25e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:38.657737 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb27e37-c23e-4bd4-9409-2e8ccbf4052d admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:38.658518 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-0d203c0a-7768-42d1-a820-10049c8b25e8 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:22:38.659728 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-0d203c0a-7768-42d1-a820-10049c8b25e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:38.718253 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2376486-2731-40bb-8d5e-16a90fe680f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:38.718937 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2376486-2731-40bb-8d5e-16a90fe680f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:38.719260 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2376486-2731-40bb-8d5e-16a90fe680f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:38.719500 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2376486-2731-40bb-8d5e-16a90fe680f0 admin admin] PATH_INFO: `/v3/users` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:38.720194 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2376486-2731-40bb-8d5e-16a90fe680f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:38.722155 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2376486-2731-40bb-8d5e-16a90fe680f0 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:38.728407 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1267/2543] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:22:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:22:38.738832 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d203c0a-7768-42d1-a820-10049c8b25e8 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:38.740219 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-0d203c0a-7768-42d1-a820-10049c8b25e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:38.743089 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1277/2544] 10.222.0.43 () {60 vars in 1143 bytes} [Wed Jun 22 10:22:38 2022] POST /identity/v3/users => generated 291 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:22:38.746838 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2376486-2731-40bb-8d5e-16a90fe680f0 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:38.748440 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-b2376486-2731-40bb-8d5e-16a90fe680f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:38.760677 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2376486-2731-40bb-8d5e-16a90fe680f0 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:38.765439 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7245eb3-d65f-4212-a80a-6871dc3eeabe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:38.766144 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7245eb3-d65f-4212-a80a-6871dc3eeabe admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:38.766429 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7245eb3-d65f-4212-a80a-6871dc3eeabe admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:38.766703 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7245eb3-d65f-4212-a80a-6871dc3eeabe admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:38.767430 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7245eb3-d65f-4212-a80a-6871dc3eeabe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:38.769031 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7245eb3-d65f-4212-a80a-6871dc3eeabe admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:38.779204 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1278/2545] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:22:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:22:38.786883 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7245eb3-d65f-4212-a80a-6871dc3eeabe admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:38.797152 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7245eb3-d65f-4212-a80a-6871dc3eeabe admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:38.802193 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3717f75-3695-4f12-922b-9796a225bfd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:38.803084 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3717f75-3695-4f12-922b-9796a225bfd0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:38.803369 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3717f75-3695-4f12-922b-9796a225bfd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:38.803769 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3717f75-3695-4f12-922b-9796a225bfd0 admin admin] PATH_INFO: `/v3/projects/ea387cae555e43e1b4aea3bc464ad90e/users/e5ad79b9087e48fabefbc7784c09da07/roles/26d9c2ab5dfc4e6d9ca80c6014123906` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:38.804595 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d203c0a-7768-42d1-a820-10049c8b25e8 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:38.808175 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e6cb62-cbb8-4a19-85fd-05ff25b6b8ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe93d4c0737249fd8623bb5ce188e34e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:38.808814 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e6cb62-cbb8-4a19-85fd-05ff25b6b8ec service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:38.809097 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e6cb62-cbb8-4a19-85fd-05ff25b6b8ec service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:38.809375 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e6cb62-cbb8-4a19-85fd-05ff25b6b8ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:38.818859 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e6cb62-cbb8-4a19-85fd-05ff25b6b8ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:38.819907 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3717f75-3695-4f12-922b-9796a225bfd0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea387cae555e43e1b4aea3bc464ad90e, user_id=e5ad79b9087e48fabefbc7784c09da07, role_id=26d9c2ab5dfc4e6d9ca80c6014123906)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:38.820290 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e6cb62-cbb8-4a19-85fd-05ff25b6b8ec service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:38.822756 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3717f75-3695-4f12-922b-9796a225bfd0 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:38.831003 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1268/2546] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:22:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:22:38.839808 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1279/2547] 10.222.0.43 () {60 vars in 1482 bytes} [Wed Jun 22 10:22:38 2022] PUT /identity/v3/projects/ea387cae555e43e1b4aea3bc464ad90e/users/e5ad79b9087e48fabefbc7784c09da07/roles/26d9c2ab5dfc4e6d9ca80c6014123906 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:22:38.843874 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e6cb62-cbb8-4a19-85fd-05ff25b6b8ec service neutron] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:38.853683 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e6cb62-cbb8-4a19-85fd-05ff25b6b8ec service neutron] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:38.888991 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:22:38.926727 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114c7f94-112e-4fee-b847-3de115fba296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:38.927500 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114c7f94-112e-4fee-b847-3de115fba296 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:38.927925 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114c7f94-112e-4fee-b847-3de115fba296 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:38.928260 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114c7f94-112e-4fee-b847-3de115fba296 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:38.929004 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114c7f94-112e-4fee-b847-3de115fba296 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:38.930660 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114c7f94-112e-4fee-b847-3de115fba296 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:38.946679 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1269/2548] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:22:38 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:22:38.951526 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3717f75-3695-4f12-922b-9796a225bfd0 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:38.963906 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3717f75-3695-4f12-922b-9796a225bfd0 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:38.969902 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce9e11f-6581-4b5f-a94d-147cdf6d1500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:38.970805 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce9e11f-6581-4b5f-a94d-147cdf6d1500 admin admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:38.971094 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce9e11f-6581-4b5f-a94d-147cdf6d1500 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:38.971378 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce9e11f-6581-4b5f-a94d-147cdf6d1500 admin admin] PATH_INFO: `/v3/projects/ea387cae555e43e1b4aea3bc464ad90e/users/e5ad79b9087e48fabefbc7784c09da07/roles/26d9c2ab5dfc4e6d9ca80c6014123906` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:38.973464 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce9e11f-6581-4b5f-a94d-147cdf6d1500 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea387cae555e43e1b4aea3bc464ad90e, user_id=e5ad79b9087e48fabefbc7784c09da07, role_id=26d9c2ab5dfc4e6d9ca80c6014123906)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:38.976312 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce9e11f-6581-4b5f-a94d-147cdf6d1500 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:38.994741 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1280/2549] 10.222.0.43 () {60 vars in 1482 bytes} [Wed Jun 22 10:22:38 2022] PUT /identity/v3/projects/ea387cae555e43e1b4aea3bc464ad90e/users/e5ad79b9087e48fabefbc7784c09da07/roles/26d9c2ab5dfc4e6d9ca80c6014123906 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:22:39.005320 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f886b76-8aef-47a3-b7c9-2bbc5ef86292 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:39.005888 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f886b76-8aef-47a3-b7c9-2bbc5ef86292 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:39.006175 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f886b76-8aef-47a3-b7c9-2bbc5ef86292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:39.039616 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-4f886b76-8aef-47a3-b7c9-2bbc5ef86292 None None] MFA Rules not processed for user `e5ad79b9087e48fabefbc7784c09da07`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:22:39.040994 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-4f886b76-8aef-47a3-b7c9-2bbc5ef86292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:39.126810 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1270/2550] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:22:39 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:22:39.138554 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce9e11f-6581-4b5f-a94d-147cdf6d1500 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:39.139152 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f886b76-8aef-47a3-b7c9-2bbc5ef86292 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:39.140518 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-cce9e11f-6581-4b5f-a94d-147cdf6d1500 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:39.140633 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-4f886b76-8aef-47a3-b7c9-2bbc5ef86292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:39.201648 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce9e11f-6581-4b5f-a94d-147cdf6d1500 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:39.205732 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd27498-fb2b-433d-a474-e01f9a827240 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bbcb3d4dc704dfdb0097abc594ca855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:39.206381 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd27498-fb2b-433d-a474-e01f9a827240 service cinder] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:39.206690 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd27498-fb2b-433d-a474-e01f9a827240 service cinder] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:39.206967 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd27498-fb2b-433d-a474-e01f9a827240 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:39.215645 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f886b76-8aef-47a3-b7c9-2bbc5ef86292 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:39.215891 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd27498-fb2b-433d-a474-e01f9a827240 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:39.217951 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd27498-fb2b-433d-a474-e01f9a827240 service cinder] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:39.220939 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a924e42-9d74-4d5a-a6bf-7c8a897ac2a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:39.221819 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a924e42-9d74-4d5a-a6bf-7c8a897ac2a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:39.222109 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a924e42-9d74-4d5a-a6bf-7c8a897ac2a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:39.222392 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a924e42-9d74-4d5a-a6bf-7c8a897ac2a8 admin admin] PATH_INFO: `/v3/projects/ba12e528403f4c128f36be8756372604` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:39.223605 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a924e42-9d74-4d5a-a6bf-7c8a897ac2a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba12e528403f4c128f36be8756372604)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:39.225514 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a924e42-9d74-4d5a-a6bf-7c8a897ac2a8 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:39.227857 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1281/2551] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:22:39 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:22:39.294743 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-6a924e42-9d74-4d5a-a6bf-7c8a897ac2a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba12e528403f4c128f36be8756372604', 'request_id': 'req-6a924e42-9d74-4d5a-a6bf-7c8a897ac2a8'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:39.300937 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-6a924e42-9d74-4d5a-a6bf-7c8a897ac2a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba12e528403f4c128f36be8756372604', 'request_id': 'req-6a924e42-9d74-4d5a-a6bf-7c8a897ac2a8'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:39.302654 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:22:39.312036 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-6a924e42-9d74-4d5a-a6bf-7c8a897ac2a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba12e528403f4c128f36be8756372604', 'request_id': 'req-6a924e42-9d74-4d5a-a6bf-7c8a897ac2a8'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:39.326045 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-6a924e42-9d74-4d5a-a6bf-7c8a897ac2a8 admin admin] The token cache is being invalidate because project ba12e528403f4c128f36be8756372604 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:22:39.326419 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-6a924e42-9d74-4d5a-a6bf-7c8a897ac2a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:39.327625 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-6a924e42-9d74-4d5a-a6bf-7c8a897ac2a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:39.329290 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1271/2552] 10.222.0.43 () {58 vars in 1232 bytes} [Wed Jun 22 10:22:39 2022] DELETE /identity/v3/projects/ba12e528403f4c128f36be8756372604 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:22:39.333410 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd27498-fb2b-433d-a474-e01f9a827240 service cinder] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:39.339493 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:22:39.348146 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd27498-fb2b-433d-a474-e01f9a827240 service cinder] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:39.420121 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af75ee1d-e74e-48a2-bc66-05a72e3fb714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:39.421643 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af75ee1d-e74e-48a2-bc66-05a72e3fb714 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:39.421961 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af75ee1d-e74e-48a2-bc66-05a72e3fb714 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:39.422246 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af75ee1d-e74e-48a2-bc66-05a72e3fb714 admin admin] PATH_INFO: `/v3/users/0ab2e7e0d6ab4d0099b898e8f8fc80b6` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:39.423956 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af75ee1d-e74e-48a2-bc66-05a72e3fb714 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ab2e7e0d6ab4d0099b898e8f8fc80b6)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:39.425422 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af75ee1d-e74e-48a2-bc66-05a72e3fb714 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:39.495302 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-af75ee1d-e74e-48a2-bc66-05a72e3fb714 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ab2e7e0d6ab4d0099b898e8f8fc80b6'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:39.520741 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-af75ee1d-e74e-48a2-bc66-05a72e3fb714 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ab2e7e0d6ab4d0099b898e8f8fc80b6'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:39.531695 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-af75ee1d-e74e-48a2-bc66-05a72e3fb714 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ab2e7e0d6ab4d0099b898e8f8fc80b6'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:39.540298 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-af75ee1d-e74e-48a2-bc66-05a72e3fb714 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ab2e7e0d6ab4d0099b898e8f8fc80b6'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:39.541167 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-af75ee1d-e74e-48a2-bc66-05a72e3fb714 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ab2e7e0d6ab4d0099b898e8f8fc80b6'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:39.551042 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1282/2553] 10.222.0.43 () {58 vars in 1223 bytes} [Wed Jun 22 10:22:39 2022] DELETE /identity/v3/users/0ab2e7e0d6ab4d0099b898e8f8fc80b6 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:22:39.883049 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a924e42-9d74-4d5a-a6bf-7c8a897ac2a8 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:39.886117 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-6a924e42-9d74-4d5a-a6bf-7c8a897ac2a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:39.906261 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a924e42-9d74-4d5a-a6bf-7c8a897ac2a8 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:39.975105 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1c66ed-63fc-4d3a-afcf-7adae694800f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:39.975989 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1c66ed-63fc-4d3a-afcf-7adae694800f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:39.976276 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1c66ed-63fc-4d3a-afcf-7adae694800f admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:39.976803 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1c66ed-63fc-4d3a-afcf-7adae694800f admin admin] PATH_INFO: `/v3/projects/624168a7e2464a97a4f03dbd95391178` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:39.978029 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1c66ed-63fc-4d3a-afcf-7adae694800f admin admin] RBAC: Authorizing `identity:delete_project(project_id=624168a7e2464a97a4f03dbd95391178)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:39.979980 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1c66ed-63fc-4d3a-afcf-7adae694800f admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:40.035785 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-9a1c66ed-63fc-4d3a-afcf-7adae694800f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '624168a7e2464a97a4f03dbd95391178', 'request_id': 'req-9a1c66ed-63fc-4d3a-afcf-7adae694800f'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:40.044694 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-9a1c66ed-63fc-4d3a-afcf-7adae694800f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '624168a7e2464a97a4f03dbd95391178', 'request_id': 'req-9a1c66ed-63fc-4d3a-afcf-7adae694800f'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:40.054311 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-9a1c66ed-63fc-4d3a-afcf-7adae694800f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '624168a7e2464a97a4f03dbd95391178', 'request_id': 'req-9a1c66ed-63fc-4d3a-afcf-7adae694800f'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:40.066578 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-9a1c66ed-63fc-4d3a-afcf-7adae694800f admin admin] The token cache is being invalidate because project 624168a7e2464a97a4f03dbd95391178 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:22:40.066901 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-9a1c66ed-63fc-4d3a-afcf-7adae694800f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:40.067547 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-9a1c66ed-63fc-4d3a-afcf-7adae694800f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:40.069088 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1272/2554] 10.222.0.43 () {58 vars in 1232 bytes} [Wed Jun 22 10:22:39 2022] DELETE /identity/v3/projects/624168a7e2464a97a4f03dbd95391178 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:22:40.074211 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b35cfb-7c51-43e4-b4d6-ac471ba2b6c1 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:40.074524 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b35cfb-7c51-43e4-b4d6-ac471ba2b6c1 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:40.074805 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b35cfb-7c51-43e4-b4d6-ac471ba2b6c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:40.110438 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-26b35cfb-7c51-43e4-b4d6-ac471ba2b6c1 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:22:40.111667 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-26b35cfb-7c51-43e4-b4d6-ac471ba2b6c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:40.180599 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1283/2555] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:22:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:22:40.190098 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718dae16-2409-4b0b-9639-a88951abd57e None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:40.190390 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718dae16-2409-4b0b-9639-a88951abd57e None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:40.190672 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718dae16-2409-4b0b-9639-a88951abd57e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:40.209197 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-718dae16-2409-4b0b-9639-a88951abd57e None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:22:40.210456 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-718dae16-2409-4b0b-9639-a88951abd57e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:40.222063 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1273/2556] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:22:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:22:40.231187 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b35cfb-7c51-43e4-b4d6-ac471ba2b6c1 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:40.239161 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b35cfb-7c51-43e4-b4d6-ac471ba2b6c1 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:40.244963 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93c5359-ac65-42d7-b4cd-640f41aee148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:40.245650 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93c5359-ac65-42d7-b4cd-640f41aee148 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:40.246218 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93c5359-ac65-42d7-b4cd-640f41aee148 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:40.246506 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93c5359-ac65-42d7-b4cd-640f41aee148 admin admin] PATH_INFO: `/v3/domains` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:40.248591 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93c5359-ac65-42d7-b4cd-640f41aee148 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:22:40.249073 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93c5359-ac65-42d7-b4cd-640f41aee148 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:40.251296 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93c5359-ac65-42d7-b4cd-640f41aee148 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:40.264757 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1284/2557] 10.222.0.43 () {58 vars in 1152 bytes} [Wed Jun 22 10:22:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:22:40.269184 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718dae16-2409-4b0b-9639-a88951abd57e None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:40.278519 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718dae16-2409-4b0b-9639-a88951abd57e None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:40.283738 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a223bf0c-2e1a-47e4-be81-6b69cb2565ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:40.284636 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a223bf0c-2e1a-47e4-be81-6b69cb2565ea admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:40.284951 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a223bf0c-2e1a-47e4-be81-6b69cb2565ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:40.285232 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a223bf0c-2e1a-47e4-be81-6b69cb2565ea admin admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:40.285962 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a223bf0c-2e1a-47e4-be81-6b69cb2565ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:40.287911 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a223bf0c-2e1a-47e4-be81-6b69cb2565ea admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:40.326173 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1274/2558] 10.222.0.43 () {60 vars in 1152 bytes} [Wed Jun 22 10:22:40 2022] POST /identity/v3/projects => generated 377 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:22:40.327748 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93c5359-ac65-42d7-b4cd-640f41aee148 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:40.338055 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93c5359-ac65-42d7-b4cd-640f41aee148 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:40.344007 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:22:40.405873 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a2657e-5345-4fbf-95ad-eb77fc4a31a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:40.405873 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a2657e-5345-4fbf-95ad-eb77fc4a31a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:40.405873 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a2657e-5345-4fbf-95ad-eb77fc4a31a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:40.405873 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a2657e-5345-4fbf-95ad-eb77fc4a31a4 admin admin] PATH_INFO: `/v3/users` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:40.406252 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a2657e-5345-4fbf-95ad-eb77fc4a31a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:40.407707 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a2657e-5345-4fbf-95ad-eb77fc4a31a4 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:40.432238 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1285/2559] 10.222.0.43 () {60 vars in 1143 bytes} [Wed Jun 22 10:22:40 2022] POST /identity/v3/users => generated 289 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:22:40.433434 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a223bf0c-2e1a-47e4-be81-6b69cb2565ea admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:40.443819 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a223bf0c-2e1a-47e4-be81-6b69cb2565ea admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:40.449163 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ede3c4-07ce-450b-8856-f6969d9af123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:40.449963 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ede3c4-07ce-450b-8856-f6969d9af123 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:40.450348 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ede3c4-07ce-450b-8856-f6969d9af123 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:40.450693 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ede3c4-07ce-450b-8856-f6969d9af123 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:40.451591 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ede3c4-07ce-450b-8856-f6969d9af123 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:40.453621 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ede3c4-07ce-450b-8856-f6969d9af123 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:40.465732 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1275/2560] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:22:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:22:40.470611 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a2657e-5345-4fbf-95ad-eb77fc4a31a4 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:40.481328 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a2657e-5345-4fbf-95ad-eb77fc4a31a4 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:40.488234 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f10cc2c-050f-4eb4-88b3-3104d009cb5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:40.488921 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f10cc2c-050f-4eb4-88b3-3104d009cb5c admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:40.489210 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f10cc2c-050f-4eb4-88b3-3104d009cb5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:40.490606 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f10cc2c-050f-4eb4-88b3-3104d009cb5c admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:40.491364 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f10cc2c-050f-4eb4-88b3-3104d009cb5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:40.493469 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f10cc2c-050f-4eb4-88b3-3104d009cb5c admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:40.507672 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1286/2561] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:22:40 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:22:40.511933 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ede3c4-07ce-450b-8856-f6969d9af123 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:40.523561 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ede3c4-07ce-450b-8856-f6969d9af123 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:40.532637 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8095c905-efa3-4d05-a8c5-e84fa27dd608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:40.533539 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8095c905-efa3-4d05-a8c5-e84fa27dd608 admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:40.533899 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8095c905-efa3-4d05-a8c5-e84fa27dd608 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:40.534142 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8095c905-efa3-4d05-a8c5-e84fa27dd608 admin admin] PATH_INFO: `/v3/projects/41ddd20aaadc438c8bb2f5689f3d0836/users/1029e0ea7c164a798439fbff29f1098a/roles/9f88c83743f745a9a785a2f454753f06` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:40.551967 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8095c905-efa3-4d05-a8c5-e84fa27dd608 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41ddd20aaadc438c8bb2f5689f3d0836, user_id=1029e0ea7c164a798439fbff29f1098a, role_id=9f88c83743f745a9a785a2f454753f06)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:40.554682 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8095c905-efa3-4d05-a8c5-e84fa27dd608 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:40.568419 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1276/2562] 10.222.0.43 () {60 vars in 1482 bytes} [Wed Jun 22 10:22:40 2022] PUT /identity/v3/projects/41ddd20aaadc438c8bb2f5689f3d0836/users/1029e0ea7c164a798439fbff29f1098a/roles/9f88c83743f745a9a785a2f454753f06 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:22:40.582231 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee2a35e-7d84-4b4b-ae6c-55a514a50e36 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:40.582555 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee2a35e-7d84-4b4b-ae6c-55a514a50e36 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:40.582889 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee2a35e-7d84-4b4b-ae6c-55a514a50e36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:40.611095 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-eee2a35e-7d84-4b4b-ae6c-55a514a50e36 None None] MFA Rules not processed for user `1029e0ea7c164a798439fbff29f1098a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:22:40.612301 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-eee2a35e-7d84-4b4b-ae6c-55a514a50e36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:40.678283 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1287/2563] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:22:40 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:22:40.692107 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8095c905-efa3-4d05-a8c5-e84fa27dd608 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:40.692336 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-8095c905-efa3-4d05-a8c5-e84fa27dd608 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:40.711852 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:INSERT=4,keystone:DELETE=8,keystone:SELECT=88 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:22:40.762726 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee2a35e-7d84-4b4b-ae6c-55a514a50e36 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:40.764583 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-eee2a35e-7d84-4b4b-ae6c-55a514a50e36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:40.770285 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8095c905-efa3-4d05-a8c5-e84fa27dd608 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:40.774541 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59107b43-ea69-45e0-a40a-6303fe2e2d25 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2418acec46b4db48346129004827853', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:40.775365 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59107b43-ea69-45e0-a40a-6303fe2e2d25 service glance] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:40.775781 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59107b43-ea69-45e0-a40a-6303fe2e2d25 service glance] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:40.776124 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59107b43-ea69-45e0-a40a-6303fe2e2d25 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:40.785732 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59107b43-ea69-45e0-a40a-6303fe2e2d25 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:40.787150 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59107b43-ea69-45e0-a40a-6303fe2e2d25 service glance] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:40.799214 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1277/2564] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:22:40 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:22:40.863414 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee2a35e-7d84-4b4b-ae6c-55a514a50e36 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:40.868273 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9584033c-68c4-499b-99ba-178bd3cdff9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:40.869162 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9584033c-68c4-499b-99ba-178bd3cdff9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:40.869460 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9584033c-68c4-499b-99ba-178bd3cdff9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:40.869762 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9584033c-68c4-499b-99ba-178bd3cdff9b admin admin] PATH_INFO: `/v3/users/7ddd6142815c48b5b76f7f34984a59d5` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:40.870986 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9584033c-68c4-499b-99ba-178bd3cdff9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ddd6142815c48b5b76f7f34984a59d5)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:40.872931 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9584033c-68c4-499b-99ba-178bd3cdff9b admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:40.901277 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:22:40.943898 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-9584033c-68c4-499b-99ba-178bd3cdff9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ddd6142815c48b5b76f7f34984a59d5'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:40.958376 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-9584033c-68c4-499b-99ba-178bd3cdff9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ddd6142815c48b5b76f7f34984a59d5'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:40.968611 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-9584033c-68c4-499b-99ba-178bd3cdff9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ddd6142815c48b5b76f7f34984a59d5'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:40.976813 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-9584033c-68c4-499b-99ba-178bd3cdff9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ddd6142815c48b5b76f7f34984a59d5'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:40.977828 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-9584033c-68c4-499b-99ba-178bd3cdff9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ddd6142815c48b5b76f7f34984a59d5'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:40.985062 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1288/2565] 10.222.0.43 () {58 vars in 1223 bytes} [Wed Jun 22 10:22:40 2022] DELETE /identity/v3/users/7ddd6142815c48b5b76f7f34984a59d5 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:22:40.989860 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e801fe2a-e395-472a-9577-e3f1a1a9c647 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:40.990227 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e801fe2a-e395-472a-9577-e3f1a1a9c647 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:40.990855 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e801fe2a-e395-472a-9577-e3f1a1a9c647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:41.013081 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-e801fe2a-e395-472a-9577-e3f1a1a9c647 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:22:41.015108 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-e801fe2a-e395-472a-9577-e3f1a1a9c647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:41.119965 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1278/2566] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:22:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:22:41.134580 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9584033c-68c4-499b-99ba-178bd3cdff9b admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:41.136661 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-9584033c-68c4-499b-99ba-178bd3cdff9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:41.207108 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9584033c-68c4-499b-99ba-178bd3cdff9b admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:41.211062 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f9a1bf-9672-4eb0-9868-ae9c63acdff8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe93d4c0737249fd8623bb5ce188e34e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:41.211785 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f9a1bf-9672-4eb0-9868-ae9c63acdff8 service neutron] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:41.212134 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f9a1bf-9672-4eb0-9868-ae9c63acdff8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:41.212483 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f9a1bf-9672-4eb0-9868-ae9c63acdff8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:41.222417 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f9a1bf-9672-4eb0-9868-ae9c63acdff8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:41.224103 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f9a1bf-9672-4eb0-9868-ae9c63acdff8 service neutron] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:41.245766 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1289/2567] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:22:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:22:41.602146 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e801fe2a-e395-472a-9577-e3f1a1a9c647 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:41.603701 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-e801fe2a-e395-472a-9577-e3f1a1a9c647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:41.618539 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e801fe2a-e395-472a-9577-e3f1a1a9c647 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:41.624477 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0ecb26-6924-4e76-9758-5654c6755d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:41.625480 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0ecb26-6924-4e76-9758-5654c6755d40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:41.625875 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0ecb26-6924-4e76-9758-5654c6755d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:41.626157 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0ecb26-6924-4e76-9758-5654c6755d40 admin admin] PATH_INFO: `/v3/projects/0dfa367fdc3c49e890e97a6aa299f77f` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:41.627390 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0ecb26-6924-4e76-9758-5654c6755d40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0dfa367fdc3c49e890e97a6aa299f77f)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:41.629332 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0ecb26-6924-4e76-9758-5654c6755d40 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:41.680723 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-2e0ecb26-6924-4e76-9758-5654c6755d40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0dfa367fdc3c49e890e97a6aa299f77f', 'request_id': 'req-2e0ecb26-6924-4e76-9758-5654c6755d40'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:41.688857 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-2e0ecb26-6924-4e76-9758-5654c6755d40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0dfa367fdc3c49e890e97a6aa299f77f', 'request_id': 'req-2e0ecb26-6924-4e76-9758-5654c6755d40'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:41.696827 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-2e0ecb26-6924-4e76-9758-5654c6755d40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0dfa367fdc3c49e890e97a6aa299f77f', 'request_id': 'req-2e0ecb26-6924-4e76-9758-5654c6755d40'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:41.708360 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-2e0ecb26-6924-4e76-9758-5654c6755d40 admin admin] The token cache is being invalidate because project 0dfa367fdc3c49e890e97a6aa299f77f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:22:41.708657 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-2e0ecb26-6924-4e76-9758-5654c6755d40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:41.709292 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-2e0ecb26-6924-4e76-9758-5654c6755d40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:41.710888 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1279/2568] 10.222.0.43 () {58 vars in 1232 bytes} [Wed Jun 22 10:22:41 2022] DELETE /identity/v3/projects/0dfa367fdc3c49e890e97a6aa299f77f => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:22:41.715353 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f9a1bf-9672-4eb0-9868-ae9c63acdff8 service neutron] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:41.727972 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f9a1bf-9672-4eb0-9868-ae9c63acdff8 service neutron] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:41.787869 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff28d95-c8e3-4bc3-8a00-38afeb72b414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:41.788767 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff28d95-c8e3-4bc3-8a00-38afeb72b414 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:41.789045 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff28d95-c8e3-4bc3-8a00-38afeb72b414 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:41.789377 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff28d95-c8e3-4bc3-8a00-38afeb72b414 admin admin] PATH_INFO: `/v3/users/e5ad79b9087e48fabefbc7784c09da07` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:41.790580 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff28d95-c8e3-4bc3-8a00-38afeb72b414 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5ad79b9087e48fabefbc7784c09da07)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:41.792579 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff28d95-c8e3-4bc3-8a00-38afeb72b414 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:41.835378 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:22:41.841460 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-8ff28d95-c8e3-4bc3-8a00-38afeb72b414 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5ad79b9087e48fabefbc7784c09da07'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:41.856600 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-8ff28d95-c8e3-4bc3-8a00-38afeb72b414 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5ad79b9087e48fabefbc7784c09da07'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:41.865607 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-8ff28d95-c8e3-4bc3-8a00-38afeb72b414 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5ad79b9087e48fabefbc7784c09da07'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:41.872772 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-8ff28d95-c8e3-4bc3-8a00-38afeb72b414 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5ad79b9087e48fabefbc7784c09da07'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:41.874044 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-8ff28d95-c8e3-4bc3-8a00-38afeb72b414 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5ad79b9087e48fabefbc7784c09da07'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:41.880983 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1290/2569] 10.222.0.43 () {58 vars in 1223 bytes} [Wed Jun 22 10:22:41 2022] DELETE /identity/v3/users/e5ad79b9087e48fabefbc7784c09da07 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:22:42.174537 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0ecb26-6924-4e76-9758-5654c6755d40 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:42.176000 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-2e0ecb26-6924-4e76-9758-5654c6755d40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:42.204743 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0ecb26-6924-4e76-9758-5654c6755d40 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:42.247800 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:22:42.272478 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea44842-6143-4805-ad63-85aa43f0c1db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:42.273382 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea44842-6143-4805-ad63-85aa43f0c1db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:42.273672 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea44842-6143-4805-ad63-85aa43f0c1db admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:42.273990 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea44842-6143-4805-ad63-85aa43f0c1db admin admin] PATH_INFO: `/v3/projects/ea387cae555e43e1b4aea3bc464ad90e` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:42.275210 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea44842-6143-4805-ad63-85aa43f0c1db admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea387cae555e43e1b4aea3bc464ad90e)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:42.277133 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea44842-6143-4805-ad63-85aa43f0c1db admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:42.331395 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-5ea44842-6143-4805-ad63-85aa43f0c1db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea387cae555e43e1b4aea3bc464ad90e', 'request_id': 'req-5ea44842-6143-4805-ad63-85aa43f0c1db'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:42.337484 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-5ea44842-6143-4805-ad63-85aa43f0c1db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea387cae555e43e1b4aea3bc464ad90e', 'request_id': 'req-5ea44842-6143-4805-ad63-85aa43f0c1db'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:42.348692 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-5ea44842-6143-4805-ad63-85aa43f0c1db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea387cae555e43e1b4aea3bc464ad90e', 'request_id': 'req-5ea44842-6143-4805-ad63-85aa43f0c1db'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:42.362839 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-5ea44842-6143-4805-ad63-85aa43f0c1db admin admin] The token cache is being invalidate because project ea387cae555e43e1b4aea3bc464ad90e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:22:42.363225 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-5ea44842-6143-4805-ad63-85aa43f0c1db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:42.364071 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-5ea44842-6143-4805-ad63-85aa43f0c1db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:42.366449 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1280/2570] 10.222.0.43 () {58 vars in 1232 bytes} [Wed Jun 22 10:22:42 2022] DELETE /identity/v3/projects/ea387cae555e43e1b4aea3bc464ad90e => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:22:42.371955 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a42f07b-8208-4dea-9c45-31943130bf4f None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:42.372436 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a42f07b-8208-4dea-9c45-31943130bf4f None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:42.372560 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a42f07b-8208-4dea-9c45-31943130bf4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:42.394892 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-1a42f07b-8208-4dea-9c45-31943130bf4f None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:22:42.396241 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-1a42f07b-8208-4dea-9c45-31943130bf4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:42.473036 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1291/2571] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:22:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:22:42.482424 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf9b75f-240c-4422-82d6-3c33039b3633 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:42.482832 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf9b75f-240c-4422-82d6-3c33039b3633 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:42.483819 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf9b75f-240c-4422-82d6-3c33039b3633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:42.505101 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-0cf9b75f-240c-4422-82d6-3c33039b3633 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:22:42.506510 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-0cf9b75f-240c-4422-82d6-3c33039b3633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:42.519495 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1281/2572] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:22:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:22:42.523959 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a42f07b-8208-4dea-9c45-31943130bf4f None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:42.536879 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a42f07b-8208-4dea-9c45-31943130bf4f None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:42.545880 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4efb7fa-6ba1-4a11-b3d4-37d7d91c70d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:42.545880 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4efb7fa-6ba1-4a11-b3d4-37d7d91c70d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:42.545880 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4efb7fa-6ba1-4a11-b3d4-37d7d91c70d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:42.545880 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4efb7fa-6ba1-4a11-b3d4-37d7d91c70d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:42.550654 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4efb7fa-6ba1-4a11-b3d4-37d7d91c70d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:22:42.550654 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4efb7fa-6ba1-4a11-b3d4-37d7d91c70d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:42.550654 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4efb7fa-6ba1-4a11-b3d4-37d7d91c70d3 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:42.567815 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1292/2573] 10.222.0.43 () {58 vars in 1152 bytes} [Wed Jun 22 10:22:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:22:42.572104 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf9b75f-240c-4422-82d6-3c33039b3633 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:42.584933 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf9b75f-240c-4422-82d6-3c33039b3633 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:42.597357 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e36453e-4044-4291-b4f9-2b22fcc083c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:42.598083 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e36453e-4044-4291-b4f9-2b22fcc083c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:42.598374 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e36453e-4044-4291-b4f9-2b22fcc083c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:42.598758 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e36453e-4044-4291-b4f9-2b22fcc083c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:42.599433 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e36453e-4044-4291-b4f9-2b22fcc083c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:42.601316 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e36453e-4044-4291-b4f9-2b22fcc083c9 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:42.645521 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1282/2574] 10.222.0.43 () {60 vars in 1152 bytes} [Wed Jun 22 10:22:42 2022] POST /identity/v3/projects => generated 381 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:22:42.650292 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4efb7fa-6ba1-4a11-b3d4-37d7d91c70d3 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:42.663845 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4efb7fa-6ba1-4a11-b3d4-37d7d91c70d3 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:42.727345 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6b8f00-0114-45e6-84c3-7650a621aae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:42.727947 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6b8f00-0114-45e6-84c3-7650a621aae1 admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:42.728232 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6b8f00-0114-45e6-84c3-7650a621aae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:42.728510 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6b8f00-0114-45e6-84c3-7650a621aae1 admin admin] PATH_INFO: `/v3/users` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:42.729215 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6b8f00-0114-45e6-84c3-7650a621aae1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:42.731211 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6b8f00-0114-45e6-84c3-7650a621aae1 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:42.757454 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1293/2575] 10.222.0.43 () {60 vars in 1143 bytes} [Wed Jun 22 10:22:42 2022] POST /identity/v3/users => generated 291 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:22:42.758779 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e36453e-4044-4291-b4f9-2b22fcc083c9 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:42.770158 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e36453e-4044-4291-b4f9-2b22fcc083c9 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:42.779452 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262a74bf-1e86-4276-8763-c6dd53e27340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:42.781410 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262a74bf-1e86-4276-8763-c6dd53e27340 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:42.781714 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262a74bf-1e86-4276-8763-c6dd53e27340 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:42.782001 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262a74bf-1e86-4276-8763-c6dd53e27340 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:42.782758 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262a74bf-1e86-4276-8763-c6dd53e27340 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:42.784447 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262a74bf-1e86-4276-8763-c6dd53e27340 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:42.800553 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1283/2576] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:22:42 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:22:42.801781 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6b8f00-0114-45e6-84c3-7650a621aae1 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:42.812078 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6b8f00-0114-45e6-84c3-7650a621aae1 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:42.816851 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfcf7c6-6a59-4074-8d92-5a2a3a450967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:42.817518 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfcf7c6-6a59-4074-8d92-5a2a3a450967 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:42.817832 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfcf7c6-6a59-4074-8d92-5a2a3a450967 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:42.818111 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfcf7c6-6a59-4074-8d92-5a2a3a450967 admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:42.818975 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfcf7c6-6a59-4074-8d92-5a2a3a450967 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:42.820715 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfcf7c6-6a59-4074-8d92-5a2a3a450967 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:42.838307 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1294/2577] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:22:42 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:22:42.844412 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262a74bf-1e86-4276-8763-c6dd53e27340 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:42.859265 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262a74bf-1e86-4276-8763-c6dd53e27340 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:42.864276 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26161ac-e58c-4d1f-83c3-b25a4112c587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:42.865360 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26161ac-e58c-4d1f-83c3-b25a4112c587 admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:42.865643 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26161ac-e58c-4d1f-83c3-b25a4112c587 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:42.865972 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26161ac-e58c-4d1f-83c3-b25a4112c587 admin admin] PATH_INFO: `/v3/projects/79ebb00cae594ed1b78d5149a0066002/users/48bb05032fc04a528eb0b69c76bd7915/roles/9f88c83743f745a9a785a2f454753f06` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:42.882674 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26161ac-e58c-4d1f-83c3-b25a4112c587 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79ebb00cae594ed1b78d5149a0066002, user_id=48bb05032fc04a528eb0b69c76bd7915, role_id=9f88c83743f745a9a785a2f454753f06)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:42.886073 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26161ac-e58c-4d1f-83c3-b25a4112c587 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:42.900809 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1284/2578] 10.222.0.43 () {60 vars in 1482 bytes} [Wed Jun 22 10:22:42 2022] PUT /identity/v3/projects/79ebb00cae594ed1b78d5149a0066002/users/48bb05032fc04a528eb0b69c76bd7915/roles/9f88c83743f745a9a785a2f454753f06 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:22:42.915880 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09647164-6ef6-4904-9435-64511b75f52e None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:42.916369 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09647164-6ef6-4904-9435-64511b75f52e None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:42.916658 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09647164-6ef6-4904-9435-64511b75f52e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:42.944631 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-09647164-6ef6-4904-9435-64511b75f52e None None] MFA Rules not processed for user `48bb05032fc04a528eb0b69c76bd7915`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:22:42.946009 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-09647164-6ef6-4904-9435-64511b75f52e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:42.959912 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:22:43.018697 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1295/2579] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:22:42 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:22:43.023469 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26161ac-e58c-4d1f-83c3-b25a4112c587 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:43.087461 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26161ac-e58c-4d1f-83c3-b25a4112c587 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:43.093383 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99411bc-97ed-49d6-bc5f-3f024beb346c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:43.094114 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99411bc-97ed-49d6-bc5f-3f024beb346c admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:43.094395 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99411bc-97ed-49d6-bc5f-3f024beb346c admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:43.094669 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99411bc-97ed-49d6-bc5f-3f024beb346c admin admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:43.095371 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99411bc-97ed-49d6-bc5f-3f024beb346c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:43.097322 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99411bc-97ed-49d6-bc5f-3f024beb346c admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:43.108221 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:22:43.127800 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1285/2580] 10.222.0.43 () {60 vars in 1152 bytes} [Wed Jun 22 10:22:43 2022] POST /identity/v3/projects => generated 379 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:22:43.131996 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09647164-6ef6-4904-9435-64511b75f52e None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:43.143368 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09647164-6ef6-4904-9435-64511b75f52e None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:43.205106 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c54d3b2-2dde-42b5-95b0-1fe9eec1311d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:43.205827 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c54d3b2-2dde-42b5-95b0-1fe9eec1311d admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:43.206118 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c54d3b2-2dde-42b5-95b0-1fe9eec1311d admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:43.206403 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c54d3b2-2dde-42b5-95b0-1fe9eec1311d admin admin] PATH_INFO: `/v3/users` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:43.207110 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c54d3b2-2dde-42b5-95b0-1fe9eec1311d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:43.209167 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c54d3b2-2dde-42b5-95b0-1fe9eec1311d admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:43.236135 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1296/2581] 10.222.0.43 () {60 vars in 1143 bytes} [Wed Jun 22 10:22:43 2022] POST /identity/v3/users => generated 296 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:22:43.240348 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99411bc-97ed-49d6-bc5f-3f024beb346c admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:43.252181 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99411bc-97ed-49d6-bc5f-3f024beb346c admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:43.256914 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d97b27-01c2-4a80-9d94-1330087ac967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:43.257584 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d97b27-01c2-4a80-9d94-1330087ac967 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:43.257902 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d97b27-01c2-4a80-9d94-1330087ac967 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:43.258183 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d97b27-01c2-4a80-9d94-1330087ac967 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:43.258924 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d97b27-01c2-4a80-9d94-1330087ac967 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:43.260531 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d97b27-01c2-4a80-9d94-1330087ac967 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:43.272273 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1286/2582] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:22:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:22:43.276793 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c54d3b2-2dde-42b5-95b0-1fe9eec1311d admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:43.288547 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c54d3b2-2dde-42b5-95b0-1fe9eec1311d admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:43.293589 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ecf259-8326-4cdd-9204-3c49fee27c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:43.294506 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ecf259-8326-4cdd-9204-3c49fee27c60 admin admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:43.294816 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ecf259-8326-4cdd-9204-3c49fee27c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:43.295127 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ecf259-8326-4cdd-9204-3c49fee27c60 admin admin] PATH_INFO: `/v3/projects/3a25edf709b94f6e8139950a92395f1e/users/54117e5ff1144fa094b30d7870399f1f/roles/26d9c2ab5dfc4e6d9ca80c6014123906` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:43.310037 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ecf259-8326-4cdd-9204-3c49fee27c60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a25edf709b94f6e8139950a92395f1e, user_id=54117e5ff1144fa094b30d7870399f1f, role_id=26d9c2ab5dfc4e6d9ca80c6014123906)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:43.312890 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ecf259-8326-4cdd-9204-3c49fee27c60 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:43.325602 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1297/2583] 10.222.0.43 () {60 vars in 1482 bytes} [Wed Jun 22 10:22:43 2022] PUT /identity/v3/projects/3a25edf709b94f6e8139950a92395f1e/users/54117e5ff1144fa094b30d7870399f1f/roles/26d9c2ab5dfc4e6d9ca80c6014123906 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:22:43.330263 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d97b27-01c2-4a80-9d94-1330087ac967 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:43.343859 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d97b27-01c2-4a80-9d94-1330087ac967 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:43.410950 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755ba148-2a52-4d7a-89a3-11f37bfb30d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:43.412067 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755ba148-2a52-4d7a-89a3-11f37bfb30d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:43.412654 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755ba148-2a52-4d7a-89a3-11f37bfb30d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:43.413129 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755ba148-2a52-4d7a-89a3-11f37bfb30d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:43.414402 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755ba148-2a52-4d7a-89a3-11f37bfb30d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:43.417181 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755ba148-2a52-4d7a-89a3-11f37bfb30d7 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:43.440601 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1287/2584] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:22:43 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:22:43.445387 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ecf259-8326-4cdd-9204-3c49fee27c60 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:43.458176 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ecf259-8326-4cdd-9204-3c49fee27c60 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:43.478528 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3959129-4929-4628-8419-df80bd05d82c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:43.479792 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3959129-4929-4628-8419-df80bd05d82c admin admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:43.480075 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3959129-4929-4628-8419-df80bd05d82c admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:43.480811 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3959129-4929-4628-8419-df80bd05d82c admin admin] PATH_INFO: `/v3/projects/3a25edf709b94f6e8139950a92395f1e/users/54117e5ff1144fa094b30d7870399f1f/roles/26d9c2ab5dfc4e6d9ca80c6014123906` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:43.483869 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3959129-4929-4628-8419-df80bd05d82c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a25edf709b94f6e8139950a92395f1e, user_id=54117e5ff1144fa094b30d7870399f1f, role_id=26d9c2ab5dfc4e6d9ca80c6014123906)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:43.486897 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3959129-4929-4628-8419-df80bd05d82c admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:43.500167 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1298/2585] 10.222.0.43 () {60 vars in 1482 bytes} [Wed Jun 22 10:22:43 2022] PUT /identity/v3/projects/3a25edf709b94f6e8139950a92395f1e/users/54117e5ff1144fa094b30d7870399f1f/roles/26d9c2ab5dfc4e6d9ca80c6014123906 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:22:43.510544 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dafb943-c535-42c3-be59-092335eb30b1 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:43.510967 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dafb943-c535-42c3-be59-092335eb30b1 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:43.511331 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dafb943-c535-42c3-be59-092335eb30b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:43.540157 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-7dafb943-c535-42c3-be59-092335eb30b1 None None] MFA Rules not processed for user `54117e5ff1144fa094b30d7870399f1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:22:43.540435 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-7dafb943-c535-42c3-be59-092335eb30b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:43.632073 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1288/2586] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:22:43 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:22:43.644222 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3959129-4929-4628-8419-df80bd05d82c admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:43.646125 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-f3959129-4929-4628-8419-df80bd05d82c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:43.720567 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3959129-4929-4628-8419-df80bd05d82c admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:43.726986 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e5d799-6e4b-4b69-bab6-c25da6e11ce4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bbcb3d4dc704dfdb0097abc594ca855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:43.728784 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e5d799-6e4b-4b69-bab6-c25da6e11ce4 service cinder] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:43.729072 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e5d799-6e4b-4b69-bab6-c25da6e11ce4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:43.734598 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e5d799-6e4b-4b69-bab6-c25da6e11ce4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:43.744999 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e5d799-6e4b-4b69-bab6-c25da6e11ce4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:43.746501 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e5d799-6e4b-4b69-bab6-c25da6e11ce4 service cinder] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:43.760070 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1299/2587] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:22:43 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:22:44.235078 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dafb943-c535-42c3-be59-092335eb30b1 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:44.318272 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dafb943-c535-42c3-be59-092335eb30b1 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:44.323338 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045c724c-3944-4a9a-9448-2e9674243d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:44.324667 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045c724c-3944-4a9a-9448-2e9674243d40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:44.325146 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045c724c-3944-4a9a-9448-2e9674243d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:44.325746 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045c724c-3944-4a9a-9448-2e9674243d40 admin admin] PATH_INFO: `/v3/users/48bb05032fc04a528eb0b69c76bd7915` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:44.328028 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045c724c-3944-4a9a-9448-2e9674243d40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=48bb05032fc04a528eb0b69c76bd7915)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:44.330336 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045c724c-3944-4a9a-9448-2e9674243d40 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:44.333223 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:22:44.382616 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-045c724c-3944-4a9a-9448-2e9674243d40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48bb05032fc04a528eb0b69c76bd7915'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:44.395779 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-045c724c-3944-4a9a-9448-2e9674243d40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48bb05032fc04a528eb0b69c76bd7915'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:44.404031 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-045c724c-3944-4a9a-9448-2e9674243d40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48bb05032fc04a528eb0b69c76bd7915'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:44.404865 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-045c724c-3944-4a9a-9448-2e9674243d40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48bb05032fc04a528eb0b69c76bd7915'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:44.412422 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-045c724c-3944-4a9a-9448-2e9674243d40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48bb05032fc04a528eb0b69c76bd7915'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:44.418684 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1289/2588] 10.222.0.43 () {58 vars in 1223 bytes} [Wed Jun 22 10:22:44 2022] DELETE /identity/v3/users/48bb05032fc04a528eb0b69c76bd7915 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:22:44.423863 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2874754c-5907-4cdc-a8f0-81b4816ba425 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:44.424158 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2874754c-5907-4cdc-a8f0-81b4816ba425 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:44.424439 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2874754c-5907-4cdc-a8f0-81b4816ba425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:44.442426 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-2874754c-5907-4cdc-a8f0-81b4816ba425 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:22:44.443629 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-2874754c-5907-4cdc-a8f0-81b4816ba425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:44.447602 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:22:44.513133 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1300/2589] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:22:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:22:44.530183 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045c724c-3944-4a9a-9448-2e9674243d40 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:44.535089 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-045c724c-3944-4a9a-9448-2e9674243d40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:44.603635 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045c724c-3944-4a9a-9448-2e9674243d40 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:44.609240 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616989bc-eb6f-4171-9f8b-eb5b6d4f9a5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe93d4c0737249fd8623bb5ce188e34e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:44.609957 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616989bc-eb6f-4171-9f8b-eb5b6d4f9a5e service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:44.610297 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616989bc-eb6f-4171-9f8b-eb5b6d4f9a5e service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:44.610538 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616989bc-eb6f-4171-9f8b-eb5b6d4f9a5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:44.620774 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616989bc-eb6f-4171-9f8b-eb5b6d4f9a5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:44.622395 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616989bc-eb6f-4171-9f8b-eb5b6d4f9a5e service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:44.634187 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1290/2590] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:22:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:22:44.935599 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2874754c-5907-4cdc-a8f0-81b4816ba425 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:44.937933 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-2874754c-5907-4cdc-a8f0-81b4816ba425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:44.950231 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2874754c-5907-4cdc-a8f0-81b4816ba425 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:44.956128 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da1f574-c8ee-4943-9413-2ded2c570007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:44.957014 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da1f574-c8ee-4943-9413-2ded2c570007 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:44.957312 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da1f574-c8ee-4943-9413-2ded2c570007 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:44.957585 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da1f574-c8ee-4943-9413-2ded2c570007 admin admin] PATH_INFO: `/v3/projects/79ebb00cae594ed1b78d5149a0066002` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:44.958847 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da1f574-c8ee-4943-9413-2ded2c570007 admin admin] RBAC: Authorizing `identity:delete_project(project_id=79ebb00cae594ed1b78d5149a0066002)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:44.960793 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da1f574-c8ee-4943-9413-2ded2c570007 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:45.022430 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-9da1f574-c8ee-4943-9413-2ded2c570007 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79ebb00cae594ed1b78d5149a0066002', 'request_id': 'req-9da1f574-c8ee-4943-9413-2ded2c570007'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:45.029601 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-9da1f574-c8ee-4943-9413-2ded2c570007 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79ebb00cae594ed1b78d5149a0066002', 'request_id': 'req-9da1f574-c8ee-4943-9413-2ded2c570007'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:45.035788 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-9da1f574-c8ee-4943-9413-2ded2c570007 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79ebb00cae594ed1b78d5149a0066002', 'request_id': 'req-9da1f574-c8ee-4943-9413-2ded2c570007'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:45.049508 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-9da1f574-c8ee-4943-9413-2ded2c570007 admin admin] The token cache is being invalidate because project 79ebb00cae594ed1b78d5149a0066002 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:22:45.050070 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-9da1f574-c8ee-4943-9413-2ded2c570007 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:45.050731 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-9da1f574-c8ee-4943-9413-2ded2c570007 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:45.052485 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1301/2591] 10.222.0.43 () {58 vars in 1232 bytes} [Wed Jun 22 10:22:44 2022] DELETE /identity/v3/projects/79ebb00cae594ed1b78d5149a0066002 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:22:45.056297 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616989bc-eb6f-4171-9f8b-eb5b6d4f9a5e service neutron] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:45.067531 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616989bc-eb6f-4171-9f8b-eb5b6d4f9a5e service neutron] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:45.147631 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae891ceb-5293-4864-90f8-9ac5d9d2e63a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:45.148551 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae891ceb-5293-4864-90f8-9ac5d9d2e63a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:45.148837 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae891ceb-5293-4864-90f8-9ac5d9d2e63a admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:45.149131 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae891ceb-5293-4864-90f8-9ac5d9d2e63a admin admin] PATH_INFO: `/v3/users/54117e5ff1144fa094b30d7870399f1f` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:45.150366 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae891ceb-5293-4864-90f8-9ac5d9d2e63a admin admin] RBAC: Authorizing `identity:delete_user(user_id=54117e5ff1144fa094b30d7870399f1f)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:45.152401 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae891ceb-5293-4864-90f8-9ac5d9d2e63a admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:45.181144 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:22:45.205384 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-ae891ceb-5293-4864-90f8-9ac5d9d2e63a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54117e5ff1144fa094b30d7870399f1f'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:45.217740 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-ae891ceb-5293-4864-90f8-9ac5d9d2e63a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54117e5ff1144fa094b30d7870399f1f'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:45.227893 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-ae891ceb-5293-4864-90f8-9ac5d9d2e63a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54117e5ff1144fa094b30d7870399f1f'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:45.228674 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-ae891ceb-5293-4864-90f8-9ac5d9d2e63a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54117e5ff1144fa094b30d7870399f1f'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:45.237370 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-ae891ceb-5293-4864-90f8-9ac5d9d2e63a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54117e5ff1144fa094b30d7870399f1f'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:45.243542 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1291/2592] 10.222.0.43 () {58 vars in 1223 bytes} [Wed Jun 22 10:22:45 2022] DELETE /identity/v3/users/54117e5ff1144fa094b30d7870399f1f => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:22:45.632845 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da1f574-c8ee-4943-9413-2ded2c570007 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:45.634391 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-9da1f574-c8ee-4943-9413-2ded2c570007 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:45.651503 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da1f574-c8ee-4943-9413-2ded2c570007 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:45.720705 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a0bedf-01bc-4291-8623-ee7541ad1c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:45.721558 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a0bedf-01bc-4291-8623-ee7541ad1c0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:45.721945 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a0bedf-01bc-4291-8623-ee7541ad1c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:45.722222 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a0bedf-01bc-4291-8623-ee7541ad1c0b admin admin] PATH_INFO: `/v3/projects/3a25edf709b94f6e8139950a92395f1e` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:45.723385 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a0bedf-01bc-4291-8623-ee7541ad1c0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a25edf709b94f6e8139950a92395f1e)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:45.725299 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a0bedf-01bc-4291-8623-ee7541ad1c0b admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:45.762854 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:22:45.775198 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-22a0bedf-01bc-4291-8623-ee7541ad1c0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a25edf709b94f6e8139950a92395f1e', 'request_id': 'req-22a0bedf-01bc-4291-8623-ee7541ad1c0b'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:45.782141 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-22a0bedf-01bc-4291-8623-ee7541ad1c0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a25edf709b94f6e8139950a92395f1e', 'request_id': 'req-22a0bedf-01bc-4291-8623-ee7541ad1c0b'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:45.787820 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-22a0bedf-01bc-4291-8623-ee7541ad1c0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a25edf709b94f6e8139950a92395f1e', 'request_id': 'req-22a0bedf-01bc-4291-8623-ee7541ad1c0b'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:45.800311 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-22a0bedf-01bc-4291-8623-ee7541ad1c0b admin admin] The token cache is being invalidate because project 3a25edf709b94f6e8139950a92395f1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:22:45.800598 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-22a0bedf-01bc-4291-8623-ee7541ad1c0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:45.801209 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-22a0bedf-01bc-4291-8623-ee7541ad1c0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:45.802758 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1302/2593] 10.222.0.43 () {58 vars in 1232 bytes} [Wed Jun 22 10:22:45 2022] DELETE /identity/v3/projects/3a25edf709b94f6e8139950a92395f1e => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:22:45.807784 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b9a897-4a22-4c1a-a548-ae1ba121c72f None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:45.808258 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b9a897-4a22-4c1a-a548-ae1ba121c72f None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:45.808353 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b9a897-4a22-4c1a-a548-ae1ba121c72f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:45.830103 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-a4b9a897-4a22-4c1a-a548-ae1ba121c72f None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:22:45.831337 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-a4b9a897-4a22-4c1a-a548-ae1ba121c72f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:45.891036 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1292/2594] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:22:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:22:45.900185 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f2f2ef-bf05-4291-9f27-31b23af89c73 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:45.900472 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f2f2ef-bf05-4291-9f27-31b23af89c73 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:45.900746 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f2f2ef-bf05-4291-9f27-31b23af89c73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:45.919456 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-31f2f2ef-bf05-4291-9f27-31b23af89c73 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:22:45.921034 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-31f2f2ef-bf05-4291-9f27-31b23af89c73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:45.929026 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1303/2595] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:22:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:22:45.933380 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b9a897-4a22-4c1a-a548-ae1ba121c72f None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:45.944421 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b9a897-4a22-4c1a-a548-ae1ba121c72f None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:45.949106 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dc1d0e-1968-49ad-b2bd-e3d4d8cb3f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:45.949842 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dc1d0e-1968-49ad-b2bd-e3d4d8cb3f92 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:45.950140 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dc1d0e-1968-49ad-b2bd-e3d4d8cb3f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:45.950430 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dc1d0e-1968-49ad-b2bd-e3d4d8cb3f92 admin admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:45.951213 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dc1d0e-1968-49ad-b2bd-e3d4d8cb3f92 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:22:45.952253 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dc1d0e-1968-49ad-b2bd-e3d4d8cb3f92 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:45.954046 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dc1d0e-1968-49ad-b2bd-e3d4d8cb3f92 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:45.967198 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1293/2596] 10.222.0.43 () {58 vars in 1152 bytes} [Wed Jun 22 10:22:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:22:45.972984 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f2f2ef-bf05-4291-9f27-31b23af89c73 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:45.984270 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f2f2ef-bf05-4291-9f27-31b23af89c73 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:45.988993 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71302f7-432e-49b5-a4f9-5e17963c62ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:45.989679 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71302f7-432e-49b5-a4f9-5e17963c62ab admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:45.989992 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71302f7-432e-49b5-a4f9-5e17963c62ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:45.990292 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71302f7-432e-49b5-a4f9-5e17963c62ab admin admin] PATH_INFO: `/v3/projects` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:45.990997 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71302f7-432e-49b5-a4f9-5e17963c62ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:45.992904 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71302f7-432e-49b5-a4f9-5e17963c62ab admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:46.019831 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1304/2597] 10.222.0.43 () {60 vars in 1152 bytes} [Wed Jun 22 10:22:45 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 10:22:46.024037 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dc1d0e-1968-49ad-b2bd-e3d4d8cb3f92 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:46.035056 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dc1d0e-1968-49ad-b2bd-e3d4d8cb3f92 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:46.098940 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f451940-f54f-496b-a03c-9ceb99cb5e4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:46.099698 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f451940-f54f-496b-a03c-9ceb99cb5e4e admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:46.099989 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f451940-f54f-496b-a03c-9ceb99cb5e4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:46.100265 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f451940-f54f-496b-a03c-9ceb99cb5e4e admin admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:46.101073 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f451940-f54f-496b-a03c-9ceb99cb5e4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:46.103362 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f451940-f54f-496b-a03c-9ceb99cb5e4e admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:46.126029 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1294/2598] 10.222.0.43 () {60 vars in 1143 bytes} [Wed Jun 22 10:22:46 2022] POST /identity/v3/users => generated 287 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:22:46.130316 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71302f7-432e-49b5-a4f9-5e17963c62ab admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:46.144797 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71302f7-432e-49b5-a4f9-5e17963c62ab admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:46.150618 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37380693-7745-4d3f-be8f-793ae2aa8a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:46.151402 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37380693-7745-4d3f-be8f-793ae2aa8a27 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:46.151793 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37380693-7745-4d3f-be8f-793ae2aa8a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:46.152163 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37380693-7745-4d3f-be8f-793ae2aa8a27 admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:46.152844 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37380693-7745-4d3f-be8f-793ae2aa8a27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:46.154663 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37380693-7745-4d3f-be8f-793ae2aa8a27 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:46.166387 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1305/2599] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:22:46 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:22:46.171369 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f451940-f54f-496b-a03c-9ceb99cb5e4e admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:46.185204 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f451940-f54f-496b-a03c-9ceb99cb5e4e admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:46.194719 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e777dea-ec6c-4d3e-88fb-8a26a7608d76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:46.195495 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e777dea-ec6c-4d3e-88fb-8a26a7608d76 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:46.195952 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e777dea-ec6c-4d3e-88fb-8a26a7608d76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:46.196317 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e777dea-ec6c-4d3e-88fb-8a26a7608d76 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:46.197119 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e777dea-ec6c-4d3e-88fb-8a26a7608d76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:46.199128 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e777dea-ec6c-4d3e-88fb-8a26a7608d76 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:46.215343 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1295/2600] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:22:46 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:22:46.221075 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37380693-7745-4d3f-be8f-793ae2aa8a27 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:46.235410 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37380693-7745-4d3f-be8f-793ae2aa8a27 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:46.243585 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1084fa6-3e87-44af-9753-aa14adba93e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:46.245455 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1084fa6-3e87-44af-9753-aa14adba93e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:46.246010 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1084fa6-3e87-44af-9753-aa14adba93e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:46.246800 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1084fa6-3e87-44af-9753-aa14adba93e2 admin admin] PATH_INFO: `/v3/projects/c4a3ba9c256f4e6ba469dfb901d02f56/users/1fe3856322dd406abc36edaa6be4ca36/roles/9f88c83743f745a9a785a2f454753f06` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:46.269855 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1084fa6-3e87-44af-9753-aa14adba93e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4a3ba9c256f4e6ba469dfb901d02f56, user_id=1fe3856322dd406abc36edaa6be4ca36, role_id=9f88c83743f745a9a785a2f454753f06)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:46.273043 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1084fa6-3e87-44af-9753-aa14adba93e2 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:46.292049 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1306/2601] 10.222.0.43 () {60 vars in 1482 bytes} [Wed Jun 22 10:22:46 2022] PUT /identity/v3/projects/c4a3ba9c256f4e6ba469dfb901d02f56/users/1fe3856322dd406abc36edaa6be4ca36/roles/9f88c83743f745a9a785a2f454753f06 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:22:46.297575 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6d3260-1a91-4742-80eb-c8750d8d1202 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:46.298079 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6d3260-1a91-4742-80eb-c8750d8d1202 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:46.298456 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6d3260-1a91-4742-80eb-c8750d8d1202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:46.318969 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-1a6d3260-1a91-4742-80eb-c8750d8d1202 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:22:46.320576 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-1a6d3260-1a91-4742-80eb-c8750d8d1202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:46.330596 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:22:46.413981 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1296/2602] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:22:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:22:46.424488 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1084fa6-3e87-44af-9753-aa14adba93e2 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:46.426356 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-b1084fa6-3e87-44af-9753-aa14adba93e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:46.500748 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1084fa6-3e87-44af-9753-aa14adba93e2 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:46.504861 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629abb6b-457e-4d1d-b9af-ab768ef37c67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe93d4c0737249fd8623bb5ce188e34e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:46.505633 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629abb6b-457e-4d1d-b9af-ab768ef37c67 service neutron] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:46.506215 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629abb6b-457e-4d1d-b9af-ab768ef37c67 service neutron] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:46.506599 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629abb6b-457e-4d1d-b9af-ab768ef37c67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:46.517396 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629abb6b-457e-4d1d-b9af-ab768ef37c67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:46.519134 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629abb6b-457e-4d1d-b9af-ab768ef37c67 service neutron] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:46.531084 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1307/2603] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:22:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:22:47.286119 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a02064f-9015-433b-934e-1dcd8ef5b6bf None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:47.286632 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a02064f-9015-433b-934e-1dcd8ef5b6bf None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:47.286729 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a02064f-9015-433b-934e-1dcd8ef5b6bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:47.316251 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-5a02064f-9015-433b-934e-1dcd8ef5b6bf None None] MFA Rules not processed for user `1fe3856322dd406abc36edaa6be4ca36`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:22:47.317450 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-5a02064f-9015-433b-934e-1dcd8ef5b6bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:47.387477 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1297/2604] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:22:47 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:22:47.392693 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629abb6b-457e-4d1d-b9af-ab768ef37c67 service neutron] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:47.404202 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629abb6b-457e-4d1d-b9af-ab768ef37c67 service neutron] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:47.409519 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9817b7fa-b27c-462f-b619-f3cdea567530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:47.410213 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9817b7fa-b27c-462f-b619-f3cdea567530 admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:47.410505 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9817b7fa-b27c-462f-b619-f3cdea567530 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:47.410788 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9817b7fa-b27c-462f-b619-f3cdea567530 admin admin] PATH_INFO: `/v3/projects` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:47.411490 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9817b7fa-b27c-462f-b619-f3cdea567530 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:47.413414 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9817b7fa-b27c-462f-b619-f3cdea567530 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:47.445239 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1308/2605] 10.222.0.43 () {60 vars in 1152 bytes} [Wed Jun 22 10:22:47 2022] POST /identity/v3/projects => generated 373 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:22:47.449528 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a02064f-9015-433b-934e-1dcd8ef5b6bf None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:47.460816 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a02064f-9015-433b-934e-1dcd8ef5b6bf None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:47.532796 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c71a664-f851-4da9-92fe-c5f3b2605d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:47.533593 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c71a664-f851-4da9-92fe-c5f3b2605d19 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:47.533920 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c71a664-f851-4da9-92fe-c5f3b2605d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:47.534346 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c71a664-f851-4da9-92fe-c5f3b2605d19 admin admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:47.535109 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c71a664-f851-4da9-92fe-c5f3b2605d19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:47.537206 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c71a664-f851-4da9-92fe-c5f3b2605d19 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:47.559015 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1298/2606] 10.222.0.43 () {60 vars in 1143 bytes} [Wed Jun 22 10:22:47 2022] POST /identity/v3/users => generated 293 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:22:47.562884 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9817b7fa-b27c-462f-b619-f3cdea567530 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:47.573611 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9817b7fa-b27c-462f-b619-f3cdea567530 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:47.579840 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ca5041-6bfc-41b9-aab6-cf7e6fe98ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:47.580561 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ca5041-6bfc-41b9-aab6-cf7e6fe98ab7 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:47.580849 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ca5041-6bfc-41b9-aab6-cf7e6fe98ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:47.581128 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ca5041-6bfc-41b9-aab6-cf7e6fe98ab7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:47.581935 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ca5041-6bfc-41b9-aab6-cf7e6fe98ab7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:47.583557 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ca5041-6bfc-41b9-aab6-cf7e6fe98ab7 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:47.595352 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1309/2607] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:22:47 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:22:47.599530 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c71a664-f851-4da9-92fe-c5f3b2605d19 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:47.610280 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c71a664-f851-4da9-92fe-c5f3b2605d19 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:47.614941 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f4ec25-6487-4861-8b5e-c093a78b40d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:47.615859 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f4ec25-6487-4861-8b5e-c093a78b40d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:47.616144 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f4ec25-6487-4861-8b5e-c093a78b40d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:47.616424 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f4ec25-6487-4861-8b5e-c093a78b40d5 admin admin] PATH_INFO: `/v3/projects/c96c0d32e5c34861a87bf004ed7cf15d/users/353be67a71fc48fb941c86d55c9eba75/roles/26d9c2ab5dfc4e6d9ca80c6014123906` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:47.632180 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f4ec25-6487-4861-8b5e-c093a78b40d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c96c0d32e5c34861a87bf004ed7cf15d, user_id=353be67a71fc48fb941c86d55c9eba75, role_id=26d9c2ab5dfc4e6d9ca80c6014123906)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:47.634906 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f4ec25-6487-4861-8b5e-c093a78b40d5 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:47.649147 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1299/2608] 10.222.0.43 () {60 vars in 1482 bytes} [Wed Jun 22 10:22:47 2022] PUT /identity/v3/projects/c96c0d32e5c34861a87bf004ed7cf15d/users/353be67a71fc48fb941c86d55c9eba75/roles/26d9c2ab5dfc4e6d9ca80c6014123906 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:22:47.653166 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ca5041-6bfc-41b9-aab6-cf7e6fe98ab7 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:47.664079 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ca5041-6bfc-41b9-aab6-cf7e6fe98ab7 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:47.694061 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:22:47.743455 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e1d85a-a6c4-4250-919c-75bb77e2ed7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:47.744212 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e1d85a-a6c4-4250-919c-75bb77e2ed7b admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:47.744580 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e1d85a-a6c4-4250-919c-75bb77e2ed7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:47.744941 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e1d85a-a6c4-4250-919c-75bb77e2ed7b admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:47.745865 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e1d85a-a6c4-4250-919c-75bb77e2ed7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:47.747723 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e1d85a-a6c4-4250-919c-75bb77e2ed7b admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:47.762961 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1310/2609] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:22:47 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:22:47.764045 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f4ec25-6487-4861-8b5e-c093a78b40d5 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:47.771382 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:22:47.775565 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f4ec25-6487-4861-8b5e-c093a78b40d5 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:47.783946 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead1ee11-4851-46ca-ab42-3b01e906a7c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:47.785006 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead1ee11-4851-46ca-ab42-3b01e906a7c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:47.785316 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead1ee11-4851-46ca-ab42-3b01e906a7c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:47.785591 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead1ee11-4851-46ca-ab42-3b01e906a7c7 admin admin] PATH_INFO: `/v3/projects/c96c0d32e5c34861a87bf004ed7cf15d/users/353be67a71fc48fb941c86d55c9eba75/roles/26d9c2ab5dfc4e6d9ca80c6014123906` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:47.788541 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead1ee11-4851-46ca-ab42-3b01e906a7c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c96c0d32e5c34861a87bf004ed7cf15d, user_id=353be67a71fc48fb941c86d55c9eba75, role_id=26d9c2ab5dfc4e6d9ca80c6014123906)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:47.791332 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead1ee11-4851-46ca-ab42-3b01e906a7c7 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:47.803542 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1300/2610] 10.222.0.43 () {60 vars in 1482 bytes} [Wed Jun 22 10:22:47 2022] PUT /identity/v3/projects/c96c0d32e5c34861a87bf004ed7cf15d/users/353be67a71fc48fb941c86d55c9eba75/roles/26d9c2ab5dfc4e6d9ca80c6014123906 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:22:48.041131 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e1d85a-a6c4-4250-919c-75bb77e2ed7b admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:48.043110 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-a6e1d85a-a6c4-4250-919c-75bb77e2ed7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:48.059184 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e1d85a-a6c4-4250-919c-75bb77e2ed7b admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:48.133252 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5576d61e-0aec-46b6-b3c9-2837f9ab3019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:48.134314 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5576d61e-0aec-46b6-b3c9-2837f9ab3019 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:48.134607 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5576d61e-0aec-46b6-b3c9-2837f9ab3019 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:48.134882 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5576d61e-0aec-46b6-b3c9-2837f9ab3019 admin admin] PATH_INFO: `/v3/users/b4baec301969435e95fcf581b3056286` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:48.137030 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5576d61e-0aec-46b6-b3c9-2837f9ab3019 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4baec301969435e95fcf581b3056286)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:48.139992 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5576d61e-0aec-46b6-b3c9-2837f9ab3019 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:48.205307 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-5576d61e-0aec-46b6-b3c9-2837f9ab3019 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4baec301969435e95fcf581b3056286'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:48.223928 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-5576d61e-0aec-46b6-b3c9-2837f9ab3019 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4baec301969435e95fcf581b3056286'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:48.234820 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-5576d61e-0aec-46b6-b3c9-2837f9ab3019 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4baec301969435e95fcf581b3056286'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:48.243440 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-5576d61e-0aec-46b6-b3c9-2837f9ab3019 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4baec301969435e95fcf581b3056286'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:48.244305 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-5576d61e-0aec-46b6-b3c9-2837f9ab3019 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4baec301969435e95fcf581b3056286'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:48.253733 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1311/2611] 10.222.0.43 () {58 vars in 1223 bytes} [Wed Jun 22 10:22:48 2022] DELETE /identity/v3/users/b4baec301969435e95fcf581b3056286 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:22:48.256703 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0a8cfd-c125-45f3-9bb9-58c4b849a55d None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:48.257104 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0a8cfd-c125-45f3-9bb9-58c4b849a55d None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:48.257487 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0a8cfd-c125-45f3-9bb9-58c4b849a55d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:48.276851 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-4b0a8cfd-c125-45f3-9bb9-58c4b849a55d None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:22:48.278309 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-4b0a8cfd-c125-45f3-9bb9-58c4b849a55d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:48.364463 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1301/2612] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:22:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:22:48.376394 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5576d61e-0aec-46b6-b3c9-2837f9ab3019 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:48.378051 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-5576d61e-0aec-46b6-b3c9-2837f9ab3019 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:48.437344 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:22:48.450937 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5576d61e-0aec-46b6-b3c9-2837f9ab3019 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:48.455907 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb31a06b-efa9-4563-afb5-45ba17756f94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe93d4c0737249fd8623bb5ce188e34e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:48.456606 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb31a06b-efa9-4563-afb5-45ba17756f94 service neutron] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:48.456895 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb31a06b-efa9-4563-afb5-45ba17756f94 service neutron] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:48.457169 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb31a06b-efa9-4563-afb5-45ba17756f94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:48.467097 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb31a06b-efa9-4563-afb5-45ba17756f94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:48.468771 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb31a06b-efa9-4563-afb5-45ba17756f94 service neutron] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:48.480143 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1312/2613] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:22:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:22:48.938853 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0a8cfd-c125-45f3-9bb9-58c4b849a55d None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:48.941106 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-4b0a8cfd-c125-45f3-9bb9-58c4b849a55d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:48.970793 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0a8cfd-c125-45f3-9bb9-58c4b849a55d None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:48.977419 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1239b1-d537-4c87-a3d1-41250abbb901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:48.978454 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1239b1-d537-4c87-a3d1-41250abbb901 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:48.978953 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1239b1-d537-4c87-a3d1-41250abbb901 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:48.979409 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1239b1-d537-4c87-a3d1-41250abbb901 admin admin] PATH_INFO: `/v3/projects/3b67f9f93e2548278203482194425620` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:48.981243 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1239b1-d537-4c87-a3d1-41250abbb901 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b67f9f93e2548278203482194425620)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:48.989387 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1239b1-d537-4c87-a3d1-41250abbb901 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:49.035923 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1386f86-9bd6-41c1-a532-61e4cd33f609 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:49.036964 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1386f86-9bd6-41c1-a532-61e4cd33f609 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:49.036964 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1386f86-9bd6-41c1-a532-61e4cd33f609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:49.076593 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-d1386f86-9bd6-41c1-a532-61e4cd33f609 None None] MFA Rules not processed for user `353be67a71fc48fb941c86d55c9eba75`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:22:49.078640 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-d1386f86-9bd6-41c1-a532-61e4cd33f609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:49.081114 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-bb1239b1-d537-4c87-a3d1-41250abbb901 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b67f9f93e2548278203482194425620', 'request_id': 'req-bb1239b1-d537-4c87-a3d1-41250abbb901'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:49.089620 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-bb1239b1-d537-4c87-a3d1-41250abbb901 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b67f9f93e2548278203482194425620', 'request_id': 'req-bb1239b1-d537-4c87-a3d1-41250abbb901'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:49.119720 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-bb1239b1-d537-4c87-a3d1-41250abbb901 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b67f9f93e2548278203482194425620', 'request_id': 'req-bb1239b1-d537-4c87-a3d1-41250abbb901'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:49.133112 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-bb1239b1-d537-4c87-a3d1-41250abbb901 admin admin] The token cache is being invalidate because project 3b67f9f93e2548278203482194425620 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:22:49.133674 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-bb1239b1-d537-4c87-a3d1-41250abbb901 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:49.134525 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-bb1239b1-d537-4c87-a3d1-41250abbb901 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:49.136229 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1302/2614] 10.222.0.43 () {58 vars in 1232 bytes} [Wed Jun 22 10:22:48 2022] DELETE /identity/v3/projects/3b67f9f93e2548278203482194425620 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:22:49.141169 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1239b1-d537-4c87-a3d1-41250abbb901 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:49.143486 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-bb1239b1-d537-4c87-a3d1-41250abbb901 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:49.178441 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1313/2615] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:22:49 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:22:49.192639 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1386f86-9bd6-41c1-a532-61e4cd33f609 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:49.194113 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-d1386f86-9bd6-41c1-a532-61e4cd33f609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:49.244270 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1239b1-d537-4c87-a3d1-41250abbb901 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:49.251698 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ec50fb-ced9-4bee-8639-394fdb507c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:49.253035 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ec50fb-ced9-4bee-8639-394fdb507c3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:49.253252 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ec50fb-ced9-4bee-8639-394fdb507c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:49.253613 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ec50fb-ced9-4bee-8639-394fdb507c3c admin admin] PATH_INFO: `/v3/users/377e8696784740e1bdae7adb0db29232` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:49.254970 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ec50fb-ced9-4bee-8639-394fdb507c3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=377e8696784740e1bdae7adb0db29232)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:49.257683 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ec50fb-ced9-4bee-8639-394fdb507c3c admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:49.288567 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1386f86-9bd6-41c1-a532-61e4cd33f609 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:49.290228 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:22:49.295052 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72afebe1-da99-4c99-b289-29edce80bd8a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bbcb3d4dc704dfdb0097abc594ca855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:49.296060 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72afebe1-da99-4c99-b289-29edce80bd8a service cinder] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:49.296450 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72afebe1-da99-4c99-b289-29edce80bd8a service cinder] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:49.296854 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72afebe1-da99-4c99-b289-29edce80bd8a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:49.300379 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-72afebe1-da99-4c99-b289-29edce80bd8a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:49.332906 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-91ec50fb-ced9-4bee-8639-394fdb507c3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '377e8696784740e1bdae7adb0db29232'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:49.354144 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-91ec50fb-ced9-4bee-8639-394fdb507c3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '377e8696784740e1bdae7adb0db29232'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:49.365246 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-91ec50fb-ced9-4bee-8639-394fdb507c3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '377e8696784740e1bdae7adb0db29232'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:49.366536 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-91ec50fb-ced9-4bee-8639-394fdb507c3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '377e8696784740e1bdae7adb0db29232'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:49.375051 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-91ec50fb-ced9-4bee-8639-394fdb507c3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '377e8696784740e1bdae7adb0db29232'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:49.381161 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72afebe1-da99-4c99-b289-29edce80bd8a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:49.381941 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1303/2616] 10.222.0.43 () {58 vars in 1223 bytes} [Wed Jun 22 10:22:49 2022] DELETE /identity/v3/users/377e8696784740e1bdae7adb0db29232 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:22:49.382741 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72afebe1-da99-4c99-b289-29edce80bd8a service cinder] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:49.394346 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1314/2617] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:22:49 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 10:22:49.749306 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ec50fb-ced9-4bee-8639-394fdb507c3c admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:49.751074 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-91ec50fb-ced9-4bee-8639-394fdb507c3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:49.869081 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ec50fb-ced9-4bee-8639-394fdb507c3c admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:49.875991 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a04e794-b21d-467e-9858-b23f13f61589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:49.877089 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a04e794-b21d-467e-9858-b23f13f61589 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:49.877438 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a04e794-b21d-467e-9858-b23f13f61589 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:49.877820 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a04e794-b21d-467e-9858-b23f13f61589 admin admin] PATH_INFO: `/v3/projects/8e808aafee0a44e492a941b49bdd100c` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:49.879230 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a04e794-b21d-467e-9858-b23f13f61589 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e808aafee0a44e492a941b49bdd100c)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:49.881326 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a04e794-b21d-467e-9858-b23f13f61589 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:49.952083 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-5a04e794-b21d-467e-9858-b23f13f61589 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e808aafee0a44e492a941b49bdd100c', 'request_id': 'req-5a04e794-b21d-467e-9858-b23f13f61589'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:49.958732 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-5a04e794-b21d-467e-9858-b23f13f61589 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e808aafee0a44e492a941b49bdd100c', 'request_id': 'req-5a04e794-b21d-467e-9858-b23f13f61589'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:49.980101 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-5a04e794-b21d-467e-9858-b23f13f61589 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e808aafee0a44e492a941b49bdd100c', 'request_id': 'req-5a04e794-b21d-467e-9858-b23f13f61589'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:50.002842 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-5a04e794-b21d-467e-9858-b23f13f61589 admin admin] The token cache is being invalidate because project 8e808aafee0a44e492a941b49bdd100c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:22:50.002842 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-5a04e794-b21d-467e-9858-b23f13f61589 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:50.002842 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-5a04e794-b21d-467e-9858-b23f13f61589 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:50.004811 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1304/2618] 10.222.0.43 () {58 vars in 1232 bytes} [Wed Jun 22 10:22:49 2022] DELETE /identity/v3/projects/8e808aafee0a44e492a941b49bdd100c => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:22:50.011596 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66ef053-8374-48c4-ac6c-bb240f0c853b None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:50.012202 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66ef053-8374-48c4-ac6c-bb240f0c853b None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:50.012202 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66ef053-8374-48c4-ac6c-bb240f0c853b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:50.034202 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-c66ef053-8374-48c4-ac6c-bb240f0c853b None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:22:50.035581 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-c66ef053-8374-48c4-ac6c-bb240f0c853b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:50.059877 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:22:50.109581 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1315/2619] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:22:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:22:50.118477 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2271aead-8135-4ef5-97c3-6253e7bfd304 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:50.118775 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2271aead-8135-4ef5-97c3-6253e7bfd304 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:50.119063 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2271aead-8135-4ef5-97c3-6253e7bfd304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:50.141415 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-2271aead-8135-4ef5-97c3-6253e7bfd304 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:22:50.142912 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-2271aead-8135-4ef5-97c3-6253e7bfd304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:50.154667 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1305/2620] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:22:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:22:50.156126 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66ef053-8374-48c4-ac6c-bb240f0c853b None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:50.165946 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66ef053-8374-48c4-ac6c-bb240f0c853b None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:50.171056 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5488941f-fb21-49bb-8873-0dcd51e920a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:50.171797 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5488941f-fb21-49bb-8873-0dcd51e920a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:50.172143 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5488941f-fb21-49bb-8873-0dcd51e920a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:50.172491 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5488941f-fb21-49bb-8873-0dcd51e920a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:50.173290 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5488941f-fb21-49bb-8873-0dcd51e920a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:22:50.173712 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5488941f-fb21-49bb-8873-0dcd51e920a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:50.175396 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5488941f-fb21-49bb-8873-0dcd51e920a0 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:50.189312 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1316/2621] 10.222.0.43 () {58 vars in 1152 bytes} [Wed Jun 22 10:22:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:22:50.193630 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2271aead-8135-4ef5-97c3-6253e7bfd304 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:50.203775 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2271aead-8135-4ef5-97c3-6253e7bfd304 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:50.208587 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e5dcbe-58bc-446a-9f87-64ba34bdb699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:50.209245 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e5dcbe-58bc-446a-9f87-64ba34bdb699 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:50.209528 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e5dcbe-58bc-446a-9f87-64ba34bdb699 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:50.209842 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e5dcbe-58bc-446a-9f87-64ba34bdb699 admin admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:50.210581 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e5dcbe-58bc-446a-9f87-64ba34bdb699 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:50.212547 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e5dcbe-58bc-446a-9f87-64ba34bdb699 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:50.230385 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:DELETE=16,keystone:SELECT=81,keystone:INSERT=3 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:22:50.247827 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1306/2622] 10.222.0.43 () {60 vars in 1152 bytes} [Wed Jun 22 10:22:50 2022] POST /identity/v3/projects => generated 375 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:22:50.252660 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5488941f-fb21-49bb-8873-0dcd51e920a0 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:50.264968 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5488941f-fb21-49bb-8873-0dcd51e920a0 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:50.335088 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef27820-a5dd-47af-9777-4041a996b917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:50.337735 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef27820-a5dd-47af-9777-4041a996b917 admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:50.337735 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef27820-a5dd-47af-9777-4041a996b917 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:50.337735 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef27820-a5dd-47af-9777-4041a996b917 admin admin] PATH_INFO: `/v3/users` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:50.337735 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef27820-a5dd-47af-9777-4041a996b917 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:50.340681 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef27820-a5dd-47af-9777-4041a996b917 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:50.362106 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1317/2623] 10.222.0.43 () {60 vars in 1143 bytes} [Wed Jun 22 10:22:50 2022] POST /identity/v3/users => generated 288 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:22:50.366212 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e5dcbe-58bc-446a-9f87-64ba34bdb699 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:50.377675 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e5dcbe-58bc-446a-9f87-64ba34bdb699 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:50.383079 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69921a1-9d17-44a2-98f1-dfb7f14433db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:50.383771 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69921a1-9d17-44a2-98f1-dfb7f14433db admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:50.384057 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69921a1-9d17-44a2-98f1-dfb7f14433db admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:50.384342 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69921a1-9d17-44a2-98f1-dfb7f14433db admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:50.385120 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69921a1-9d17-44a2-98f1-dfb7f14433db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:50.386771 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69921a1-9d17-44a2-98f1-dfb7f14433db admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:50.398352 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1307/2624] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:22:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:22:50.402296 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef27820-a5dd-47af-9777-4041a996b917 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:50.414429 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef27820-a5dd-47af-9777-4041a996b917 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:50.420612 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36f39d0-7f00-4a21-be54-3c5014e285f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:50.421829 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36f39d0-7f00-4a21-be54-3c5014e285f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:50.422279 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36f39d0-7f00-4a21-be54-3c5014e285f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:50.422742 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36f39d0-7f00-4a21-be54-3c5014e285f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:50.423684 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36f39d0-7f00-4a21-be54-3c5014e285f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:50.425320 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36f39d0-7f00-4a21-be54-3c5014e285f8 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:50.436751 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1318/2625] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:22:50 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:22:50.440937 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69921a1-9d17-44a2-98f1-dfb7f14433db admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:50.451811 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69921a1-9d17-44a2-98f1-dfb7f14433db admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:50.457030 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed2f35a-985b-4b8d-9dd9-f1b82ba401aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:50.457967 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed2f35a-985b-4b8d-9dd9-f1b82ba401aa admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:50.458251 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed2f35a-985b-4b8d-9dd9-f1b82ba401aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:50.458530 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed2f35a-985b-4b8d-9dd9-f1b82ba401aa admin admin] PATH_INFO: `/v3/projects/b8b4839f7b9f4c2eb7ddb165fccd2030/users/528f8a52cbc546ee8654e14334c7f14d/roles/9f88c83743f745a9a785a2f454753f06` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:50.474687 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed2f35a-985b-4b8d-9dd9-f1b82ba401aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8b4839f7b9f4c2eb7ddb165fccd2030, user_id=528f8a52cbc546ee8654e14334c7f14d, role_id=9f88c83743f745a9a785a2f454753f06)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:50.477660 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed2f35a-985b-4b8d-9dd9-f1b82ba401aa admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:50.493744 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1308/2626] 10.222.0.43 () {60 vars in 1482 bytes} [Wed Jun 22 10:22:50 2022] PUT /identity/v3/projects/b8b4839f7b9f4c2eb7ddb165fccd2030/users/528f8a52cbc546ee8654e14334c7f14d/roles/9f88c83743f745a9a785a2f454753f06 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:22:50.503513 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c381f18e-0384-44c7-9992-a772d10d5b4e None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:50.503809 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c381f18e-0384-44c7-9992-a772d10d5b4e None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:50.504097 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c381f18e-0384-44c7-9992-a772d10d5b4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:50.534337 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-c381f18e-0384-44c7-9992-a772d10d5b4e None None] MFA Rules not processed for user `528f8a52cbc546ee8654e14334c7f14d`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:22:50.535889 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-c381f18e-0384-44c7-9992-a772d10d5b4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:50.616349 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1319/2627] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:22:50 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:22:50.620723 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed2f35a-985b-4b8d-9dd9-f1b82ba401aa admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:50.690087 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed2f35a-985b-4b8d-9dd9-f1b82ba401aa admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:50.694820 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677c9924-1cf7-4471-9cb5-982122cde653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:50.695491 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677c9924-1cf7-4471-9cb5-982122cde653 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:50.695778 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677c9924-1cf7-4471-9cb5-982122cde653 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:50.696062 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677c9924-1cf7-4471-9cb5-982122cde653 admin admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:50.696765 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677c9924-1cf7-4471-9cb5-982122cde653 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:50.698716 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677c9924-1cf7-4471-9cb5-982122cde653 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:50.727604 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1309/2628] 10.222.0.43 () {60 vars in 1152 bytes} [Wed Jun 22 10:22:50 2022] POST /identity/v3/projects => generated 379 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:22:50.731636 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c381f18e-0384-44c7-9992-a772d10d5b4e None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:50.743501 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c381f18e-0384-44c7-9992-a772d10d5b4e None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:50.763329 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:22:50.813973 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b53175-7a24-4a3f-a90c-c2ddf478ef8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:50.814694 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b53175-7a24-4a3f-a90c-c2ddf478ef8e admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:50.814981 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b53175-7a24-4a3f-a90c-c2ddf478ef8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:50.815268 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b53175-7a24-4a3f-a90c-c2ddf478ef8e admin admin] PATH_INFO: `/v3/users` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:50.816040 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b53175-7a24-4a3f-a90c-c2ddf478ef8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:50.818143 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b53175-7a24-4a3f-a90c-c2ddf478ef8e admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:50.851128 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1320/2629] 10.222.0.43 () {60 vars in 1143 bytes} [Wed Jun 22 10:22:50 2022] POST /identity/v3/users => generated 290 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 10:22:50.851619 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677c9924-1cf7-4471-9cb5-982122cde653 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:50.868163 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677c9924-1cf7-4471-9cb5-982122cde653 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:50.880958 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c875a0-d8d4-4407-ad01-6cd29e7ffad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:50.881651 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c875a0-d8d4-4407-ad01-6cd29e7ffad7 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:50.881968 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c875a0-d8d4-4407-ad01-6cd29e7ffad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:50.882747 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c875a0-d8d4-4407-ad01-6cd29e7ffad7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:50.883432 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c875a0-d8d4-4407-ad01-6cd29e7ffad7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:50.885402 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c875a0-d8d4-4407-ad01-6cd29e7ffad7 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:50.903954 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b53175-7a24-4a3f-a90c-c2ddf478ef8e admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:50.911782 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1310/2630] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:22:50 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:22:50.917827 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b53175-7a24-4a3f-a90c-c2ddf478ef8e admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:50.925228 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42113e1d-9b83-46d0-a8fa-fe54de9d9b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:50.926164 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42113e1d-9b83-46d0-a8fa-fe54de9d9b82 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:50.934582 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42113e1d-9b83-46d0-a8fa-fe54de9d9b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:50.935069 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42113e1d-9b83-46d0-a8fa-fe54de9d9b82 admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:50.936407 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42113e1d-9b83-46d0-a8fa-fe54de9d9b82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:50.938078 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42113e1d-9b83-46d0-a8fa-fe54de9d9b82 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:50.959015 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1321/2631] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:22:50 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:22:50.963149 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c875a0-d8d4-4407-ad01-6cd29e7ffad7 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:50.977451 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c875a0-d8d4-4407-ad01-6cd29e7ffad7 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:50.983355 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2710c2d-e576-490e-84bc-85d5db9e8845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:50.984263 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2710c2d-e576-490e-84bc-85d5db9e8845 admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:50.984534 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2710c2d-e576-490e-84bc-85d5db9e8845 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:50.984966 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2710c2d-e576-490e-84bc-85d5db9e8845 admin admin] PATH_INFO: `/v3/projects/4468be1a74ff4dc9ad61402db44946a4/users/29705397f0d94837b96c4b910ed6352d/roles/9f88c83743f745a9a785a2f454753f06` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:51.006399 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2710c2d-e576-490e-84bc-85d5db9e8845 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4468be1a74ff4dc9ad61402db44946a4, user_id=29705397f0d94837b96c4b910ed6352d, role_id=9f88c83743f745a9a785a2f454753f06)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:51.009087 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2710c2d-e576-490e-84bc-85d5db9e8845 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:51.029398 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1311/2632] 10.222.0.43 () {60 vars in 1482 bytes} [Wed Jun 22 10:22:50 2022] PUT /identity/v3/projects/4468be1a74ff4dc9ad61402db44946a4/users/29705397f0d94837b96c4b910ed6352d/roles/9f88c83743f745a9a785a2f454753f06 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:22:51.036904 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb108c8-c9fc-4364-920b-66183328d5ad None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:51.037414 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb108c8-c9fc-4364-920b-66183328d5ad None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:51.037532 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb108c8-c9fc-4364-920b-66183328d5ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:51.039628 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2710c2d-e576-490e-84bc-85d5db9e8845 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:51.041484 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-c2710c2d-e576-490e-84bc-85d5db9e8845 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:51.067861 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-cdb108c8-c9fc-4364-920b-66183328d5ad None None] MFA Rules not processed for user `29705397f0d94837b96c4b910ed6352d`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:22:51.069622 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-cdb108c8-c9fc-4364-920b-66183328d5ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:51.118152 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2710c2d-e576-490e-84bc-85d5db9e8845 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:51.124649 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77340e44-4d2a-4eaf-844e-aa307bdb9e0f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bbcb3d4dc704dfdb0097abc594ca855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:51.125300 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77340e44-4d2a-4eaf-844e-aa307bdb9e0f service cinder] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:51.125628 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77340e44-4d2a-4eaf-844e-aa307bdb9e0f service cinder] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:51.125909 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77340e44-4d2a-4eaf-844e-aa307bdb9e0f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:51.128249 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-77340e44-4d2a-4eaf-844e-aa307bdb9e0f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:51.156515 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1322/2633] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:22:51 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:22:51.161403 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb108c8-c9fc-4364-920b-66183328d5ad None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:51.165369 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:22:51.226599 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77340e44-4d2a-4eaf-844e-aa307bdb9e0f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:51.228231 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77340e44-4d2a-4eaf-844e-aa307bdb9e0f service cinder] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:51.240035 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1312/2634] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:22:51 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:22:51.259452 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb108c8-c9fc-4364-920b-66183328d5ad None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:51.267035 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ce0f4f-ef19-4637-a47b-ffde9270e726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:51.267935 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ce0f4f-ef19-4637-a47b-ffde9270e726 admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:51.268445 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ce0f4f-ef19-4637-a47b-ffde9270e726 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:51.269213 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ce0f4f-ef19-4637-a47b-ffde9270e726 admin admin] PATH_INFO: `/v3/projects` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:51.269723 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ce0f4f-ef19-4637-a47b-ffde9270e726 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:51.274954 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ce0f4f-ef19-4637-a47b-ffde9270e726 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:51.313846 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77340e44-4d2a-4eaf-844e-aa307bdb9e0f service cinder] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:51.321868 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1323/2635] 10.222.0.43 () {60 vars in 1152 bytes} [Wed Jun 22 10:22:51 2022] POST /identity/v3/projects => generated 379 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:22:51.331838 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77340e44-4d2a-4eaf-844e-aa307bdb9e0f service cinder] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:51.434199 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437e5047-2724-4c7b-bdd5-cfc5f113ca5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:51.435055 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437e5047-2724-4c7b-bdd5-cfc5f113ca5a admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:51.435250 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437e5047-2724-4c7b-bdd5-cfc5f113ca5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:51.435822 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437e5047-2724-4c7b-bdd5-cfc5f113ca5a admin admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:51.436856 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437e5047-2724-4c7b-bdd5-cfc5f113ca5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:51.438862 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437e5047-2724-4c7b-bdd5-cfc5f113ca5a admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:51.472714 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1313/2636] 10.222.0.43 () {60 vars in 1143 bytes} [Wed Jun 22 10:22:51 2022] POST /identity/v3/users => generated 296 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 10:22:51.481812 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ce0f4f-ef19-4637-a47b-ffde9270e726 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:51.496118 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ce0f4f-ef19-4637-a47b-ffde9270e726 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:51.501127 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a75f954-d1f5-4ef5-90de-aab4324a1e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:51.501935 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a75f954-d1f5-4ef5-90de-aab4324a1e1f admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:51.502234 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a75f954-d1f5-4ef5-90de-aab4324a1e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:51.502521 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a75f954-d1f5-4ef5-90de-aab4324a1e1f admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:51.503272 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a75f954-d1f5-4ef5-90de-aab4324a1e1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:51.504926 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a75f954-d1f5-4ef5-90de-aab4324a1e1f admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:51.521423 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1324/2637] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:22:51 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:22:51.522998 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437e5047-2724-4c7b-bdd5-cfc5f113ca5a admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:51.535698 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437e5047-2724-4c7b-bdd5-cfc5f113ca5a admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:51.542582 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a57500-255b-4ce2-9f4b-8c26bcecb62d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:51.544422 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a57500-255b-4ce2-9f4b-8c26bcecb62d admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:51.544864 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a57500-255b-4ce2-9f4b-8c26bcecb62d admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:51.545186 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a57500-255b-4ce2-9f4b-8c26bcecb62d admin admin] PATH_INFO: `/v3/projects/40254f8cc3af41c884f9a301af34a500/users/e7b2a924be944d9dbc2d877d02c30850/roles/26d9c2ab5dfc4e6d9ca80c6014123906` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:51.562089 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a57500-255b-4ce2-9f4b-8c26bcecb62d admin admin] RBAC: Authorizing `identity:create_grant(project_id=40254f8cc3af41c884f9a301af34a500, user_id=e7b2a924be944d9dbc2d877d02c30850, role_id=26d9c2ab5dfc4e6d9ca80c6014123906)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:51.564872 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a57500-255b-4ce2-9f4b-8c26bcecb62d admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:51.586920 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1314/2638] 10.222.0.43 () {60 vars in 1482 bytes} [Wed Jun 22 10:22:51 2022] PUT /identity/v3/projects/40254f8cc3af41c884f9a301af34a500/users/e7b2a924be944d9dbc2d877d02c30850/roles/26d9c2ab5dfc4e6d9ca80c6014123906 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:22:51.590230 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a75f954-d1f5-4ef5-90de-aab4324a1e1f admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:51.598239 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:22:51.604234 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a75f954-d1f5-4ef5-90de-aab4324a1e1f admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:51.679901 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc6eba1-a9f0-4912-b7b3-e1765ad56559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:51.680612 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc6eba1-a9f0-4912-b7b3-e1765ad56559 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:51.681027 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc6eba1-a9f0-4912-b7b3-e1765ad56559 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:51.681196 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc6eba1-a9f0-4912-b7b3-e1765ad56559 admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:51.682600 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc6eba1-a9f0-4912-b7b3-e1765ad56559 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:51.683571 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc6eba1-a9f0-4912-b7b3-e1765ad56559 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:51.698145 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1325/2639] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:22:51 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:22:51.699382 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a57500-255b-4ce2-9f4b-8c26bcecb62d admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:51.711705 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a57500-255b-4ce2-9f4b-8c26bcecb62d admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:51.717640 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6163939e-ef6b-4a7a-a3d4-d87f756e3b8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:51.718646 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6163939e-ef6b-4a7a-a3d4-d87f756e3b8e admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:51.718935 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6163939e-ef6b-4a7a-a3d4-d87f756e3b8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:51.719216 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6163939e-ef6b-4a7a-a3d4-d87f756e3b8e admin admin] PATH_INFO: `/v3/projects/40254f8cc3af41c884f9a301af34a500/users/e7b2a924be944d9dbc2d877d02c30850/roles/26d9c2ab5dfc4e6d9ca80c6014123906` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:51.721769 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6163939e-ef6b-4a7a-a3d4-d87f756e3b8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=40254f8cc3af41c884f9a301af34a500, user_id=e7b2a924be944d9dbc2d877d02c30850, role_id=26d9c2ab5dfc4e6d9ca80c6014123906)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:51.724914 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6163939e-ef6b-4a7a-a3d4-d87f756e3b8e admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:51.736836 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1315/2640] 10.222.0.43 () {60 vars in 1482 bytes} [Wed Jun 22 10:22:51 2022] PUT /identity/v3/projects/40254f8cc3af41c884f9a301af34a500/users/e7b2a924be944d9dbc2d877d02c30850/roles/26d9c2ab5dfc4e6d9ca80c6014123906 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:22:51.749131 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60905d48-f935-4ea5-ab83-5ebd4e79f645 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:51.749866 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60905d48-f935-4ea5-ab83-5ebd4e79f645 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:51.750345 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60905d48-f935-4ea5-ab83-5ebd4e79f645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:51.779680 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-60905d48-f935-4ea5-ab83-5ebd4e79f645 None None] MFA Rules not processed for user `e7b2a924be944d9dbc2d877d02c30850`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:22:51.780954 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-60905d48-f935-4ea5-ab83-5ebd4e79f645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:51.859151 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1326/2641] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:22:51 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:22:51.871127 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6163939e-ef6b-4a7a-a3d4-d87f756e3b8e admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:51.943584 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6163939e-ef6b-4a7a-a3d4-d87f756e3b8e admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:51.949924 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b1908d-81fa-4d2c-875c-e6dbc57de276 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bbcb3d4dc704dfdb0097abc594ca855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:51.949924 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b1908d-81fa-4d2c-875c-e6dbc57de276 service cinder] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:51.949924 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b1908d-81fa-4d2c-875c-e6dbc57de276 service cinder] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:51.949924 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b1908d-81fa-4d2c-875c-e6dbc57de276 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:51.963748 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b1908d-81fa-4d2c-875c-e6dbc57de276 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:51.965301 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b1908d-81fa-4d2c-875c-e6dbc57de276 service cinder] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:51.978916 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1316/2642] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:22:51 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:22:52.021954 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60905d48-f935-4ea5-ab83-5ebd4e79f645 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:52.023552 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-60905d48-f935-4ea5-ab83-5ebd4e79f645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:52.037949 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60905d48-f935-4ea5-ab83-5ebd4e79f645 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:52.041752 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c19fe34-daf4-402d-a11e-15b88b0220dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bbcb3d4dc704dfdb0097abc594ca855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:52.042576 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c19fe34-daf4-402d-a11e-15b88b0220dd service cinder] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:52.042957 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c19fe34-daf4-402d-a11e-15b88b0220dd service cinder] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:52.043306 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c19fe34-daf4-402d-a11e-15b88b0220dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:52.114481 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c19fe34-daf4-402d-a11e-15b88b0220dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:52.115742 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c19fe34-daf4-402d-a11e-15b88b0220dd service cinder] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:52.127223 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1327/2643] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:22:52 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:22:55.145902 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b1908d-81fa-4d2c-875c-e6dbc57de276 service cinder] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:55.173539 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:22:55.213085 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b1908d-81fa-4d2c-875c-e6dbc57de276 service cinder] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:55.218458 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ea69b5-f816-4185-bc04-4055d913a513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:55.219360 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ea69b5-f816-4185-bc04-4055d913a513 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:55.219650 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ea69b5-f816-4185-bc04-4055d913a513 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:55.219931 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ea69b5-f816-4185-bc04-4055d913a513 admin admin] PATH_INFO: `/v3/users/528f8a52cbc546ee8654e14334c7f14d` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:55.221155 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ea69b5-f816-4185-bc04-4055d913a513 admin admin] RBAC: Authorizing `identity:delete_user(user_id=528f8a52cbc546ee8654e14334c7f14d)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:55.223174 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ea69b5-f816-4185-bc04-4055d913a513 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:55.274831 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-61ea69b5-f816-4185-bc04-4055d913a513 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '528f8a52cbc546ee8654e14334c7f14d'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:55.289040 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-61ea69b5-f816-4185-bc04-4055d913a513 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '528f8a52cbc546ee8654e14334c7f14d'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:55.298429 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-61ea69b5-f816-4185-bc04-4055d913a513 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '528f8a52cbc546ee8654e14334c7f14d'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:55.299315 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-61ea69b5-f816-4185-bc04-4055d913a513 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '528f8a52cbc546ee8654e14334c7f14d'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:55.307676 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-61ea69b5-f816-4185-bc04-4055d913a513 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '528f8a52cbc546ee8654e14334c7f14d'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:55.315350 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1317/2644] 10.222.0.43 () {58 vars in 1223 bytes} [Wed Jun 22 10:22:55 2022] DELETE /identity/v3/users/528f8a52cbc546ee8654e14334c7f14d => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:22:55.319938 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea80b4cc-1f7b-462d-9c95-aac4383a78a7 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:55.320466 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea80b4cc-1f7b-462d-9c95-aac4383a78a7 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:55.320826 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea80b4cc-1f7b-462d-9c95-aac4383a78a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:55.338925 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-ea80b4cc-1f7b-462d-9c95-aac4383a78a7 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:22:55.340110 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-ea80b4cc-1f7b-462d-9c95-aac4383a78a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:55.363089 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:22:55.409580 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1328/2645] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:22:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:22:55.420008 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ea69b5-f816-4185-bc04-4055d913a513 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:55.422463 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-61ea69b5-f816-4185-bc04-4055d913a513 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:55.489136 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ea69b5-f816-4185-bc04-4055d913a513 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:55.492873 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1c7269-d77a-495a-b58f-2d4f337ba216 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe93d4c0737249fd8623bb5ce188e34e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:55.493620 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1c7269-d77a-495a-b58f-2d4f337ba216 service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:55.493837 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1c7269-d77a-495a-b58f-2d4f337ba216 service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:55.494117 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1c7269-d77a-495a-b58f-2d4f337ba216 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:55.503969 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1c7269-d77a-495a-b58f-2d4f337ba216 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:55.505462 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1c7269-d77a-495a-b58f-2d4f337ba216 service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:55.515911 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1318/2646] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:22:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:22:55.790425 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea80b4cc-1f7b-462d-9c95-aac4383a78a7 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:55.791988 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-ea80b4cc-1f7b-462d-9c95-aac4383a78a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:55.805385 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea80b4cc-1f7b-462d-9c95-aac4383a78a7 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:55.810590 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354341fb-84bd-4d45-835c-e8dd80d6ec0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:55.811498 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354341fb-84bd-4d45-835c-e8dd80d6ec0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:55.812710 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354341fb-84bd-4d45-835c-e8dd80d6ec0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:55.812994 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354341fb-84bd-4d45-835c-e8dd80d6ec0f admin admin] PATH_INFO: `/v3/projects/b8b4839f7b9f4c2eb7ddb165fccd2030` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:55.814419 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354341fb-84bd-4d45-835c-e8dd80d6ec0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8b4839f7b9f4c2eb7ddb165fccd2030)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:55.816502 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354341fb-84bd-4d45-835c-e8dd80d6ec0f admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:55.864767 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-354341fb-84bd-4d45-835c-e8dd80d6ec0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8b4839f7b9f4c2eb7ddb165fccd2030', 'request_id': 'req-354341fb-84bd-4d45-835c-e8dd80d6ec0f'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:55.870957 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-354341fb-84bd-4d45-835c-e8dd80d6ec0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8b4839f7b9f4c2eb7ddb165fccd2030', 'request_id': 'req-354341fb-84bd-4d45-835c-e8dd80d6ec0f'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:55.877258 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-354341fb-84bd-4d45-835c-e8dd80d6ec0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8b4839f7b9f4c2eb7ddb165fccd2030', 'request_id': 'req-354341fb-84bd-4d45-835c-e8dd80d6ec0f'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:55.889142 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-354341fb-84bd-4d45-835c-e8dd80d6ec0f admin admin] The token cache is being invalidate because project b8b4839f7b9f4c2eb7ddb165fccd2030 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:22:55.889430 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-354341fb-84bd-4d45-835c-e8dd80d6ec0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:55.893678 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-354341fb-84bd-4d45-835c-e8dd80d6ec0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:55.895294 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1329/2647] 10.222.0.43 () {58 vars in 1232 bytes} [Wed Jun 22 10:22:55 2022] DELETE /identity/v3/projects/b8b4839f7b9f4c2eb7ddb165fccd2030 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:22:55.899368 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1c7269-d77a-495a-b58f-2d4f337ba216 service neutron] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:55.908926 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1c7269-d77a-495a-b58f-2d4f337ba216 service neutron] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:55.945266 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:22:55.969594 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399d4acb-3d8d-48ed-a74a-0239d83932ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:55.970501 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399d4acb-3d8d-48ed-a74a-0239d83932ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:55.970782 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399d4acb-3d8d-48ed-a74a-0239d83932ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:55.971063 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399d4acb-3d8d-48ed-a74a-0239d83932ca admin admin] PATH_INFO: `/v3/users/29705397f0d94837b96c4b910ed6352d` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:55.972258 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399d4acb-3d8d-48ed-a74a-0239d83932ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=29705397f0d94837b96c4b910ed6352d)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:55.974326 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399d4acb-3d8d-48ed-a74a-0239d83932ca admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:56.018925 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-399d4acb-3d8d-48ed-a74a-0239d83932ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29705397f0d94837b96c4b910ed6352d'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:56.031668 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-399d4acb-3d8d-48ed-a74a-0239d83932ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29705397f0d94837b96c4b910ed6352d'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:56.041446 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-399d4acb-3d8d-48ed-a74a-0239d83932ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29705397f0d94837b96c4b910ed6352d'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:56.042447 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-399d4acb-3d8d-48ed-a74a-0239d83932ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29705397f0d94837b96c4b910ed6352d'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:56.052748 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-399d4acb-3d8d-48ed-a74a-0239d83932ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29705397f0d94837b96c4b910ed6352d'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:56.059375 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1319/2648] 10.222.0.43 () {58 vars in 1223 bytes} [Wed Jun 22 10:22:55 2022] DELETE /identity/v3/users/29705397f0d94837b96c4b910ed6352d => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:22:56.340919 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354341fb-84bd-4d45-835c-e8dd80d6ec0f admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:56.342620 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-354341fb-84bd-4d45-835c-e8dd80d6ec0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:56.356494 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354341fb-84bd-4d45-835c-e8dd80d6ec0f admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:56.429003 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4424ecfe-093d-4c0d-a88d-16b44100401a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:56.429908 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4424ecfe-093d-4c0d-a88d-16b44100401a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:56.430191 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4424ecfe-093d-4c0d-a88d-16b44100401a admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:56.430463 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4424ecfe-093d-4c0d-a88d-16b44100401a admin admin] PATH_INFO: `/v3/projects/4468be1a74ff4dc9ad61402db44946a4` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:56.432292 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4424ecfe-093d-4c0d-a88d-16b44100401a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4468be1a74ff4dc9ad61402db44946a4)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:56.434240 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4424ecfe-093d-4c0d-a88d-16b44100401a admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:56.493469 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-4424ecfe-093d-4c0d-a88d-16b44100401a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4468be1a74ff4dc9ad61402db44946a4', 'request_id': 'req-4424ecfe-093d-4c0d-a88d-16b44100401a'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:56.494805 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:22:56.502307 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-4424ecfe-093d-4c0d-a88d-16b44100401a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4468be1a74ff4dc9ad61402db44946a4', 'request_id': 'req-4424ecfe-093d-4c0d-a88d-16b44100401a'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:56.510912 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-4424ecfe-093d-4c0d-a88d-16b44100401a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4468be1a74ff4dc9ad61402db44946a4', 'request_id': 'req-4424ecfe-093d-4c0d-a88d-16b44100401a'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:56.527327 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-4424ecfe-093d-4c0d-a88d-16b44100401a admin admin] The token cache is being invalidate because project 4468be1a74ff4dc9ad61402db44946a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:22:56.527750 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-4424ecfe-093d-4c0d-a88d-16b44100401a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:56.528309 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-4424ecfe-093d-4c0d-a88d-16b44100401a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:56.530388 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1330/2649] 10.222.0.43 () {58 vars in 1232 bytes} [Wed Jun 22 10:22:56 2022] DELETE /identity/v3/projects/4468be1a74ff4dc9ad61402db44946a4 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:22:56.534753 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399d4acb-3d8d-48ed-a74a-0239d83932ca admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:56.536694 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-399d4acb-3d8d-48ed-a74a-0239d83932ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:56.552763 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399d4acb-3d8d-48ed-a74a-0239d83932ca admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:56.635175 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe071362-14f7-4cfe-91ee-99796e4c8843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:56.636064 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe071362-14f7-4cfe-91ee-99796e4c8843 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:56.636349 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe071362-14f7-4cfe-91ee-99796e4c8843 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:56.636627 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe071362-14f7-4cfe-91ee-99796e4c8843 admin admin] PATH_INFO: `/v3/users/e7b2a924be944d9dbc2d877d02c30850` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:56.637996 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe071362-14f7-4cfe-91ee-99796e4c8843 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7b2a924be944d9dbc2d877d02c30850)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:56.640131 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe071362-14f7-4cfe-91ee-99796e4c8843 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:56.701432 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-fe071362-14f7-4cfe-91ee-99796e4c8843 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7b2a924be944d9dbc2d877d02c30850'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:56.710051 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:22:56.716670 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-fe071362-14f7-4cfe-91ee-99796e4c8843 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7b2a924be944d9dbc2d877d02c30850'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:56.727172 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-fe071362-14f7-4cfe-91ee-99796e4c8843 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7b2a924be944d9dbc2d877d02c30850'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:56.727799 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-fe071362-14f7-4cfe-91ee-99796e4c8843 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7b2a924be944d9dbc2d877d02c30850'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:56.735950 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-fe071362-14f7-4cfe-91ee-99796e4c8843 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7b2a924be944d9dbc2d877d02c30850'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:56.742647 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1320/2650] 10.222.0.43 () {58 vars in 1223 bytes} [Wed Jun 22 10:22:56 2022] DELETE /identity/v3/users/e7b2a924be944d9dbc2d877d02c30850 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:22:57.023752 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4424ecfe-093d-4c0d-a88d-16b44100401a admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:57.025408 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-4424ecfe-093d-4c0d-a88d-16b44100401a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:57.041220 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4424ecfe-093d-4c0d-a88d-16b44100401a admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:57.101669 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7edb97-c8e6-4fcc-8491-c00633aa8d2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:57.102558 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7edb97-c8e6-4fcc-8491-c00633aa8d2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:57.102847 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7edb97-c8e6-4fcc-8491-c00633aa8d2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:57.103127 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7edb97-c8e6-4fcc-8491-c00633aa8d2d admin admin] PATH_INFO: `/v3/projects/40254f8cc3af41c884f9a301af34a500` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:57.104365 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7edb97-c8e6-4fcc-8491-c00633aa8d2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=40254f8cc3af41c884f9a301af34a500)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:57.106420 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7edb97-c8e6-4fcc-8491-c00633aa8d2d admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:57.154282 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-0b7edb97-c8e6-4fcc-8491-c00633aa8d2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40254f8cc3af41c884f9a301af34a500', 'request_id': 'req-0b7edb97-c8e6-4fcc-8491-c00633aa8d2d'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:57.160605 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-0b7edb97-c8e6-4fcc-8491-c00633aa8d2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40254f8cc3af41c884f9a301af34a500', 'request_id': 'req-0b7edb97-c8e6-4fcc-8491-c00633aa8d2d'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:57.166081 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-0b7edb97-c8e6-4fcc-8491-c00633aa8d2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40254f8cc3af41c884f9a301af34a500', 'request_id': 'req-0b7edb97-c8e6-4fcc-8491-c00633aa8d2d'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:57.178967 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-0b7edb97-c8e6-4fcc-8491-c00633aa8d2d admin admin] The token cache is being invalidate because project 40254f8cc3af41c884f9a301af34a500 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:22:57.179276 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-0b7edb97-c8e6-4fcc-8491-c00633aa8d2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:57.179897 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-0b7edb97-c8e6-4fcc-8491-c00633aa8d2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:57.181424 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1331/2651] 10.222.0.43 () {58 vars in 1232 bytes} [Wed Jun 22 10:22:57 2022] DELETE /identity/v3/projects/40254f8cc3af41c884f9a301af34a500 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:22:57.188032 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2916c819-5815-46fd-a221-16e38d9cbedb None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:57.188334 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2916c819-5815-46fd-a221-16e38d9cbedb None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:57.188623 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2916c819-5815-46fd-a221-16e38d9cbedb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:57.208461 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-2916c819-5815-46fd-a221-16e38d9cbedb None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:22:57.209613 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-2916c819-5815-46fd-a221-16e38d9cbedb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:57.269300 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1321/2652] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:22:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:22:57.277765 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fadf70e-0f59-4f0b-803e-89590e06e635 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:57.278060 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fadf70e-0f59-4f0b-803e-89590e06e635 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:57.278343 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fadf70e-0f59-4f0b-803e-89590e06e635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:57.296872 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-6fadf70e-0f59-4f0b-803e-89590e06e635 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:22:57.298109 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-6fadf70e-0f59-4f0b-803e-89590e06e635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:57.306027 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1332/2653] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:22:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:22:57.310307 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2916c819-5815-46fd-a221-16e38d9cbedb None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:57.320777 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2916c819-5815-46fd-a221-16e38d9cbedb None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:57.325364 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b6d9cf-e8e8-4893-964e-dc3564b98a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:57.326053 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b6d9cf-e8e8-4893-964e-dc3564b98a66 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:57.326342 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b6d9cf-e8e8-4893-964e-dc3564b98a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:57.326624 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b6d9cf-e8e8-4893-964e-dc3564b98a66 admin admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:57.327387 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b6d9cf-e8e8-4893-964e-dc3564b98a66 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:22:57.327763 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b6d9cf-e8e8-4893-964e-dc3564b98a66 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:57.329422 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b6d9cf-e8e8-4893-964e-dc3564b98a66 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:57.341220 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1322/2654] 10.222.0.43 () {58 vars in 1152 bytes} [Wed Jun 22 10:22:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:22:57.345753 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fadf70e-0f59-4f0b-803e-89590e06e635 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:57.355396 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fadf70e-0f59-4f0b-803e-89590e06e635 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:57.360705 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd72f40e-f9c6-4d99-ac1c-c1ed1219767c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:57.361356 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd72f40e-f9c6-4d99-ac1c-c1ed1219767c admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:57.361643 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd72f40e-f9c6-4d99-ac1c-c1ed1219767c admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:57.361976 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd72f40e-f9c6-4d99-ac1c-c1ed1219767c admin admin] PATH_INFO: `/v3/projects` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:57.362677 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd72f40e-f9c6-4d99-ac1c-c1ed1219767c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:57.364617 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd72f40e-f9c6-4d99-ac1c-c1ed1219767c admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:57.389763 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1333/2655] 10.222.0.43 () {60 vars in 1152 bytes} [Wed Jun 22 10:22:57 2022] POST /identity/v3/projects => generated 383 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:22:57.394650 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b6d9cf-e8e8-4893-964e-dc3564b98a66 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:57.404400 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b6d9cf-e8e8-4893-964e-dc3564b98a66 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:57.460897 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2238636b-b5fb-46c8-b748-ef14352737cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:57.461527 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2238636b-b5fb-46c8-b748-ef14352737cd admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:57.461849 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2238636b-b5fb-46c8-b748-ef14352737cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:57.462134 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2238636b-b5fb-46c8-b748-ef14352737cd admin admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:57.462863 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2238636b-b5fb-46c8-b748-ef14352737cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:57.464873 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2238636b-b5fb-46c8-b748-ef14352737cd admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:57.485236 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1323/2656] 10.222.0.43 () {60 vars in 1143 bytes} [Wed Jun 22 10:22:57 2022] POST /identity/v3/users => generated 292 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:22:57.489359 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd72f40e-f9c6-4d99-ac1c-c1ed1219767c admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:57.499514 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd72f40e-f9c6-4d99-ac1c-c1ed1219767c admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:57.504278 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4512fd05-386d-4515-b0ce-a4a91b37255a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:57.504942 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4512fd05-386d-4515-b0ce-a4a91b37255a admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:57.505227 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4512fd05-386d-4515-b0ce-a4a91b37255a admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:57.505508 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4512fd05-386d-4515-b0ce-a4a91b37255a admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:57.506288 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4512fd05-386d-4515-b0ce-a4a91b37255a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:57.507897 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4512fd05-386d-4515-b0ce-a4a91b37255a admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:57.518943 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1334/2657] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:22:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:22:57.522720 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2238636b-b5fb-46c8-b748-ef14352737cd admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:57.533733 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2238636b-b5fb-46c8-b748-ef14352737cd admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:57.538435 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7b6313-8b19-4fc1-9c13-5bc30d84c75e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:57.539094 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7b6313-8b19-4fc1-9c13-5bc30d84c75e admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:57.539386 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7b6313-8b19-4fc1-9c13-5bc30d84c75e admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:57.539670 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7b6313-8b19-4fc1-9c13-5bc30d84c75e admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:57.540405 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7b6313-8b19-4fc1-9c13-5bc30d84c75e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:57.542156 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7b6313-8b19-4fc1-9c13-5bc30d84c75e admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:57.552177 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1324/2658] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:22:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 10:22:57.556142 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4512fd05-386d-4515-b0ce-a4a91b37255a admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:57.566470 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4512fd05-386d-4515-b0ce-a4a91b37255a admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:57.570972 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234623bf-a53d-40b3-b83e-66505b97f43b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:57.571835 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234623bf-a53d-40b3-b83e-66505b97f43b admin admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:57.572118 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234623bf-a53d-40b3-b83e-66505b97f43b admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:57.572396 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234623bf-a53d-40b3-b83e-66505b97f43b admin admin] PATH_INFO: `/v3/projects/3710fd33ac2e4b218e6cbfadb69b95fc/users/e089ed4c9f9341fb8a13a9f9aac861b8/roles/9f88c83743f745a9a785a2f454753f06` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:57.588143 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234623bf-a53d-40b3-b83e-66505b97f43b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3710fd33ac2e4b218e6cbfadb69b95fc, user_id=e089ed4c9f9341fb8a13a9f9aac861b8, role_id=9f88c83743f745a9a785a2f454753f06)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:57.590850 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234623bf-a53d-40b3-b83e-66505b97f43b admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:57.603750 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1335/2659] 10.222.0.43 () {60 vars in 1482 bytes} [Wed Jun 22 10:22:57 2022] PUT /identity/v3/projects/3710fd33ac2e4b218e6cbfadb69b95fc/users/e089ed4c9f9341fb8a13a9f9aac861b8/roles/9f88c83743f745a9a785a2f454753f06 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:22:57.615219 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aa4412-9fac-44fb-b60a-ea6cd9022aff None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:57.615536 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aa4412-9fac-44fb-b60a-ea6cd9022aff None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:57.615810 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aa4412-9fac-44fb-b60a-ea6cd9022aff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:57.646932 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-56aa4412-9fac-44fb-b60a-ea6cd9022aff None None] MFA Rules not processed for user `e089ed4c9f9341fb8a13a9f9aac861b8`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:22:57.648225 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-56aa4412-9fac-44fb-b60a-ea6cd9022aff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:57.652163 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234623bf-a53d-40b3-b83e-66505b97f43b admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:57.653818 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-234623bf-a53d-40b3-b83e-66505b97f43b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:57.660633 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:22:57.682176 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:22:57.722265 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1325/2660] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:22:57 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:22:57.725791 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234623bf-a53d-40b3-b83e-66505b97f43b admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:57.726969 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aa4412-9fac-44fb-b60a-ea6cd9022aff None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:57.730832 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229855a5-75bb-48eb-9e3b-4849e9c453af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:57.731711 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229855a5-75bb-48eb-9e3b-4849e9c453af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:57.732011 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229855a5-75bb-48eb-9e3b-4849e9c453af admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:57.732294 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229855a5-75bb-48eb-9e3b-4849e9c453af admin admin] PATH_INFO: `/v3/users/1029e0ea7c164a798439fbff29f1098a` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:57.733500 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229855a5-75bb-48eb-9e3b-4849e9c453af admin admin] RBAC: Authorizing `identity:delete_user(user_id=1029e0ea7c164a798439fbff29f1098a)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:57.735483 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229855a5-75bb-48eb-9e3b-4849e9c453af admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:57.737494 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aa4412-9fac-44fb-b60a-ea6cd9022aff None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:57.742128 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c518a5-9dcd-47ee-af2c-607dca7235b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:57.742776 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c518a5-9dcd-47ee-af2c-607dca7235b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:57.743058 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c518a5-9dcd-47ee-af2c-607dca7235b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:57.743333 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c518a5-9dcd-47ee-af2c-607dca7235b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:57.744019 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c518a5-9dcd-47ee-af2c-607dca7235b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:57.745941 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c518a5-9dcd-47ee-af2c-607dca7235b6 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:57.776679 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1326/2661] 10.222.0.43 () {60 vars in 1152 bytes} [Wed Jun 22 10:22:57 2022] POST /identity/v3/projects => generated 383 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 10:22:57.781096 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c518a5-9dcd-47ee-af2c-607dca7235b6 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:57.798664 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-229855a5-75bb-48eb-9e3b-4849e9c453af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1029e0ea7c164a798439fbff29f1098a'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:57.814680 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-229855a5-75bb-48eb-9e3b-4849e9c453af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1029e0ea7c164a798439fbff29f1098a'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:57.823076 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-229855a5-75bb-48eb-9e3b-4849e9c453af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1029e0ea7c164a798439fbff29f1098a'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:57.832504 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-229855a5-75bb-48eb-9e3b-4849e9c453af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1029e0ea7c164a798439fbff29f1098a'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:57.833300 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-229855a5-75bb-48eb-9e3b-4849e9c453af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1029e0ea7c164a798439fbff29f1098a'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:57.840179 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1336/2662] 10.222.0.43 () {58 vars in 1223 bytes} [Wed Jun 22 10:22:57 2022] DELETE /identity/v3/users/1029e0ea7c164a798439fbff29f1098a => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:22:57.845002 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbdae7b-5e16-426e-9892-1085e35c4824 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:57.845301 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbdae7b-5e16-426e-9892-1085e35c4824 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:57.845578 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbdae7b-5e16-426e-9892-1085e35c4824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:57.858732 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c518a5-9dcd-47ee-af2c-607dca7235b6 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:57.865228 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-fdbdae7b-5e16-426e-9892-1085e35c4824 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:22:57.866481 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-fdbdae7b-5e16-426e-9892-1085e35c4824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:57.924891 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a8a2ac-8561-4499-a5b7-a22ce42e7b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:57.925699 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a8a2ac-8561-4499-a5b7-a22ce42e7b98 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:57.926110 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a8a2ac-8561-4499-a5b7-a22ce42e7b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:57.926464 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a8a2ac-8561-4499-a5b7-a22ce42e7b98 admin admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:57.927547 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a8a2ac-8561-4499-a5b7-a22ce42e7b98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:57.929168 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a8a2ac-8561-4499-a5b7-a22ce42e7b98 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:57.947171 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1337/2663] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:22:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:22:57.953616 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1327/2664] 10.222.0.43 () {60 vars in 1143 bytes} [Wed Jun 22 10:22:57 2022] POST /identity/v3/users => generated 298 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:22:57.957426 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbdae7b-5e16-426e-9892-1085e35c4824 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:57.959481 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a8a2ac-8561-4499-a5b7-a22ce42e7b98 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:57.959613 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-fdbdae7b-5e16-426e-9892-1085e35c4824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:57.961491 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-84a8a2ac-8561-4499-a5b7-a22ce42e7b98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:57.976924 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbdae7b-5e16-426e-9892-1085e35c4824 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:57.982595 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9247e303-b64b-42ad-bc4c-d5c0d4cf6cf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:57.983275 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9247e303-b64b-42ad-bc4c-d5c0d4cf6cf2 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:57.984084 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9247e303-b64b-42ad-bc4c-d5c0d4cf6cf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:57.984367 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9247e303-b64b-42ad-bc4c-d5c0d4cf6cf2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:57.985262 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9247e303-b64b-42ad-bc4c-d5c0d4cf6cf2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:57.987411 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9247e303-b64b-42ad-bc4c-d5c0d4cf6cf2 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:58.001949 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1338/2665] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:22:57 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:22:58.002940 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9247e303-b64b-42ad-bc4c-d5c0d4cf6cf2 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:58.020673 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9247e303-b64b-42ad-bc4c-d5c0d4cf6cf2 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:58.026307 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4760a7-69dd-4726-b5e7-30cd0153dd06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:58.027628 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4760a7-69dd-4726-b5e7-30cd0153dd06 admin admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:58.028080 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4760a7-69dd-4726-b5e7-30cd0153dd06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:58.028522 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4760a7-69dd-4726-b5e7-30cd0153dd06 admin admin] PATH_INFO: `/v3/projects/aec37aeb3844436098426091c9b15b0c/users/18ef782225904934937729ae285a6920/roles/26d9c2ab5dfc4e6d9ca80c6014123906` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:58.030980 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:22:58.043955 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a8a2ac-8561-4499-a5b7-a22ce42e7b98 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:58.047187 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:22:58.052212 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4760a7-69dd-4726-b5e7-30cd0153dd06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aec37aeb3844436098426091c9b15b0c, user_id=18ef782225904934937729ae285a6920, role_id=26d9c2ab5dfc4e6d9ca80c6014123906)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:58.052642 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38a4fc8-794f-4952-ba93-be16e4bb4fd1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe93d4c0737249fd8623bb5ce188e34e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:58.053664 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38a4fc8-794f-4952-ba93-be16e4bb4fd1 service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:58.054126 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38a4fc8-794f-4952-ba93-be16e4bb4fd1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:58.054416 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38a4fc8-794f-4952-ba93-be16e4bb4fd1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:58.057918 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4760a7-69dd-4726-b5e7-30cd0153dd06 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:58.071518 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38a4fc8-794f-4952-ba93-be16e4bb4fd1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:58.081140 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38a4fc8-794f-4952-ba93-be16e4bb4fd1 service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:58.081334 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1339/2666] 10.222.0.43 () {60 vars in 1482 bytes} [Wed Jun 22 10:22:58 2022] PUT /identity/v3/projects/aec37aeb3844436098426091c9b15b0c/users/18ef782225904934937729ae285a6920/roles/26d9c2ab5dfc4e6d9ca80c6014123906 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:22:58.084832 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4760a7-69dd-4726-b5e7-30cd0153dd06 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:58.087224 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1328/2667] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:22:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 10:22:58.173492 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4760a7-69dd-4726-b5e7-30cd0153dd06 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:58.178652 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63bac1e-c36a-4967-afc9-e6d702bab424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:58.179852 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63bac1e-c36a-4967-afc9-e6d702bab424 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:58.180135 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63bac1e-c36a-4967-afc9-e6d702bab424 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:58.180413 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63bac1e-c36a-4967-afc9-e6d702bab424 admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:58.181152 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63bac1e-c36a-4967-afc9-e6d702bab424 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:58.183147 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63bac1e-c36a-4967-afc9-e6d702bab424 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:58.193904 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1340/2668] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:22:58 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:22:58.198048 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38a4fc8-794f-4952-ba93-be16e4bb4fd1 service neutron] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:58.211795 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38a4fc8-794f-4952-ba93-be16e4bb4fd1 service neutron] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:58.216411 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8885178-df5a-4db0-b2a4-b64ee6287881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:58.217353 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8885178-df5a-4db0-b2a4-b64ee6287881 admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:58.217579 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8885178-df5a-4db0-b2a4-b64ee6287881 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:58.217898 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8885178-df5a-4db0-b2a4-b64ee6287881 admin admin] PATH_INFO: `/v3/projects/aec37aeb3844436098426091c9b15b0c/users/18ef782225904934937729ae285a6920/roles/26d9c2ab5dfc4e6d9ca80c6014123906` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:58.220694 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8885178-df5a-4db0-b2a4-b64ee6287881 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aec37aeb3844436098426091c9b15b0c, user_id=18ef782225904934937729ae285a6920, role_id=26d9c2ab5dfc4e6d9ca80c6014123906)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:58.223399 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8885178-df5a-4db0-b2a4-b64ee6287881 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:58.237874 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1329/2669] 10.222.0.43 () {60 vars in 1482 bytes} [Wed Jun 22 10:22:58 2022] PUT /identity/v3/projects/aec37aeb3844436098426091c9b15b0c/users/18ef782225904934937729ae285a6920/roles/26d9c2ab5dfc4e6d9ca80c6014123906 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:22:58.247209 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aa5db2-d109-4113-823b-6680edcf319d None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:58.247528 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aa5db2-d109-4113-823b-6680edcf319d None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:58.247885 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aa5db2-d109-4113-823b-6680edcf319d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:58.276634 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-f5aa5db2-d109-4113-823b-6680edcf319d None None] MFA Rules not processed for user `18ef782225904934937729ae285a6920`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:22:58.278027 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-f5aa5db2-d109-4113-823b-6680edcf319d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:58.355082 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1341/2670] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:22:58 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:22:58.368562 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8885178-df5a-4db0-b2a4-b64ee6287881 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:58.371026 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-c8885178-df5a-4db0-b2a4-b64ee6287881 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:58.380087 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aa5db2-d109-4113-823b-6680edcf319d None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:58.381559 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-f5aa5db2-d109-4113-823b-6680edcf319d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:58.458625 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8885178-df5a-4db0-b2a4-b64ee6287881 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:58.460366 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aa5db2-d109-4113-823b-6680edcf319d None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:58.462416 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b472e29d-d596-4c1e-a175-6101e9b48829 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bbcb3d4dc704dfdb0097abc594ca855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:58.463058 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b472e29d-d596-4c1e-a175-6101e9b48829 service cinder] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:58.463343 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b472e29d-d596-4c1e-a175-6101e9b48829 service cinder] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:58.463649 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b472e29d-d596-4c1e-a175-6101e9b48829 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:58.465015 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca881999-c0ae-4dfd-a667-309ecebf621d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:58.465434 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-b472e29d-d596-4c1e-a175-6101e9b48829 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:58.465926 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca881999-c0ae-4dfd-a667-309ecebf621d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:58.466209 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca881999-c0ae-4dfd-a667-309ecebf621d admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:58.466557 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca881999-c0ae-4dfd-a667-309ecebf621d admin admin] PATH_INFO: `/v3/projects/41ddd20aaadc438c8bb2f5689f3d0836` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:58.467689 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca881999-c0ae-4dfd-a667-309ecebf621d admin admin] RBAC: Authorizing `identity:delete_project(project_id=41ddd20aaadc438c8bb2f5689f3d0836)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:58.470148 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca881999-c0ae-4dfd-a667-309ecebf621d admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:58.482646 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:22:58.520835 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-ca881999-c0ae-4dfd-a667-309ecebf621d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41ddd20aaadc438c8bb2f5689f3d0836', 'request_id': 'req-ca881999-c0ae-4dfd-a667-309ecebf621d'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:58.527992 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-ca881999-c0ae-4dfd-a667-309ecebf621d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41ddd20aaadc438c8bb2f5689f3d0836', 'request_id': 'req-ca881999-c0ae-4dfd-a667-309ecebf621d'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:58.528128 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b472e29d-d596-4c1e-a175-6101e9b48829 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:58.529442 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b472e29d-d596-4c1e-a175-6101e9b48829 service cinder] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:58.535366 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-ca881999-c0ae-4dfd-a667-309ecebf621d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41ddd20aaadc438c8bb2f5689f3d0836', 'request_id': 'req-ca881999-c0ae-4dfd-a667-309ecebf621d'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:58.540703 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1330/2671] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:22:58 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 10:22:58.549253 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-ca881999-c0ae-4dfd-a667-309ecebf621d admin admin] The token cache is being invalidate because project 41ddd20aaadc438c8bb2f5689f3d0836 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:22:58.549554 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-ca881999-c0ae-4dfd-a667-309ecebf621d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:58.550235 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-ca881999-c0ae-4dfd-a667-309ecebf621d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:22:58.551778 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1342/2672] 10.222.0.43 () {58 vars in 1232 bytes} [Wed Jun 22 10:22:58 2022] DELETE /identity/v3/projects/41ddd20aaadc438c8bb2f5689f3d0836 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:22:58.556885 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56776891-8b33-494e-b7ca-3f512a6bfcbb None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:58.557191 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56776891-8b33-494e-b7ca-3f512a6bfcbb None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:58.557497 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56776891-8b33-494e-b7ca-3f512a6bfcbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:58.575485 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-56776891-8b33-494e-b7ca-3f512a6bfcbb None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:22:58.576673 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-56776891-8b33-494e-b7ca-3f512a6bfcbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:58.641146 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1331/2673] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:22:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:22:58.648890 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997d91c2-cf82-41b7-af73-4004c4bb8046 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:58.649184 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997d91c2-cf82-41b7-af73-4004c4bb8046 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:58.649466 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997d91c2-cf82-41b7-af73-4004c4bb8046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:58.668132 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-997d91c2-cf82-41b7-af73-4004c4bb8046 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:22:58.669593 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-997d91c2-cf82-41b7-af73-4004c4bb8046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:58.678004 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1343/2674] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:22:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:22:58.682410 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56776891-8b33-494e-b7ca-3f512a6bfcbb None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:58.692979 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56776891-8b33-494e-b7ca-3f512a6bfcbb None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:58.697745 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e1126f-592a-44b3-bb5c-49acc8fa06ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:58.698404 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e1126f-592a-44b3-bb5c-49acc8fa06ec admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:58.698687 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e1126f-592a-44b3-bb5c-49acc8fa06ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:58.698965 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e1126f-592a-44b3-bb5c-49acc8fa06ec admin admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:58.699687 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e1126f-592a-44b3-bb5c-49acc8fa06ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:22:58.699991 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e1126f-592a-44b3-bb5c-49acc8fa06ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:58.701574 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e1126f-592a-44b3-bb5c-49acc8fa06ec admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:58.717573 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1332/2675] 10.222.0.43 () {58 vars in 1152 bytes} [Wed Jun 22 10:22:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:22:58.719507 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997d91c2-cf82-41b7-af73-4004c4bb8046 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:58.732757 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997d91c2-cf82-41b7-af73-4004c4bb8046 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:58.739387 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2596846b-d565-4624-89d0-4be163f2f76b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:58.740465 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2596846b-d565-4624-89d0-4be163f2f76b admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:58.740787 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2596846b-d565-4624-89d0-4be163f2f76b admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:58.741059 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2596846b-d565-4624-89d0-4be163f2f76b admin admin] PATH_INFO: `/v3/projects` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:58.741796 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2596846b-d565-4624-89d0-4be163f2f76b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:58.743696 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2596846b-d565-4624-89d0-4be163f2f76b admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:58.773112 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1344/2676] 10.222.0.43 () {60 vars in 1152 bytes} [Wed Jun 22 10:22:58 2022] POST /identity/v3/projects => generated 385 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:22:58.777330 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e1126f-592a-44b3-bb5c-49acc8fa06ec admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:58.788305 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e1126f-592a-44b3-bb5c-49acc8fa06ec admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:58.803218 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:22:58.856938 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80090a0d-e951-4be1-9da3-ea75b644701a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:58.857739 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80090a0d-e951-4be1-9da3-ea75b644701a admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:58.858033 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80090a0d-e951-4be1-9da3-ea75b644701a admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:58.858317 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80090a0d-e951-4be1-9da3-ea75b644701a admin admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:58.860061 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80090a0d-e951-4be1-9da3-ea75b644701a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:58.862038 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80090a0d-e951-4be1-9da3-ea75b644701a admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:58.885938 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1333/2677] 10.222.0.43 () {60 vars in 1143 bytes} [Wed Jun 22 10:22:58 2022] POST /identity/v3/users => generated 293 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:22:58.889796 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2596846b-d565-4624-89d0-4be163f2f76b admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:58.901742 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2596846b-d565-4624-89d0-4be163f2f76b admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:58.908583 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6b4a05-2f48-4df6-8214-0f63c5a7da5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:58.909330 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6b4a05-2f48-4df6-8214-0f63c5a7da5c admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:58.909738 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6b4a05-2f48-4df6-8214-0f63c5a7da5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:58.910091 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6b4a05-2f48-4df6-8214-0f63c5a7da5c admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:58.910927 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6b4a05-2f48-4df6-8214-0f63c5a7da5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:58.912699 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6b4a05-2f48-4df6-8214-0f63c5a7da5c admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:58.929602 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1345/2678] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:22:58 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:22:58.931278 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80090a0d-e951-4be1-9da3-ea75b644701a admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:58.942557 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80090a0d-e951-4be1-9da3-ea75b644701a admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:58.947285 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeb5e10-fdef-4459-bb17-84524103a233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:58.947962 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeb5e10-fdef-4459-bb17-84524103a233 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:58.948251 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeb5e10-fdef-4459-bb17-84524103a233 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:58.948533 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeb5e10-fdef-4459-bb17-84524103a233 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:58.949273 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbeb5e10-fdef-4459-bb17-84524103a233 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:58.950913 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbeb5e10-fdef-4459-bb17-84524103a233 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:58.961832 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1334/2679] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:22:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:22:58.966960 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6b4a05-2f48-4df6-8214-0f63c5a7da5c admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:58.978763 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6b4a05-2f48-4df6-8214-0f63c5a7da5c admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:58.983550 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336e5e6f-5bf9-4750-a774-628ca2ac5c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:58.985882 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336e5e6f-5bf9-4750-a774-628ca2ac5c1a admin admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:58.986175 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336e5e6f-5bf9-4750-a774-628ca2ac5c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:58.986457 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336e5e6f-5bf9-4750-a774-628ca2ac5c1a admin admin] PATH_INFO: `/v3/projects/06dbdcfd1d444846b08810da7d5dceed/users/c0fd31879eac4966805bc1ef6335b6cb/roles/9f88c83743f745a9a785a2f454753f06` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:59.003074 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336e5e6f-5bf9-4750-a774-628ca2ac5c1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=06dbdcfd1d444846b08810da7d5dceed, user_id=c0fd31879eac4966805bc1ef6335b6cb, role_id=9f88c83743f745a9a785a2f454753f06)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:59.005833 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336e5e6f-5bf9-4750-a774-628ca2ac5c1a admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:59.019188 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1346/2680] 10.222.0.43 () {60 vars in 1482 bytes} [Wed Jun 22 10:22:58 2022] PUT /identity/v3/projects/06dbdcfd1d444846b08810da7d5dceed/users/c0fd31879eac4966805bc1ef6335b6cb/roles/9f88c83743f745a9a785a2f454753f06 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:22:59.029534 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7c7c41-5a12-403c-984a-4560f2012b1a None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:59.029796 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7c7c41-5a12-403c-984a-4560f2012b1a None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:59.030092 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7c7c41-5a12-403c-984a-4560f2012b1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:59.056606 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-7c7c7c41-5a12-403c-984a-4560f2012b1a None None] MFA Rules not processed for user `c0fd31879eac4966805bc1ef6335b6cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:22:59.057858 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-7c7c7c41-5a12-403c-984a-4560f2012b1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:59.150039 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1335/2681] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:22:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:22:59.160984 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336e5e6f-5bf9-4750-a774-628ca2ac5c1a admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:22:59.162828 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-336e5e6f-5bf9-4750-a774-628ca2ac5c1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:22:59.224054 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336e5e6f-5bf9-4750-a774-628ca2ac5c1a admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:22:59.227958 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9504d4c-fa82-4022-aaf0-745241b9a793 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bbcb3d4dc704dfdb0097abc594ca855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:22:59.228736 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9504d4c-fa82-4022-aaf0-745241b9a793 service cinder] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:22:59.229026 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9504d4c-fa82-4022-aaf0-745241b9a793 service cinder] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:22:59.229302 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9504d4c-fa82-4022-aaf0-745241b9a793 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:22:59.238109 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9504d4c-fa82-4022-aaf0-745241b9a793 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:22:59.239658 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9504d4c-fa82-4022-aaf0-745241b9a793 service cinder] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:22:59.258425 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1347/2682] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:22:59 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:23:04.827767 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7c7c41-5a12-403c-984a-4560f2012b1a None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:04.837463 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7c7c41-5a12-403c-984a-4560f2012b1a None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:04.841042 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49ec7cc-1d91-4732-9987-e941d868c3ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bbcb3d4dc704dfdb0097abc594ca855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:04.841725 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49ec7cc-1d91-4732-9987-e941d868c3ac service cinder] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:04.842010 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49ec7cc-1d91-4732-9987-e941d868c3ac service cinder] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:04.842296 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49ec7cc-1d91-4732-9987-e941d868c3ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:04.844680 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-e49ec7cc-1d91-4732-9987-e941d868c3ac service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:23:04.912229 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49ec7cc-1d91-4732-9987-e941d868c3ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:04.914260 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49ec7cc-1d91-4732-9987-e941d868c3ac service cinder] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:04.928150 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1336/2683] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:23:04 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:23:05.502776 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9504d4c-fa82-4022-aaf0-745241b9a793 service cinder] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:05.504158 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-d9504d4c-fa82-4022-aaf0-745241b9a793 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:23:05.569674 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:23:05.600182 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9504d4c-fa82-4022-aaf0-745241b9a793 service cinder] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:05.605469 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdbde0a-0e24-4c55-b952-407515f54cfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:05.606487 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdbde0a-0e24-4c55-b952-407515f54cfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:05.606951 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdbde0a-0e24-4c55-b952-407515f54cfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:05.607297 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdbde0a-0e24-4c55-b952-407515f54cfd admin admin] PATH_INFO: `/v3/users/1fe3856322dd406abc36edaa6be4ca36` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:05.608926 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdbde0a-0e24-4c55-b952-407515f54cfd admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fe3856322dd406abc36edaa6be4ca36)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:05.610876 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdbde0a-0e24-4c55-b952-407515f54cfd admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:05.658583 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-3bdbde0a-0e24-4c55-b952-407515f54cfd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fe3856322dd406abc36edaa6be4ca36'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:05.670650 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-3bdbde0a-0e24-4c55-b952-407515f54cfd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fe3856322dd406abc36edaa6be4ca36'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:05.679247 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-3bdbde0a-0e24-4c55-b952-407515f54cfd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fe3856322dd406abc36edaa6be4ca36'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:05.686967 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-3bdbde0a-0e24-4c55-b952-407515f54cfd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fe3856322dd406abc36edaa6be4ca36'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:05.688013 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-3bdbde0a-0e24-4c55-b952-407515f54cfd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fe3856322dd406abc36edaa6be4ca36'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:05.694066 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1348/2684] 10.222.0.43 () {58 vars in 1223 bytes} [Wed Jun 22 10:23:05 2022] DELETE /identity/v3/users/1fe3856322dd406abc36edaa6be4ca36 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:23:05.878065 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49ec7cc-1d91-4732-9987-e941d868c3ac service cinder] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:05.888886 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49ec7cc-1d91-4732-9987-e941d868c3ac service cinder] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:05.911373 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:23:05.955525 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc5cfba-1b94-4386-b3fe-08c64e4e29d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:05.956392 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc5cfba-1b94-4386-b3fe-08c64e4e29d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:05.956682 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc5cfba-1b94-4386-b3fe-08c64e4e29d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:05.956965 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc5cfba-1b94-4386-b3fe-08c64e4e29d8 admin admin] PATH_INFO: `/v3/projects/c4a3ba9c256f4e6ba469dfb901d02f56` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:05.958180 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc5cfba-1b94-4386-b3fe-08c64e4e29d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4a3ba9c256f4e6ba469dfb901d02f56)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:05.960086 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc5cfba-1b94-4386-b3fe-08c64e4e29d8 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:06.006709 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-acc5cfba-1b94-4386-b3fe-08c64e4e29d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4a3ba9c256f4e6ba469dfb901d02f56', 'request_id': 'req-acc5cfba-1b94-4386-b3fe-08c64e4e29d8'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:06.012190 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-acc5cfba-1b94-4386-b3fe-08c64e4e29d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4a3ba9c256f4e6ba469dfb901d02f56', 'request_id': 'req-acc5cfba-1b94-4386-b3fe-08c64e4e29d8'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:06.019716 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-acc5cfba-1b94-4386-b3fe-08c64e4e29d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4a3ba9c256f4e6ba469dfb901d02f56', 'request_id': 'req-acc5cfba-1b94-4386-b3fe-08c64e4e29d8'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:06.031295 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-acc5cfba-1b94-4386-b3fe-08c64e4e29d8 admin admin] The token cache is being invalidate because project c4a3ba9c256f4e6ba469dfb901d02f56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:23:06.031591 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-acc5cfba-1b94-4386-b3fe-08c64e4e29d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:06.032231 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-acc5cfba-1b94-4386-b3fe-08c64e4e29d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:06.033840 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1337/2685] 10.222.0.43 () {58 vars in 1232 bytes} [Wed Jun 22 10:23:05 2022] DELETE /identity/v3/projects/c4a3ba9c256f4e6ba469dfb901d02f56 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:23:06.037819 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdbde0a-0e24-4c55-b952-407515f54cfd admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:06.039223 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-3bdbde0a-0e24-4c55-b952-407515f54cfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:23:06.052592 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdbde0a-0e24-4c55-b952-407515f54cfd admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:06.112531 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bec701-2fe7-4d75-b923-44c87f2966a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:06.113413 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bec701-2fe7-4d75-b923-44c87f2966a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:06.113709 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bec701-2fe7-4d75-b923-44c87f2966a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:06.114001 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bec701-2fe7-4d75-b923-44c87f2966a2 admin admin] PATH_INFO: `/v3/users/353be67a71fc48fb941c86d55c9eba75` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:06.115172 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bec701-2fe7-4d75-b923-44c87f2966a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=353be67a71fc48fb941c86d55c9eba75)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:06.117088 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bec701-2fe7-4d75-b923-44c87f2966a2 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:06.162623 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-46bec701-2fe7-4d75-b923-44c87f2966a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '353be67a71fc48fb941c86d55c9eba75'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:06.173052 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:23:06.175475 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-46bec701-2fe7-4d75-b923-44c87f2966a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '353be67a71fc48fb941c86d55c9eba75'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:06.183600 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-46bec701-2fe7-4d75-b923-44c87f2966a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '353be67a71fc48fb941c86d55c9eba75'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:06.193198 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-46bec701-2fe7-4d75-b923-44c87f2966a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '353be67a71fc48fb941c86d55c9eba75'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:06.193896 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-46bec701-2fe7-4d75-b923-44c87f2966a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '353be67a71fc48fb941c86d55c9eba75'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:06.199713 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1349/2686] 10.222.0.43 () {58 vars in 1223 bytes} [Wed Jun 22 10:23:06 2022] DELETE /identity/v3/users/353be67a71fc48fb941c86d55c9eba75 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:23:06.377557 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc5cfba-1b94-4386-b3fe-08c64e4e29d8 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:06.379041 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-acc5cfba-1b94-4386-b3fe-08c64e4e29d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:23:06.396848 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc5cfba-1b94-4386-b3fe-08c64e4e29d8 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:06.472541 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0861162e-db3e-4e64-b11c-da5b763733c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:06.473716 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0861162e-db3e-4e64-b11c-da5b763733c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:06.474035 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0861162e-db3e-4e64-b11c-da5b763733c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:06.474135 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0861162e-db3e-4e64-b11c-da5b763733c7 admin admin] PATH_INFO: `/v3/projects/c96c0d32e5c34861a87bf004ed7cf15d` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:06.475748 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0861162e-db3e-4e64-b11c-da5b763733c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c96c0d32e5c34861a87bf004ed7cf15d)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:06.478087 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0861162e-db3e-4e64-b11c-da5b763733c7 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:06.545573 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-0861162e-db3e-4e64-b11c-da5b763733c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c96c0d32e5c34861a87bf004ed7cf15d', 'request_id': 'req-0861162e-db3e-4e64-b11c-da5b763733c7'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:06.549012 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:23:06.556231 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-0861162e-db3e-4e64-b11c-da5b763733c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c96c0d32e5c34861a87bf004ed7cf15d', 'request_id': 'req-0861162e-db3e-4e64-b11c-da5b763733c7'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:06.569141 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-0861162e-db3e-4e64-b11c-da5b763733c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c96c0d32e5c34861a87bf004ed7cf15d', 'request_id': 'req-0861162e-db3e-4e64-b11c-da5b763733c7'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:06.584400 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-0861162e-db3e-4e64-b11c-da5b763733c7 admin admin] The token cache is being invalidate because project c96c0d32e5c34861a87bf004ed7cf15d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:23:06.584693 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-0861162e-db3e-4e64-b11c-da5b763733c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:06.585350 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-0861162e-db3e-4e64-b11c-da5b763733c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:06.586965 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1338/2687] 10.222.0.43 () {58 vars in 1232 bytes} [Wed Jun 22 10:23:06 2022] DELETE /identity/v3/projects/c96c0d32e5c34861a87bf004ed7cf15d => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:23:06.591787 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b493f60a-a299-41bd-9fda-4a14c6c0c927 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:06.592298 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b493f60a-a299-41bd-9fda-4a14c6c0c927 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:06.592397 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b493f60a-a299-41bd-9fda-4a14c6c0c927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:06.610962 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-b493f60a-a299-41bd-9fda-4a14c6c0c927 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:23:06.612184 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-b493f60a-a299-41bd-9fda-4a14c6c0c927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:23:06.659021 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0861162e-db3e-4e64-b11c-da5b763733c7 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:06.660462 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-0861162e-db3e-4e64-b11c-da5b763733c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:23:06.682254 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1350/2688] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:23:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:23:06.691389 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ded34fe-063f-4526-94a3-6dd3c97a858a None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:06.691766 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ded34fe-063f-4526-94a3-6dd3c97a858a None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:06.691995 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ded34fe-063f-4526-94a3-6dd3c97a858a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:06.714282 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-8ded34fe-063f-4526-94a3-6dd3c97a858a None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:23:06.715509 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-8ded34fe-063f-4526-94a3-6dd3c97a858a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:23:06.725771 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1351/2689] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:23:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:23:06.730304 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ded34fe-063f-4526-94a3-6dd3c97a858a None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:06.740024 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0861162e-db3e-4e64-b11c-da5b763733c7 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:06.740769 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ded34fe-063f-4526-94a3-6dd3c97a858a None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:06.745578 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d88dc37-3983-482f-b3ad-dc26890b899d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:06.746166 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8547ee-d93c-4da9-a5d1-ecea894c9460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:06.746683 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d88dc37-3983-482f-b3ad-dc26890b899d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:06.746820 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8547ee-d93c-4da9-a5d1-ecea894c9460 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:06.747443 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d88dc37-3983-482f-b3ad-dc26890b899d admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:06.747568 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8547ee-d93c-4da9-a5d1-ecea894c9460 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:06.747679 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d88dc37-3983-482f-b3ad-dc26890b899d admin admin] PATH_INFO: `/v3/users/c0fd31879eac4966805bc1ef6335b6cb` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:06.747762 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8547ee-d93c-4da9-a5d1-ecea894c9460 admin admin] PATH_INFO: `/v3/domains` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:06.748116 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8547ee-d93c-4da9-a5d1-ecea894c9460 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:23:06.748425 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8547ee-d93c-4da9-a5d1-ecea894c9460 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:06.749578 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d88dc37-3983-482f-b3ad-dc26890b899d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0fd31879eac4966805bc1ef6335b6cb)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:06.750881 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8547ee-d93c-4da9-a5d1-ecea894c9460 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:06.751761 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d88dc37-3983-482f-b3ad-dc26890b899d admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:06.763614 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1352/2690] 10.222.0.43 () {58 vars in 1152 bytes} [Wed Jun 22 10:23:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:23:06.768254 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8547ee-d93c-4da9-a5d1-ecea894c9460 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:06.779708 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8547ee-d93c-4da9-a5d1-ecea894c9460 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:06.785455 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0a12f0-941c-46b6-9ba9-40c798d0941b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:06.786052 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0a12f0-941c-46b6-9ba9-40c798d0941b admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:06.786366 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0a12f0-941c-46b6-9ba9-40c798d0941b admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:06.786659 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0a12f0-941c-46b6-9ba9-40c798d0941b admin admin] PATH_INFO: `/v3/projects` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:06.787390 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0a12f0-941c-46b6-9ba9-40c798d0941b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:06.789408 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0a12f0-941c-46b6-9ba9-40c798d0941b admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:06.803455 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-5d88dc37-3983-482f-b3ad-dc26890b899d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0fd31879eac4966805bc1ef6335b6cb'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:06.816196 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-5d88dc37-3983-482f-b3ad-dc26890b899d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0fd31879eac4966805bc1ef6335b6cb'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:06.816780 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1353/2691] 10.222.0.43 () {60 vars in 1152 bytes} [Wed Jun 22 10:23:06 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 10:23:06.820811 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0a12f0-941c-46b6-9ba9-40c798d0941b admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:06.823982 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-5d88dc37-3983-482f-b3ad-dc26890b899d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0fd31879eac4966805bc1ef6335b6cb'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:06.824634 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-5d88dc37-3983-482f-b3ad-dc26890b899d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0fd31879eac4966805bc1ef6335b6cb'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:06.832715 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-5d88dc37-3983-482f-b3ad-dc26890b899d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0fd31879eac4966805bc1ef6335b6cb'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:06.839248 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1339/2692] 10.222.0.43 () {58 vars in 1223 bytes} [Wed Jun 22 10:23:06 2022] DELETE /identity/v3/users/c0fd31879eac4966805bc1ef6335b6cb => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:23:06.843659 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aa3f1f-90c8-4948-bf0c-0d24b5c7873e None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:06.843957 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aa3f1f-90c8-4948-bf0c-0d24b5c7873e None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:06.844243 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aa3f1f-90c8-4948-bf0c-0d24b5c7873e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:06.864185 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-69aa3f1f-90c8-4948-bf0c-0d24b5c7873e None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:23:06.865406 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-69aa3f1f-90c8-4948-bf0c-0d24b5c7873e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:23:06.883844 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0a12f0-941c-46b6-9ba9-40c798d0941b admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:06.918834 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:23:06.926636 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:DELETE=2,keystone:SELECT=96,keystone:INSERT=2 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:23:06.933485 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1340/2693] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:23:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:23:06.940616 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aa3f1f-90c8-4948-bf0c-0d24b5c7873e None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:06.942009 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-69aa3f1f-90c8-4948-bf0c-0d24b5c7873e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:23:06.946098 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e975452-84a7-4ade-9f8d-9d666ac655cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:06.946778 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e975452-84a7-4ade-9f8d-9d666ac655cd admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:06.947066 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e975452-84a7-4ade-9f8d-9d666ac655cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:06.947345 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e975452-84a7-4ade-9f8d-9d666ac655cd admin admin] PATH_INFO: `/v3/users` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:06.948041 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e975452-84a7-4ade-9f8d-9d666ac655cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:06.950035 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e975452-84a7-4ade-9f8d-9d666ac655cd admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:06.976797 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1354/2694] 10.222.0.43 () {60 vars in 1143 bytes} [Wed Jun 22 10:23:06 2022] POST /identity/v3/users => generated 287 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 10:23:06.980308 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e975452-84a7-4ade-9f8d-9d666ac655cd admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:06.982222 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-5e975452-84a7-4ade-9f8d-9d666ac655cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:23:06.998020 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e975452-84a7-4ade-9f8d-9d666ac655cd admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:07.003408 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4410f74-97ef-4c1b-bc71-33c44db5476d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:07.004087 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4410f74-97ef-4c1b-bc71-33c44db5476d admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:07.004383 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4410f74-97ef-4c1b-bc71-33c44db5476d admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:07.004671 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4410f74-97ef-4c1b-bc71-33c44db5476d admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:07.005407 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4410f74-97ef-4c1b-bc71-33c44db5476d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:07.007081 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4410f74-97ef-4c1b-bc71-33c44db5476d admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:07.012322 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aa3f1f-90c8-4948-bf0c-0d24b5c7873e None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:07.016641 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ab317f-b63d-4651-a665-2f4d74d66f03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe93d4c0737249fd8623bb5ce188e34e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:07.017294 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ab317f-b63d-4651-a665-2f4d74d66f03 service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:07.017579 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ab317f-b63d-4651-a665-2f4d74d66f03 service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:07.017895 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ab317f-b63d-4651-a665-2f4d74d66f03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:07.021286 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1355/2695] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:23:06 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:23:07.022232 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4410f74-97ef-4c1b-bc71-33c44db5476d admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:07.031495 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ab317f-b63d-4651-a665-2f4d74d66f03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:07.032438 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4410f74-97ef-4c1b-bc71-33c44db5476d admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:07.032942 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ab317f-b63d-4651-a665-2f4d74d66f03 service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:07.037111 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c60c258-d1b9-4144-a3e9-e8f08e0a2440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:07.037728 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c60c258-d1b9-4144-a3e9-e8f08e0a2440 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:07.038021 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c60c258-d1b9-4144-a3e9-e8f08e0a2440 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:07.038301 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c60c258-d1b9-4144-a3e9-e8f08e0a2440 admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:07.039048 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c60c258-d1b9-4144-a3e9-e8f08e0a2440 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:07.040665 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c60c258-d1b9-4144-a3e9-e8f08e0a2440 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:07.042880 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1341/2696] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:23:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 10:23:07.055248 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1356/2697] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:23:07 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 10:23:07.059338 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ab317f-b63d-4651-a665-2f4d74d66f03 service neutron] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:07.069675 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ab317f-b63d-4651-a665-2f4d74d66f03 service neutron] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:07.076927 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b575d0-cdb3-498b-af78-75396614767b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:07.078721 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b575d0-cdb3-498b-af78-75396614767b admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:07.079212 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b575d0-cdb3-498b-af78-75396614767b admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:07.079655 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b575d0-cdb3-498b-af78-75396614767b admin admin] PATH_INFO: `/v3/projects/9a413f18733940f287f7af30437a9bfe/users/57d9832a2afd444ebfc225aa2a088758/roles/9f88c83743f745a9a785a2f454753f06` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:07.097026 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b575d0-cdb3-498b-af78-75396614767b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a413f18733940f287f7af30437a9bfe, user_id=57d9832a2afd444ebfc225aa2a088758, role_id=9f88c83743f745a9a785a2f454753f06)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:07.100391 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b575d0-cdb3-498b-af78-75396614767b admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:07.116985 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1342/2698] 10.222.0.43 () {60 vars in 1482 bytes} [Wed Jun 22 10:23:07 2022] PUT /identity/v3/projects/9a413f18733940f287f7af30437a9bfe/users/57d9832a2afd444ebfc225aa2a088758/roles/9f88c83743f745a9a785a2f454753f06 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:23:07.127127 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fc0ed4-248a-4964-899f-6c6a604d8d18 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:07.127404 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fc0ed4-248a-4964-899f-6c6a604d8d18 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:07.127687 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fc0ed4-248a-4964-899f-6c6a604d8d18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:07.158084 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-57fc0ed4-248a-4964-899f-6c6a604d8d18 None None] MFA Rules not processed for user `57d9832a2afd444ebfc225aa2a088758`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:23:07.159418 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-57fc0ed4-248a-4964-899f-6c6a604d8d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:23:07.230182 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1357/2699] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:23:07 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:23:07.241905 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b575d0-cdb3-498b-af78-75396614767b admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:07.243736 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-a2b575d0-cdb3-498b-af78-75396614767b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:23:07.305261 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b575d0-cdb3-498b-af78-75396614767b admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:07.309154 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d611061b-3c79-42dd-bc71-4ac0fea68016 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bbcb3d4dc704dfdb0097abc594ca855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:07.309842 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d611061b-3c79-42dd-bc71-4ac0fea68016 service cinder] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:07.310271 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d611061b-3c79-42dd-bc71-4ac0fea68016 service cinder] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:07.310558 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d611061b-3c79-42dd-bc71-4ac0fea68016 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:07.319797 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d611061b-3c79-42dd-bc71-4ac0fea68016 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:07.321461 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d611061b-3c79-42dd-bc71-4ac0fea68016 service cinder] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:07.332164 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1343/2700] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:23:07 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:23:07.344795 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fc0ed4-248a-4964-899f-6c6a604d8d18 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:07.346354 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-57fc0ed4-248a-4964-899f-6c6a604d8d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:23:07.423544 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fc0ed4-248a-4964-899f-6c6a604d8d18 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:07.429540 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cbd649-7b47-4dda-b59b-876abd7a6283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:07.430500 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cbd649-7b47-4dda-b59b-876abd7a6283 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:07.430789 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cbd649-7b47-4dda-b59b-876abd7a6283 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:07.431066 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cbd649-7b47-4dda-b59b-876abd7a6283 admin admin] PATH_INFO: `/v3/projects/06dbdcfd1d444846b08810da7d5dceed` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:07.432264 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cbd649-7b47-4dda-b59b-876abd7a6283 admin admin] RBAC: Authorizing `identity:delete_project(project_id=06dbdcfd1d444846b08810da7d5dceed)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:07.434290 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cbd649-7b47-4dda-b59b-876abd7a6283 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:07.481948 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:23:07.488395 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-15cbd649-7b47-4dda-b59b-876abd7a6283 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06dbdcfd1d444846b08810da7d5dceed', 'request_id': 'req-15cbd649-7b47-4dda-b59b-876abd7a6283'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:07.496794 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-15cbd649-7b47-4dda-b59b-876abd7a6283 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06dbdcfd1d444846b08810da7d5dceed', 'request_id': 'req-15cbd649-7b47-4dda-b59b-876abd7a6283'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:07.503681 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-15cbd649-7b47-4dda-b59b-876abd7a6283 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06dbdcfd1d444846b08810da7d5dceed', 'request_id': 'req-15cbd649-7b47-4dda-b59b-876abd7a6283'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:07.517669 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-15cbd649-7b47-4dda-b59b-876abd7a6283 admin admin] The token cache is being invalidate because project 06dbdcfd1d444846b08810da7d5dceed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:23:07.518134 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-15cbd649-7b47-4dda-b59b-876abd7a6283 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:07.518739 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-15cbd649-7b47-4dda-b59b-876abd7a6283 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:07.520562 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1358/2701] 10.222.0.43 () {58 vars in 1232 bytes} [Wed Jun 22 10:23:07 2022] DELETE /identity/v3/projects/06dbdcfd1d444846b08810da7d5dceed => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:23:07.526102 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50138701-e89f-4500-8033-1326c2abc730 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:07.526402 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50138701-e89f-4500-8033-1326c2abc730 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:07.526688 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50138701-e89f-4500-8033-1326c2abc730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:07.547058 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-50138701-e89f-4500-8033-1326c2abc730 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:23:07.548231 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-50138701-e89f-4500-8033-1326c2abc730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:23:07.633252 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1344/2702] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:23:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:23:07.643408 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2bc33b-17ee-4448-b7cc-6daeb7ec69d7 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:07.652460 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2bc33b-17ee-4448-b7cc-6daeb7ec69d7 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:07.652724 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2bc33b-17ee-4448-b7cc-6daeb7ec69d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:07.674184 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-3c2bc33b-17ee-4448-b7cc-6daeb7ec69d7 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:23:07.675505 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-3c2bc33b-17ee-4448-b7cc-6daeb7ec69d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:23:07.684855 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1359/2703] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:23:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:23:07.689952 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50138701-e89f-4500-8033-1326c2abc730 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:07.704563 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50138701-e89f-4500-8033-1326c2abc730 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:07.710418 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b753cfa8-7c7b-4809-b8c5-d1dc07aa0bf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:07.710987 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b753cfa8-7c7b-4809-b8c5-d1dc07aa0bf9 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:07.711312 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b753cfa8-7c7b-4809-b8c5-d1dc07aa0bf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:07.711597 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b753cfa8-7c7b-4809-b8c5-d1dc07aa0bf9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:07.712411 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b753cfa8-7c7b-4809-b8c5-d1dc07aa0bf9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:23:07.712687 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b753cfa8-7c7b-4809-b8c5-d1dc07aa0bf9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:07.714549 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b753cfa8-7c7b-4809-b8c5-d1dc07aa0bf9 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:07.731727 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1345/2704] 10.222.0.43 () {58 vars in 1152 bytes} [Wed Jun 22 10:23:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:23:07.732932 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2bc33b-17ee-4448-b7cc-6daeb7ec69d7 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:07.745869 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2bc33b-17ee-4448-b7cc-6daeb7ec69d7 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:07.751328 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332908da-ec97-41c3-9ce2-e1022c51d832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:07.752065 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332908da-ec97-41c3-9ce2-e1022c51d832 admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:07.752352 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332908da-ec97-41c3-9ce2-e1022c51d832 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:07.752633 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332908da-ec97-41c3-9ce2-e1022c51d832 admin admin] PATH_INFO: `/v3/projects` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:07.753372 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332908da-ec97-41c3-9ce2-e1022c51d832 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:07.755357 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332908da-ec97-41c3-9ce2-e1022c51d832 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:07.782088 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1360/2705] 10.222.0.43 () {60 vars in 1152 bytes} [Wed Jun 22 10:23:07 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:23:07.786173 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b753cfa8-7c7b-4809-b8c5-d1dc07aa0bf9 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:07.796395 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b753cfa8-7c7b-4809-b8c5-d1dc07aa0bf9 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:07.801161 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:23:07.853636 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcf578c-730b-41d2-9919-58eed1439aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:07.854241 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcf578c-730b-41d2-9919-58eed1439aae admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:07.854518 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcf578c-730b-41d2-9919-58eed1439aae admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:07.854802 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcf578c-730b-41d2-9919-58eed1439aae admin admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:07.855501 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcf578c-730b-41d2-9919-58eed1439aae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:07.857415 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcf578c-730b-41d2-9919-58eed1439aae admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:07.877001 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1346/2706] 10.222.0.43 () {60 vars in 1143 bytes} [Wed Jun 22 10:23:07 2022] POST /identity/v3/users => generated 287 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:23:07.881069 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332908da-ec97-41c3-9ce2-e1022c51d832 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:07.892940 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332908da-ec97-41c3-9ce2-e1022c51d832 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:07.897665 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daea18ae-6739-4375-8152-96025525dfd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:07.898355 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daea18ae-6739-4375-8152-96025525dfd1 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:07.898644 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daea18ae-6739-4375-8152-96025525dfd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:07.898927 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daea18ae-6739-4375-8152-96025525dfd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:07.899656 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daea18ae-6739-4375-8152-96025525dfd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:07.901264 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daea18ae-6739-4375-8152-96025525dfd1 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:07.912305 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1361/2707] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:23:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:23:07.916564 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcf578c-730b-41d2-9919-58eed1439aae admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:07.927953 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcf578c-730b-41d2-9919-58eed1439aae admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:07.932783 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d812b6b-7644-4a0c-a757-7fe54028e698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:07.933449 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d812b6b-7644-4a0c-a757-7fe54028e698 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:07.933765 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d812b6b-7644-4a0c-a757-7fe54028e698 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:07.934051 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d812b6b-7644-4a0c-a757-7fe54028e698 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:07.934802 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d812b6b-7644-4a0c-a757-7fe54028e698 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:07.936992 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d812b6b-7644-4a0c-a757-7fe54028e698 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:07.947472 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1347/2708] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:23:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:23:07.951852 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daea18ae-6739-4375-8152-96025525dfd1 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:07.962654 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daea18ae-6739-4375-8152-96025525dfd1 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:07.967339 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6087c6-a923-4971-ba7d-872bf2386c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:07.968218 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6087c6-a923-4971-ba7d-872bf2386c81 admin admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:07.968502 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6087c6-a923-4971-ba7d-872bf2386c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:07.968782 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6087c6-a923-4971-ba7d-872bf2386c81 admin admin] PATH_INFO: `/v3/projects/4445c014dc2a44cc9c7445fa5fc6928f/users/8f796ec44d9e41a4be2abb7c9004d6e4/roles/9f88c83743f745a9a785a2f454753f06` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:07.984771 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6087c6-a923-4971-ba7d-872bf2386c81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4445c014dc2a44cc9c7445fa5fc6928f, user_id=8f796ec44d9e41a4be2abb7c9004d6e4, role_id=9f88c83743f745a9a785a2f454753f06)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:07.987369 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6087c6-a923-4971-ba7d-872bf2386c81 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:08.000475 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1362/2709] 10.222.0.43 () {60 vars in 1482 bytes} [Wed Jun 22 10:23:07 2022] PUT /identity/v3/projects/4445c014dc2a44cc9c7445fa5fc6928f/users/8f796ec44d9e41a4be2abb7c9004d6e4/roles/9f88c83743f745a9a785a2f454753f06 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:23:08.010829 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b62a4d-3bd6-476f-a598-d77376eb0c48 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:08.011126 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b62a4d-3bd6-476f-a598-d77376eb0c48 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:08.011412 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b62a4d-3bd6-476f-a598-d77376eb0c48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:08.039602 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-91b62a4d-3bd6-476f-a598-d77376eb0c48 None None] MFA Rules not processed for user `8f796ec44d9e41a4be2abb7c9004d6e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:23:08.040835 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-91b62a4d-3bd6-476f-a598-d77376eb0c48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:23:08.107728 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1348/2710] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:23:08 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:23:08.112652 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6087c6-a923-4971-ba7d-872bf2386c81 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:08.174533 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6087c6-a923-4971-ba7d-872bf2386c81 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:08.179179 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c54975a-146a-46ab-bed4-8940fd70f2db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:08.179833 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c54975a-146a-46ab-bed4-8940fd70f2db admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:08.180122 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c54975a-146a-46ab-bed4-8940fd70f2db admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:08.180404 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c54975a-146a-46ab-bed4-8940fd70f2db admin admin] PATH_INFO: `/v3/projects` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:08.181094 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c54975a-146a-46ab-bed4-8940fd70f2db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:08.183095 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c54975a-146a-46ab-bed4-8940fd70f2db admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:08.208294 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1363/2711] 10.222.0.43 () {60 vars in 1152 bytes} [Wed Jun 22 10:23:08 2022] POST /identity/v3/projects => generated 373 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:23:08.212322 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b62a4d-3bd6-476f-a598-d77376eb0c48 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:08.223154 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b62a4d-3bd6-476f-a598-d77376eb0c48 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:08.278742 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8295f13a-db85-4976-b179-834e305e5b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:08.279406 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8295f13a-db85-4976-b179-834e305e5b67 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:08.279707 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8295f13a-db85-4976-b179-834e305e5b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:08.279990 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8295f13a-db85-4976-b179-834e305e5b67 admin admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:08.280744 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8295f13a-db85-4976-b179-834e305e5b67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:08.282767 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8295f13a-db85-4976-b179-834e305e5b67 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:08.302209 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1349/2712] 10.222.0.43 () {60 vars in 1143 bytes} [Wed Jun 22 10:23:08 2022] POST /identity/v3/users => generated 293 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:23:08.306180 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c54975a-146a-46ab-bed4-8940fd70f2db admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:08.317646 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c54975a-146a-46ab-bed4-8940fd70f2db admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:08.322363 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c2f29e-b730-4901-8d82-3282cb93d438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:08.323032 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c2f29e-b730-4901-8d82-3282cb93d438 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:08.323322 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c2f29e-b730-4901-8d82-3282cb93d438 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:08.323605 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c2f29e-b730-4901-8d82-3282cb93d438 admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:08.324336 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c2f29e-b730-4901-8d82-3282cb93d438 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:08.325982 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c2f29e-b730-4901-8d82-3282cb93d438 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:08.336534 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1364/2713] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:23:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:23:08.340819 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8295f13a-db85-4976-b179-834e305e5b67 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:08.350860 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8295f13a-db85-4976-b179-834e305e5b67 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:08.355739 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9462242-6be4-4ea3-b4ab-5e0c3f1d745a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:08.356667 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9462242-6be4-4ea3-b4ab-5e0c3f1d745a admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:08.356898 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9462242-6be4-4ea3-b4ab-5e0c3f1d745a admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:08.357171 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9462242-6be4-4ea3-b4ab-5e0c3f1d745a admin admin] PATH_INFO: `/v3/projects/d4be338fe2f54f229476848b66167090/users/8cccaaf1ddf94ea38be5133d8b296f17/roles/26d9c2ab5dfc4e6d9ca80c6014123906` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:08.359941 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:23:08.373754 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9462242-6be4-4ea3-b4ab-5e0c3f1d745a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4be338fe2f54f229476848b66167090, user_id=8cccaaf1ddf94ea38be5133d8b296f17, role_id=26d9c2ab5dfc4e6d9ca80c6014123906)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:08.376424 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9462242-6be4-4ea3-b4ab-5e0c3f1d745a admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:08.388869 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1350/2714] 10.222.0.43 () {60 vars in 1482 bytes} [Wed Jun 22 10:23:08 2022] PUT /identity/v3/projects/d4be338fe2f54f229476848b66167090/users/8cccaaf1ddf94ea38be5133d8b296f17/roles/26d9c2ab5dfc4e6d9ca80c6014123906 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:23:08.393058 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c2f29e-b730-4901-8d82-3282cb93d438 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:08.403545 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c2f29e-b730-4901-8d82-3282cb93d438 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:08.447026 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:23:08.465414 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6838d1c7-05bb-4c85-b290-a08f2f72c786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:08.466124 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6838d1c7-05bb-4c85-b290-a08f2f72c786 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:08.466415 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6838d1c7-05bb-4c85-b290-a08f2f72c786 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:08.466692 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6838d1c7-05bb-4c85-b290-a08f2f72c786 admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:08.467417 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6838d1c7-05bb-4c85-b290-a08f2f72c786 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:08.469913 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6838d1c7-05bb-4c85-b290-a08f2f72c786 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:08.479908 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1365/2715] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:23:08 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:23:08.484021 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9462242-6be4-4ea3-b4ab-5e0c3f1d745a admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:08.494410 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9462242-6be4-4ea3-b4ab-5e0c3f1d745a admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:08.499873 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3356654-6cfd-456b-ac08-ae44f64da8a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:08.500528 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3356654-6cfd-456b-ac08-ae44f64da8a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:08.500814 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3356654-6cfd-456b-ac08-ae44f64da8a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:08.501092 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3356654-6cfd-456b-ac08-ae44f64da8a3 admin admin] PATH_INFO: `/v3/projects/d4be338fe2f54f229476848b66167090/users/8cccaaf1ddf94ea38be5133d8b296f17/roles/26d9c2ab5dfc4e6d9ca80c6014123906` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:08.503097 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3356654-6cfd-456b-ac08-ae44f64da8a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4be338fe2f54f229476848b66167090, user_id=8cccaaf1ddf94ea38be5133d8b296f17, role_id=26d9c2ab5dfc4e6d9ca80c6014123906)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:08.505826 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3356654-6cfd-456b-ac08-ae44f64da8a3 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:08.517362 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1351/2716] 10.222.0.43 () {60 vars in 1482 bytes} [Wed Jun 22 10:23:08 2022] PUT /identity/v3/projects/d4be338fe2f54f229476848b66167090/users/8cccaaf1ddf94ea38be5133d8b296f17/roles/26d9c2ab5dfc4e6d9ca80c6014123906 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:23:08.527557 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e73396-6990-44ea-938e-e61934d5f699 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:08.527858 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e73396-6990-44ea-938e-e61934d5f699 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:08.528138 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e73396-6990-44ea-938e-e61934d5f699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:08.556268 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-64e73396-6990-44ea-938e-e61934d5f699 None None] MFA Rules not processed for user `8cccaaf1ddf94ea38be5133d8b296f17`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:23:08.557463 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-64e73396-6990-44ea-938e-e61934d5f699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:23:08.625301 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1366/2717] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:23:08 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:23:08.636040 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3356654-6cfd-456b-ac08-ae44f64da8a3 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:08.637870 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-b3356654-6cfd-456b-ac08-ae44f64da8a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:23:08.699788 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3356654-6cfd-456b-ac08-ae44f64da8a3 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:08.705468 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108cfc5f-8f9c-43d4-96ef-f52d5c56a998 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bbcb3d4dc704dfdb0097abc594ca855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:08.706171 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108cfc5f-8f9c-43d4-96ef-f52d5c56a998 service cinder] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:08.706460 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108cfc5f-8f9c-43d4-96ef-f52d5c56a998 service cinder] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:08.706739 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108cfc5f-8f9c-43d4-96ef-f52d5c56a998 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:08.768017 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108cfc5f-8f9c-43d4-96ef-f52d5c56a998 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:08.769466 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108cfc5f-8f9c-43d4-96ef-f52d5c56a998 service cinder] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:08.779701 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1352/2718] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:23:08 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:23:10.016121 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e73396-6990-44ea-938e-e61934d5f699 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:10.017851 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-64e73396-6990-44ea-938e-e61934d5f699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:23:10.083381 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e73396-6990-44ea-938e-e61934d5f699 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:10.087882 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45a8369-5aca-49d9-a4ce-a14d6510b496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:10.088764 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45a8369-5aca-49d9-a4ce-a14d6510b496 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:10.089044 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45a8369-5aca-49d9-a4ce-a14d6510b496 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:10.089317 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45a8369-5aca-49d9-a4ce-a14d6510b496 admin admin] PATH_INFO: `/v3/users/e089ed4c9f9341fb8a13a9f9aac861b8` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:10.090553 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45a8369-5aca-49d9-a4ce-a14d6510b496 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e089ed4c9f9341fb8a13a9f9aac861b8)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:10.092543 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45a8369-5aca-49d9-a4ce-a14d6510b496 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:10.145309 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-b45a8369-5aca-49d9-a4ce-a14d6510b496 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e089ed4c9f9341fb8a13a9f9aac861b8'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:10.158230 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-b45a8369-5aca-49d9-a4ce-a14d6510b496 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e089ed4c9f9341fb8a13a9f9aac861b8'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:10.160033 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:23:10.167079 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-b45a8369-5aca-49d9-a4ce-a14d6510b496 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e089ed4c9f9341fb8a13a9f9aac861b8'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:10.175669 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-b45a8369-5aca-49d9-a4ce-a14d6510b496 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e089ed4c9f9341fb8a13a9f9aac861b8'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:10.176373 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-b45a8369-5aca-49d9-a4ce-a14d6510b496 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e089ed4c9f9341fb8a13a9f9aac861b8'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:10.182692 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1367/2719] 10.222.0.43 () {58 vars in 1223 bytes} [Wed Jun 22 10:23:10 2022] DELETE /identity/v3/users/e089ed4c9f9341fb8a13a9f9aac861b8 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:23:10.187927 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e19061-5108-41db-9f04-a9cfbdd98df7 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:10.188419 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e19061-5108-41db-9f04-a9cfbdd98df7 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:10.188539 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e19061-5108-41db-9f04-a9cfbdd98df7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:10.207363 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-11e19061-5108-41db-9f04-a9cfbdd98df7 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:23:10.208820 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-11e19061-5108-41db-9f04-a9cfbdd98df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:23:10.274160 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1353/2720] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:23:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:23:10.284319 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45a8369-5aca-49d9-a4ce-a14d6510b496 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:10.285885 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-b45a8369-5aca-49d9-a4ce-a14d6510b496 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:23:10.350092 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45a8369-5aca-49d9-a4ce-a14d6510b496 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:10.354029 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938bc8bb-5d77-46d2-8a29-8e41cd0a3b60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe93d4c0737249fd8623bb5ce188e34e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:10.354692 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938bc8bb-5d77-46d2-8a29-8e41cd0a3b60 service neutron] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:10.354981 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938bc8bb-5d77-46d2-8a29-8e41cd0a3b60 service neutron] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:10.355261 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938bc8bb-5d77-46d2-8a29-8e41cd0a3b60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:10.365087 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938bc8bb-5d77-46d2-8a29-8e41cd0a3b60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:10.366660 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938bc8bb-5d77-46d2-8a29-8e41cd0a3b60 service neutron] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:10.376779 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1368/2721] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:23:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:23:10.482441 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e19061-5108-41db-9f04-a9cfbdd98df7 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:10.484631 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-11e19061-5108-41db-9f04-a9cfbdd98df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:23:10.496882 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e19061-5108-41db-9f04-a9cfbdd98df7 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:10.502327 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942ddcd4-a551-4bef-8d68-1e772459166c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:10.503210 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942ddcd4-a551-4bef-8d68-1e772459166c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:10.503498 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942ddcd4-a551-4bef-8d68-1e772459166c admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:10.503801 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942ddcd4-a551-4bef-8d68-1e772459166c admin admin] PATH_INFO: `/v3/users/57d9832a2afd444ebfc225aa2a088758` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:10.504981 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942ddcd4-a551-4bef-8d68-1e772459166c admin admin] RBAC: Authorizing `identity:delete_user(user_id=57d9832a2afd444ebfc225aa2a088758)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:10.506956 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942ddcd4-a551-4bef-8d68-1e772459166c admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:10.529182 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:23:10.575864 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-942ddcd4-a551-4bef-8d68-1e772459166c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57d9832a2afd444ebfc225aa2a088758'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:10.588639 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-942ddcd4-a551-4bef-8d68-1e772459166c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57d9832a2afd444ebfc225aa2a088758'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:10.596603 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-942ddcd4-a551-4bef-8d68-1e772459166c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57d9832a2afd444ebfc225aa2a088758'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:10.597345 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-942ddcd4-a551-4bef-8d68-1e772459166c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57d9832a2afd444ebfc225aa2a088758'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:10.605048 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-942ddcd4-a551-4bef-8d68-1e772459166c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57d9832a2afd444ebfc225aa2a088758'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:10.612081 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1354/2722] 10.222.0.43 () {58 vars in 1223 bytes} [Wed Jun 22 10:23:10 2022] DELETE /identity/v3/users/57d9832a2afd444ebfc225aa2a088758 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:23:10.616460 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a355c1e-bc1a-481a-a8ee-e5e891c7a963 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:10.616751 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a355c1e-bc1a-481a-a8ee-e5e891c7a963 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:10.617033 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a355c1e-bc1a-481a-a8ee-e5e891c7a963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:10.635438 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-9a355c1e-bc1a-481a-a8ee-e5e891c7a963 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:23:10.636648 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-9a355c1e-bc1a-481a-a8ee-e5e891c7a963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:23:10.679070 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942ddcd4-a551-4bef-8d68-1e772459166c admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:10.681271 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-942ddcd4-a551-4bef-8d68-1e772459166c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:23:10.705894 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1369/2723] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:23:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:23:10.714846 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a355c1e-bc1a-481a-a8ee-e5e891c7a963 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:10.718787 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-9a355c1e-bc1a-481a-a8ee-e5e891c7a963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:23:10.767933 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942ddcd4-a551-4bef-8d68-1e772459166c admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:10.772626 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fd5856-e8cc-472a-948e-21b0ddf2f77c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:10.773500 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fd5856-e8cc-472a-948e-21b0ddf2f77c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:10.773847 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fd5856-e8cc-472a-948e-21b0ddf2f77c admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:10.774134 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fd5856-e8cc-472a-948e-21b0ddf2f77c admin admin] PATH_INFO: `/v3/projects/3710fd33ac2e4b218e6cbfadb69b95fc` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:10.775326 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fd5856-e8cc-472a-948e-21b0ddf2f77c admin admin] RBAC: Authorizing `identity:delete_project(project_id=3710fd33ac2e4b218e6cbfadb69b95fc)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:10.777234 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fd5856-e8cc-472a-948e-21b0ddf2f77c admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:10.783116 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a355c1e-bc1a-481a-a8ee-e5e891c7a963 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:10.786714 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc73db9a-340c-469c-9676-5d035785a0c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe93d4c0737249fd8623bb5ce188e34e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:10.787363 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc73db9a-340c-469c-9676-5d035785a0c5 service neutron] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:10.787650 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc73db9a-340c-469c-9676-5d035785a0c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:10.787930 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc73db9a-340c-469c-9676-5d035785a0c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:10.797243 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc73db9a-340c-469c-9676-5d035785a0c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:10.798714 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc73db9a-340c-469c-9676-5d035785a0c5 service neutron] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:10.808638 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1370/2724] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:23:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 10:23:10.826390 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-42fd5856-e8cc-472a-948e-21b0ddf2f77c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3710fd33ac2e4b218e6cbfadb69b95fc', 'request_id': 'req-42fd5856-e8cc-472a-948e-21b0ddf2f77c'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:10.832881 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-42fd5856-e8cc-472a-948e-21b0ddf2f77c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3710fd33ac2e4b218e6cbfadb69b95fc', 'request_id': 'req-42fd5856-e8cc-472a-948e-21b0ddf2f77c'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:10.840642 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-42fd5856-e8cc-472a-948e-21b0ddf2f77c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3710fd33ac2e4b218e6cbfadb69b95fc', 'request_id': 'req-42fd5856-e8cc-472a-948e-21b0ddf2f77c'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:10.853675 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-42fd5856-e8cc-472a-948e-21b0ddf2f77c admin admin] The token cache is being invalidate because project 3710fd33ac2e4b218e6cbfadb69b95fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:23:10.854077 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-42fd5856-e8cc-472a-948e-21b0ddf2f77c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:10.854847 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-42fd5856-e8cc-472a-948e-21b0ddf2f77c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:10.856606 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1355/2725] 10.222.0.43 () {58 vars in 1232 bytes} [Wed Jun 22 10:23:10 2022] DELETE /identity/v3/projects/3710fd33ac2e4b218e6cbfadb69b95fc => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:23:10.860731 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc73db9a-340c-469c-9676-5d035785a0c5 service neutron] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:10.872236 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc73db9a-340c-469c-9676-5d035785a0c5 service neutron] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:10.902705 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:INSERT=1,keystone:DELETE=1,keystone:SELECT=98 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:23:10.939448 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce9ba78-3e28-4cb7-b32b-cc8e6ed55f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:10.940361 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce9ba78-3e28-4cb7-b32b-cc8e6ed55f73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:10.940647 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce9ba78-3e28-4cb7-b32b-cc8e6ed55f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:10.940925 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce9ba78-3e28-4cb7-b32b-cc8e6ed55f73 admin admin] PATH_INFO: `/v3/users/18ef782225904934937729ae285a6920` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:10.942195 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce9ba78-3e28-4cb7-b32b-cc8e6ed55f73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=18ef782225904934937729ae285a6920)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:10.944123 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce9ba78-3e28-4cb7-b32b-cc8e6ed55f73 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:11.008162 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-1ce9ba78-3e28-4cb7-b32b-cc8e6ed55f73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18ef782225904934937729ae285a6920'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:11.023537 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-1ce9ba78-3e28-4cb7-b32b-cc8e6ed55f73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18ef782225904934937729ae285a6920'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:11.034391 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-1ce9ba78-3e28-4cb7-b32b-cc8e6ed55f73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18ef782225904934937729ae285a6920'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:11.042444 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-1ce9ba78-3e28-4cb7-b32b-cc8e6ed55f73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18ef782225904934937729ae285a6920'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:11.043377 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-1ce9ba78-3e28-4cb7-b32b-cc8e6ed55f73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18ef782225904934937729ae285a6920'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:11.050856 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1371/2726] 10.222.0.43 () {58 vars in 1223 bytes} [Wed Jun 22 10:23:10 2022] DELETE /identity/v3/users/18ef782225904934937729ae285a6920 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:23:11.126308 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fd5856-e8cc-472a-948e-21b0ddf2f77c admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:11.127848 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-42fd5856-e8cc-472a-948e-21b0ddf2f77c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:23:11.153489 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fd5856-e8cc-472a-948e-21b0ddf2f77c admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:11.192197 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:23:11.236927 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44977b8-e6ad-4f9a-a99e-b39881e4bf5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:11.238010 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44977b8-e6ad-4f9a-a99e-b39881e4bf5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:11.238309 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44977b8-e6ad-4f9a-a99e-b39881e4bf5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:11.238732 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44977b8-e6ad-4f9a-a99e-b39881e4bf5f admin admin] PATH_INFO: `/v3/projects/9a413f18733940f287f7af30437a9bfe` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:11.240000 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44977b8-e6ad-4f9a-a99e-b39881e4bf5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a413f18733940f287f7af30437a9bfe)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:11.242081 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44977b8-e6ad-4f9a-a99e-b39881e4bf5f admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:11.300673 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-a44977b8-e6ad-4f9a-a99e-b39881e4bf5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a413f18733940f287f7af30437a9bfe', 'request_id': 'req-a44977b8-e6ad-4f9a-a99e-b39881e4bf5f'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:11.307122 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-a44977b8-e6ad-4f9a-a99e-b39881e4bf5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a413f18733940f287f7af30437a9bfe', 'request_id': 'req-a44977b8-e6ad-4f9a-a99e-b39881e4bf5f'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:11.318619 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-a44977b8-e6ad-4f9a-a99e-b39881e4bf5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a413f18733940f287f7af30437a9bfe', 'request_id': 'req-a44977b8-e6ad-4f9a-a99e-b39881e4bf5f'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:11.332541 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-a44977b8-e6ad-4f9a-a99e-b39881e4bf5f admin admin] The token cache is being invalidate because project 9a413f18733940f287f7af30437a9bfe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:23:11.332842 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-a44977b8-e6ad-4f9a-a99e-b39881e4bf5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:11.334013 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-a44977b8-e6ad-4f9a-a99e-b39881e4bf5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:11.340681 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1356/2727] 10.222.0.43 () {58 vars in 1232 bytes} [Wed Jun 22 10:23:11 2022] DELETE /identity/v3/projects/9a413f18733940f287f7af30437a9bfe => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:23:11.342026 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b228189-8422-4fc4-8f27-16767d04bbab None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:11.342238 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44977b8-e6ad-4f9a-a99e-b39881e4bf5f admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:11.342375 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b228189-8422-4fc4-8f27-16767d04bbab None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:11.342712 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b228189-8422-4fc4-8f27-16767d04bbab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:11.344092 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-a44977b8-e6ad-4f9a-a99e-b39881e4bf5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:23:11.362059 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-4b228189-8422-4fc4-8f27-16767d04bbab None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:23:11.363661 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-4b228189-8422-4fc4-8f27-16767d04bbab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:23:11.428355 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44977b8-e6ad-4f9a-a99e-b39881e4bf5f admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:11.433138 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5006f9-5687-4a82-8126-c63fccf778b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:11.434075 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5006f9-5687-4a82-8126-c63fccf778b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:11.434351 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5006f9-5687-4a82-8126-c63fccf778b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:11.434624 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5006f9-5687-4a82-8126-c63fccf778b8 admin admin] PATH_INFO: `/v3/users/8f796ec44d9e41a4be2abb7c9004d6e4` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:11.436104 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5006f9-5687-4a82-8126-c63fccf778b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f796ec44d9e41a4be2abb7c9004d6e4)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:11.437623 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1372/2728] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:23:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:23:11.443768 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b228189-8422-4fc4-8f27-16767d04bbab None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:11.443898 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5006f9-5687-4a82-8126-c63fccf778b8 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:11.443999 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-4b228189-8422-4fc4-8f27-16767d04bbab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:23:11.453323 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b228189-8422-4fc4-8f27-16767d04bbab None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:11.458602 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d1b96b-aee3-417b-a0ed-7ae0be95487c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:11.459551 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d1b96b-aee3-417b-a0ed-7ae0be95487c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:11.459902 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d1b96b-aee3-417b-a0ed-7ae0be95487c admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:11.460251 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d1b96b-aee3-417b-a0ed-7ae0be95487c admin admin] PATH_INFO: `/v3/projects/aec37aeb3844436098426091c9b15b0c` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:11.461531 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d1b96b-aee3-417b-a0ed-7ae0be95487c admin admin] RBAC: Authorizing `identity:delete_project(project_id=aec37aeb3844436098426091c9b15b0c)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:11.463591 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d1b96b-aee3-417b-a0ed-7ae0be95487c admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:11.488800 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-ba5006f9-5687-4a82-8126-c63fccf778b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f796ec44d9e41a4be2abb7c9004d6e4'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:11.497155 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:23:11.503517 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-ba5006f9-5687-4a82-8126-c63fccf778b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f796ec44d9e41a4be2abb7c9004d6e4'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:11.514982 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-ba5006f9-5687-4a82-8126-c63fccf778b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f796ec44d9e41a4be2abb7c9004d6e4'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:11.515622 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-ba5006f9-5687-4a82-8126-c63fccf778b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f796ec44d9e41a4be2abb7c9004d6e4'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:11.519014 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:23:11.523938 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-29d1b96b-aee3-417b-a0ed-7ae0be95487c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aec37aeb3844436098426091c9b15b0c', 'request_id': 'req-29d1b96b-aee3-417b-a0ed-7ae0be95487c'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:11.526975 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-ba5006f9-5687-4a82-8126-c63fccf778b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f796ec44d9e41a4be2abb7c9004d6e4'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:11.533562 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-29d1b96b-aee3-417b-a0ed-7ae0be95487c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aec37aeb3844436098426091c9b15b0c', 'request_id': 'req-29d1b96b-aee3-417b-a0ed-7ae0be95487c'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:11.534609 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1357/2729] 10.222.0.43 () {58 vars in 1223 bytes} [Wed Jun 22 10:23:11 2022] DELETE /identity/v3/users/8f796ec44d9e41a4be2abb7c9004d6e4 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:23:11.538791 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8784db-f77c-4a62-ab98-da7f085d92c8 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:11.539089 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8784db-f77c-4a62-ab98-da7f085d92c8 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:11.539372 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8784db-f77c-4a62-ab98-da7f085d92c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:11.540793 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-29d1b96b-aee3-417b-a0ed-7ae0be95487c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aec37aeb3844436098426091c9b15b0c', 'request_id': 'req-29d1b96b-aee3-417b-a0ed-7ae0be95487c'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:11.554253 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-29d1b96b-aee3-417b-a0ed-7ae0be95487c admin admin] The token cache is being invalidate because project aec37aeb3844436098426091c9b15b0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:23:11.554471 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-29d1b96b-aee3-417b-a0ed-7ae0be95487c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:11.555103 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-29d1b96b-aee3-417b-a0ed-7ae0be95487c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:11.556703 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1373/2730] 10.222.0.43 () {58 vars in 1232 bytes} [Wed Jun 22 10:23:11 2022] DELETE /identity/v3/projects/aec37aeb3844436098426091c9b15b0c => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:23:11.558459 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-5e8784db-f77c-4a62-ab98-da7f085d92c8 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:23:11.559060 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1792af-f775-41b2-898c-abfb2819c42a None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:11.559357 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1792af-f775-41b2-898c-abfb2819c42a None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:11.559642 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1792af-f775-41b2-898c-abfb2819c42a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:11.559761 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-5e8784db-f77c-4a62-ab98-da7f085d92c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:23:11.579233 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-bf1792af-f775-41b2-898c-abfb2819c42a None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:23:11.580447 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-bf1792af-f775-41b2-898c-abfb2819c42a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:23:11.629042 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1358/2731] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:23:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:23:11.630391 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422c9413-bbde-497c-b47b-b500c5904ec3 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:11.630684 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422c9413-bbde-497c-b47b-b500c5904ec3 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:11.630963 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422c9413-bbde-497c-b47b-b500c5904ec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:11.642456 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1374/2732] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:23:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:23:11.643318 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1792af-f775-41b2-898c-abfb2819c42a None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:11.649500 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-422c9413-bbde-497c-b47b-b500c5904ec3 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:23:11.650754 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-422c9413-bbde-497c-b47b-b500c5904ec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:23:11.654914 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1792af-f775-41b2-898c-abfb2819c42a None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:11.659011 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1359/2733] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:23:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:23:11.659737 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8782f16-519c-4cb3-98b6-0505f3bef3a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:11.659897 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422c9413-bbde-497c-b47b-b500c5904ec3 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:11.660399 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8782f16-519c-4cb3-98b6-0505f3bef3a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:11.660686 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8782f16-519c-4cb3-98b6-0505f3bef3a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:11.660964 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8782f16-519c-4cb3-98b6-0505f3bef3a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:11.661079 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-422c9413-bbde-497c-b47b-b500c5904ec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:23:11.661713 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8782f16-519c-4cb3-98b6-0505f3bef3a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:23:11.662045 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8782f16-519c-4cb3-98b6-0505f3bef3a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:11.663653 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8782f16-519c-4cb3-98b6-0505f3bef3a4 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:11.678760 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1375/2734] 10.222.0.43 () {58 vars in 1152 bytes} [Wed Jun 22 10:23:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:23:11.678760 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee0ad6f-0325-46a4-8873-b0e0b19b370c None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:11.678760 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee0ad6f-0325-46a4-8873-b0e0b19b370c None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:11.678760 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee0ad6f-0325-46a4-8873-b0e0b19b370c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:11.695363 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-9ee0ad6f-0325-46a4-8873-b0e0b19b370c None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:23:11.696557 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-9ee0ad6f-0325-46a4-8873-b0e0b19b370c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:23:11.706213 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1376/2735] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:23:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:23:11.706636 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee0ad6f-0325-46a4-8873-b0e0b19b370c None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:11.716046 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee0ad6f-0325-46a4-8873-b0e0b19b370c None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:11.720626 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2ff04e-77d3-4306-ab83-fa42ac280bf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:11.721267 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2ff04e-77d3-4306-ab83-fa42ac280bf9 admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:11.721553 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2ff04e-77d3-4306-ab83-fa42ac280bf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:11.721885 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2ff04e-77d3-4306-ab83-fa42ac280bf9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:11.722553 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2ff04e-77d3-4306-ab83-fa42ac280bf9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:11.723844 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422c9413-bbde-497c-b47b-b500c5904ec3 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:11.724454 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2ff04e-77d3-4306-ab83-fa42ac280bf9 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:11.728073 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679d762f-dca1-4905-a1dd-d1ba7efeb634 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe93d4c0737249fd8623bb5ce188e34e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:11.729031 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679d762f-dca1-4905-a1dd-d1ba7efeb634 service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:11.729318 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679d762f-dca1-4905-a1dd-d1ba7efeb634 service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:11.729596 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679d762f-dca1-4905-a1dd-d1ba7efeb634 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:11.740217 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679d762f-dca1-4905-a1dd-d1ba7efeb634 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:11.742259 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679d762f-dca1-4905-a1dd-d1ba7efeb634 service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:11.754520 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1377/2736] 10.222.0.43 () {60 vars in 1152 bytes} [Wed Jun 22 10:23:11 2022] POST /identity/v3/projects => generated 371 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:23:11.754520 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2ff04e-77d3-4306-ab83-fa42ac280bf9 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:11.754779 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1360/2737] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:23:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:23:11.755592 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679d762f-dca1-4905-a1dd-d1ba7efeb634 service neutron] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:11.766963 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679d762f-dca1-4905-a1dd-d1ba7efeb634 service neutron] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:11.833138 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2ff04e-77d3-4306-ab83-fa42ac280bf9 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:11.835621 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ca73e9-6374-4348-a1e5-6353a23bcbf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:11.836381 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ca73e9-6374-4348-a1e5-6353a23bcbf7 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:11.836673 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ca73e9-6374-4348-a1e5-6353a23bcbf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:11.836997 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ca73e9-6374-4348-a1e5-6353a23bcbf7 admin admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:11.837716 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ca73e9-6374-4348-a1e5-6353a23bcbf7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:11.839813 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfa73ab-ca53-4673-a867-8c891b955c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:11.839982 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ca73e9-6374-4348-a1e5-6353a23bcbf7 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:11.840935 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfa73ab-ca53-4673-a867-8c891b955c85 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:11.841508 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfa73ab-ca53-4673-a867-8c891b955c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:11.841973 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfa73ab-ca53-4673-a867-8c891b955c85 admin admin] PATH_INFO: `/v3/domains` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:11.843165 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfa73ab-ca53-4673-a867-8c891b955c85 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:23:11.843821 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfa73ab-ca53-4673-a867-8c891b955c85 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:11.845713 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfa73ab-ca53-4673-a867-8c891b955c85 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:11.861044 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1378/2738] 10.222.0.43 () {58 vars in 1152 bytes} [Wed Jun 22 10:23:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:23:11.863446 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1361/2739] 10.222.0.43 () {60 vars in 1143 bytes} [Wed Jun 22 10:23:11 2022] POST /identity/v3/users => generated 286 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:23:11.866055 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfa73ab-ca53-4673-a867-8c891b955c85 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:11.867166 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ca73e9-6374-4348-a1e5-6353a23bcbf7 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:11.872384 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:23:11.878224 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfa73ab-ca53-4673-a867-8c891b955c85 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:11.880064 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ca73e9-6374-4348-a1e5-6353a23bcbf7 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:11.885563 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813a1cea-bdf6-40cd-8028-aa4835e58bbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:11.886278 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813a1cea-bdf6-40cd-8028-aa4835e58bbc admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:11.886562 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813a1cea-bdf6-40cd-8028-aa4835e58bbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:11.886839 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813a1cea-bdf6-40cd-8028-aa4835e58bbc admin admin] PATH_INFO: `/v3/projects` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:11.886949 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e48dac-6a8f-4cfe-b37f-4a2c53147508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:11.887837 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813a1cea-bdf6-40cd-8028-aa4835e58bbc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:11.887991 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e48dac-6a8f-4cfe-b37f-4a2c53147508 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:11.887991 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e48dac-6a8f-4cfe-b37f-4a2c53147508 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:11.888336 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e48dac-6a8f-4cfe-b37f-4a2c53147508 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:11.889137 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e48dac-6a8f-4cfe-b37f-4a2c53147508 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:11.889626 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813a1cea-bdf6-40cd-8028-aa4835e58bbc admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:11.891784 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e48dac-6a8f-4cfe-b37f-4a2c53147508 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:11.904267 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1362/2740] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:23:11 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:23:11.908647 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e48dac-6a8f-4cfe-b37f-4a2c53147508 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:11.923174 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e48dac-6a8f-4cfe-b37f-4a2c53147508 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:11.929999 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1379/2741] 10.222.0.43 () {60 vars in 1152 bytes} [Wed Jun 22 10:23:11 2022] POST /identity/v3/projects => generated 375 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:23:11.934373 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ec31cd-898b-46fa-b509-71b41d2177f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:11.935101 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813a1cea-bdf6-40cd-8028-aa4835e58bbc admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:11.935239 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ec31cd-898b-46fa-b509-71b41d2177f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:11.935511 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ec31cd-898b-46fa-b509-71b41d2177f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:11.935790 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ec31cd-898b-46fa-b509-71b41d2177f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:11.937749 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ec31cd-898b-46fa-b509-71b41d2177f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:11.939746 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ec31cd-898b-46fa-b509-71b41d2177f7 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:11.941469 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:23:11.953976 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1363/2742] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:23:11 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:23:11.957490 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ec31cd-898b-46fa-b509-71b41d2177f7 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:11.968919 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ec31cd-898b-46fa-b509-71b41d2177f7 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:12.013329 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813a1cea-bdf6-40cd-8028-aa4835e58bbc admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:12.020338 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ea627f-37f2-4cbd-b778-882de36d78bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:12.021102 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ea627f-37f2-4cbd-b778-882de36d78bb admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:12.021392 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ea627f-37f2-4cbd-b778-882de36d78bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:12.021713 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ea627f-37f2-4cbd-b778-882de36d78bb admin admin] PATH_INFO: `/v3/users` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:12.022404 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ea627f-37f2-4cbd-b778-882de36d78bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:12.024911 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ea627f-37f2-4cbd-b778-882de36d78bb admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:12.055994 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1380/2743] 10.222.0.43 () {60 vars in 1143 bytes} [Wed Jun 22 10:23:11 2022] POST /identity/v3/users => generated 288 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 10:23:12.055994 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ea627f-37f2-4cbd-b778-882de36d78bb admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:12.056495 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f937d1c7-ac68-4f39-a8c2-e8c6024abd85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:12.057441 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f937d1c7-ac68-4f39-a8c2-e8c6024abd85 admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:12.057663 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f937d1c7-ac68-4f39-a8c2-e8c6024abd85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:12.058031 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f937d1c7-ac68-4f39-a8c2-e8c6024abd85 admin admin] PATH_INFO: `/v3/projects/c607f48c2a624e21b0e72b5d6075b43d/users/a390b7507e8347e2bd301b0e7a089a03/roles/9f88c83743f745a9a785a2f454753f06` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:12.060160 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-39ea627f-37f2-4cbd-b778-882de36d78bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:23:12.076428 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ea627f-37f2-4cbd-b778-882de36d78bb admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:12.083533 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e445661b-26b8-437b-8778-7bef19296efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:12.084635 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e445661b-26b8-437b-8778-7bef19296efb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:12.085043 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e445661b-26b8-437b-8778-7bef19296efb admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:12.085395 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e445661b-26b8-437b-8778-7bef19296efb admin admin] PATH_INFO: `/v3/projects/4445c014dc2a44cc9c7445fa5fc6928f` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:12.086648 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e445661b-26b8-437b-8778-7bef19296efb admin admin] RBAC: Authorizing `identity:delete_project(project_id=4445c014dc2a44cc9c7445fa5fc6928f)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:12.088588 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e445661b-26b8-437b-8778-7bef19296efb admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:12.094443 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f937d1c7-ac68-4f39-a8c2-e8c6024abd85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c607f48c2a624e21b0e72b5d6075b43d, user_id=a390b7507e8347e2bd301b0e7a089a03, role_id=9f88c83743f745a9a785a2f454753f06)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:12.097292 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f937d1c7-ac68-4f39-a8c2-e8c6024abd85 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:12.111797 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1364/2744] 10.222.0.43 () {60 vars in 1482 bytes} [Wed Jun 22 10:23:11 2022] PUT /identity/v3/projects/c607f48c2a624e21b0e72b5d6075b43d/users/a390b7507e8347e2bd301b0e7a089a03/roles/9f88c83743f745a9a785a2f454753f06 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:23:12.120551 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f937d1c7-ac68-4f39-a8c2-e8c6024abd85 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:12.150797 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-e445661b-26b8-437b-8778-7bef19296efb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4445c014dc2a44cc9c7445fa5fc6928f', 'request_id': 'req-e445661b-26b8-437b-8778-7bef19296efb'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:12.159309 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-e445661b-26b8-437b-8778-7bef19296efb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4445c014dc2a44cc9c7445fa5fc6928f', 'request_id': 'req-e445661b-26b8-437b-8778-7bef19296efb'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:12.165099 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-e445661b-26b8-437b-8778-7bef19296efb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4445c014dc2a44cc9c7445fa5fc6928f', 'request_id': 'req-e445661b-26b8-437b-8778-7bef19296efb'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:12.177085 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f937d1c7-ac68-4f39-a8c2-e8c6024abd85 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:12.178340 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-e445661b-26b8-437b-8778-7bef19296efb admin admin] The token cache is being invalidate because project 4445c014dc2a44cc9c7445fa5fc6928f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:23:12.178633 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-e445661b-26b8-437b-8778-7bef19296efb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:12.179247 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-e445661b-26b8-437b-8778-7bef19296efb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:12.180840 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1381/2745] 10.222.0.43 () {58 vars in 1232 bytes} [Wed Jun 22 10:23:12 2022] DELETE /identity/v3/projects/4445c014dc2a44cc9c7445fa5fc6928f => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:23:12.183012 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab04a9fa-124f-4cce-b94c-217f15403c94 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:12.183400 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab04a9fa-124f-4cce-b94c-217f15403c94 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:12.183749 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab04a9fa-124f-4cce-b94c-217f15403c94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:12.210254 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-ab04a9fa-124f-4cce-b94c-217f15403c94 None None] MFA Rules not processed for user `a390b7507e8347e2bd301b0e7a089a03`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:23:12.211571 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-ab04a9fa-124f-4cce-b94c-217f15403c94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:23:12.235495 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db7962b-6f9c-4cc6-8ad9-ba63d16a9807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:12.236285 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db7962b-6f9c-4cc6-8ad9-ba63d16a9807 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:12.236636 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db7962b-6f9c-4cc6-8ad9-ba63d16a9807 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:12.236922 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db7962b-6f9c-4cc6-8ad9-ba63d16a9807 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:12.237656 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db7962b-6f9c-4cc6-8ad9-ba63d16a9807 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:12.239300 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db7962b-6f9c-4cc6-8ad9-ba63d16a9807 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:12.250033 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1365/2746] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:23:12 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:23:12.251101 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db7962b-6f9c-4cc6-8ad9-ba63d16a9807 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:12.253084 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-7db7962b-6f9c-4cc6-8ad9-ba63d16a9807 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:23:12.266946 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db7962b-6f9c-4cc6-8ad9-ba63d16a9807 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:12.271596 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4159c6-064f-4806-9866-35258a42e39c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:12.272461 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4159c6-064f-4806-9866-35258a42e39c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:12.272746 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4159c6-064f-4806-9866-35258a42e39c admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:12.273022 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4159c6-064f-4806-9866-35258a42e39c admin admin] PATH_INFO: `/v3/users/8cccaaf1ddf94ea38be5133d8b296f17` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:12.274315 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4159c6-064f-4806-9866-35258a42e39c admin admin] RBAC: Authorizing `identity:delete_user(user_id=8cccaaf1ddf94ea38be5133d8b296f17)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:12.276233 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4159c6-064f-4806-9866-35258a42e39c admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:12.277831 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:23:12.284029 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1382/2747] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:23:12 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:23:12.284029 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab04a9fa-124f-4cce-b94c-217f15403c94 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:12.284029 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-ab04a9fa-124f-4cce-b94c-217f15403c94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:23:12.293343 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:23:12.298266 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab04a9fa-124f-4cce-b94c-217f15403c94 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:12.304027 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aa78cd-7783-480f-b5bb-df51587d6311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:12.304705 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aa78cd-7783-480f-b5bb-df51587d6311 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:12.305307 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aa78cd-7783-480f-b5bb-df51587d6311 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:12.305806 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aa78cd-7783-480f-b5bb-df51587d6311 admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:12.306901 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9aa78cd-7783-480f-b5bb-df51587d6311 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:12.308653 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9aa78cd-7783-480f-b5bb-df51587d6311 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:12.320264 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1383/2748] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:23:12 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:23:12.321069 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aa78cd-7783-480f-b5bb-df51587d6311 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:12.322742 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-c9aa78cd-7783-480f-b5bb-df51587d6311 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:23:12.332521 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-9a4159c6-064f-4806-9866-35258a42e39c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8cccaaf1ddf94ea38be5133d8b296f17'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:12.347026 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-9a4159c6-064f-4806-9866-35258a42e39c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8cccaaf1ddf94ea38be5133d8b296f17'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:12.354160 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-9a4159c6-064f-4806-9866-35258a42e39c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8cccaaf1ddf94ea38be5133d8b296f17'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:12.354894 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-9a4159c6-064f-4806-9866-35258a42e39c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8cccaaf1ddf94ea38be5133d8b296f17'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:12.361823 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-9a4159c6-064f-4806-9866-35258a42e39c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8cccaaf1ddf94ea38be5133d8b296f17'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:12.367781 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1366/2749] 10.222.0.43 () {58 vars in 1223 bytes} [Wed Jun 22 10:23:12 2022] DELETE /identity/v3/users/8cccaaf1ddf94ea38be5133d8b296f17 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:23:12.368406 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4159c6-064f-4806-9866-35258a42e39c admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:12.369757 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-9a4159c6-064f-4806-9866-35258a42e39c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:23:12.384075 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aa78cd-7783-480f-b5bb-df51587d6311 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:12.445257 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc82325-73a6-433f-a848-bd59188125b1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2418acec46b4db48346129004827853', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:12.446150 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc82325-73a6-433f-a848-bd59188125b1 service glance] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:12.446510 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc82325-73a6-433f-a848-bd59188125b1 service glance] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:12.447040 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc82325-73a6-433f-a848-bd59188125b1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:12.449263 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4159c6-064f-4806-9866-35258a42e39c admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:12.451278 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-3bc82325-73a6-433f-a848-bd59188125b1 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:23:12.454226 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1de925-622c-40cc-a108-64a9846d236a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:12.455109 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1de925-622c-40cc-a108-64a9846d236a admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:12.455398 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1de925-622c-40cc-a108-64a9846d236a admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:12.455672 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1de925-622c-40cc-a108-64a9846d236a admin admin] PATH_INFO: `/v3/projects/200fdb76f1b14c8d983cff798a4ecb65/users/02988c92ca6e45bdba927d895d04a084/roles/9f88c83743f745a9a785a2f454753f06` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:12.476492 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1de925-622c-40cc-a108-64a9846d236a admin admin] RBAC: Authorizing `identity:create_grant(project_id=200fdb76f1b14c8d983cff798a4ecb65, user_id=02988c92ca6e45bdba927d895d04a084, role_id=9f88c83743f745a9a785a2f454753f06)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:12.479485 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1de925-622c-40cc-a108-64a9846d236a admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:12.495146 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1367/2750] 10.222.0.43 () {60 vars in 1482 bytes} [Wed Jun 22 10:23:12 2022] PUT /identity/v3/projects/200fdb76f1b14c8d983cff798a4ecb65/users/02988c92ca6e45bdba927d895d04a084/roles/9f88c83743f745a9a785a2f454753f06 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:23:12.508427 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74a170a-1a1e-4a88-bf59-be08187429b1 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:12.508724 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74a170a-1a1e-4a88-bf59-be08187429b1 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:12.509010 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74a170a-1a1e-4a88-bf59-be08187429b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:12.523696 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc82325-73a6-433f-a848-bd59188125b1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:12.525140 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc82325-73a6-433f-a848-bd59188125b1 service glance] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:12.536108 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1384/2751] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:23:12 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:23:12.550431 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-c74a170a-1a1e-4a88-bf59-be08187429b1 None None] MFA Rules not processed for user `02988c92ca6e45bdba927d895d04a084`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:23:12.551741 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-c74a170a-1a1e-4a88-bf59-be08187429b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:23:12.611036 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:23:12.633554 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1368/2752] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:23:12 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:23:12.638099 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc82325-73a6-433f-a848-bd59188125b1 service glance] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:12.650779 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc82325-73a6-433f-a848-bd59188125b1 service glance] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:12.696579 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74a170a-1a1e-4a88-bf59-be08187429b1 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:12.698183 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-c74a170a-1a1e-4a88-bf59-be08187429b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:23:12.727065 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7fa3e3-4363-4ef2-95db-660f72a00380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:12.728082 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7fa3e3-4363-4ef2-95db-660f72a00380 admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:12.728379 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7fa3e3-4363-4ef2-95db-660f72a00380 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:12.728666 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7fa3e3-4363-4ef2-95db-660f72a00380 admin admin] PATH_INFO: `/v3/projects` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:12.729369 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7fa3e3-4363-4ef2-95db-660f72a00380 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:12.732557 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7fa3e3-4363-4ef2-95db-660f72a00380 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:12.743443 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=100 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:23:12.772467 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1385/2753] 10.222.0.43 () {60 vars in 1152 bytes} [Wed Jun 22 10:23:12 2022] POST /identity/v3/projects => generated 375 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:23:12.773360 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7fa3e3-4363-4ef2-95db-660f72a00380 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:12.785624 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74a170a-1a1e-4a88-bf59-be08187429b1 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:12.842639 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7fa3e3-4363-4ef2-95db-660f72a00380 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:12.847607 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4e211a-2772-49b2-bac8-8fe4ab823090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:12.848531 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4e211a-2772-49b2-bac8-8fe4ab823090 admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:12.848816 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4e211a-2772-49b2-bac8-8fe4ab823090 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:12.849100 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4e211a-2772-49b2-bac8-8fe4ab823090 admin admin] PATH_INFO: `/v3/users` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:12.849829 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4e211a-2772-49b2-bac8-8fe4ab823090 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:12.852102 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4e211a-2772-49b2-bac8-8fe4ab823090 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:12.858962 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c6e437-2691-4068-a1a8-81f9cd1762fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:12.859951 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c6e437-2691-4068-a1a8-81f9cd1762fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:12.860147 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c6e437-2691-4068-a1a8-81f9cd1762fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:12.860571 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c6e437-2691-4068-a1a8-81f9cd1762fd admin admin] PATH_INFO: `/v3/projects/d4be338fe2f54f229476848b66167090` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:12.861904 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c6e437-2691-4068-a1a8-81f9cd1762fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4be338fe2f54f229476848b66167090)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:12.864172 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c6e437-2691-4068-a1a8-81f9cd1762fd admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:12.876213 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1386/2754] 10.222.0.43 () {60 vars in 1143 bytes} [Wed Jun 22 10:23:12 2022] POST /identity/v3/users => generated 288 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 10:23:12.880158 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4e211a-2772-49b2-bac8-8fe4ab823090 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:12.892464 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4e211a-2772-49b2-bac8-8fe4ab823090 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:12.897717 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bc50ef-ea1f-4060-9e8d-9d1ad98478c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:12.898687 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bc50ef-ea1f-4060-9e8d-9d1ad98478c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:12.899171 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bc50ef-ea1f-4060-9e8d-9d1ad98478c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:12.899625 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bc50ef-ea1f-4060-9e8d-9d1ad98478c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:12.900178 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bc50ef-ea1f-4060-9e8d-9d1ad98478c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:12.901989 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bc50ef-ea1f-4060-9e8d-9d1ad98478c0 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:12.913673 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1387/2755] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:23:12 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 10:23:12.917859 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bc50ef-ea1f-4060-9e8d-9d1ad98478c0 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:12.923011 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-a7c6e437-2691-4068-a1a8-81f9cd1762fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4be338fe2f54f229476848b66167090', 'request_id': 'req-a7c6e437-2691-4068-a1a8-81f9cd1762fd'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:12.930901 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bc50ef-ea1f-4060-9e8d-9d1ad98478c0 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:12.935099 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-a7c6e437-2691-4068-a1a8-81f9cd1762fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4be338fe2f54f229476848b66167090', 'request_id': 'req-a7c6e437-2691-4068-a1a8-81f9cd1762fd'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:12.944813 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-a7c6e437-2691-4068-a1a8-81f9cd1762fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4be338fe2f54f229476848b66167090', 'request_id': 'req-a7c6e437-2691-4068-a1a8-81f9cd1762fd'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:12.961941 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-a7c6e437-2691-4068-a1a8-81f9cd1762fd admin admin] The token cache is being invalidate because project d4be338fe2f54f229476848b66167090 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:23:12.962378 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-a7c6e437-2691-4068-a1a8-81f9cd1762fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:12.963159 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-a7c6e437-2691-4068-a1a8-81f9cd1762fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:12.965391 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1369/2756] 10.222.0.43 () {58 vars in 1232 bytes} [Wed Jun 22 10:23:12 2022] DELETE /identity/v3/projects/d4be338fe2f54f229476848b66167090 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:23:12.971363 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a90ec7f-5fbf-496d-8afa-45296a1813cc None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:12.971702 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a90ec7f-5fbf-496d-8afa-45296a1813cc None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:12.971999 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a90ec7f-5fbf-496d-8afa-45296a1813cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:12.992872 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-0a90ec7f-5fbf-496d-8afa-45296a1813cc None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:23:12.994371 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-0a90ec7f-5fbf-496d-8afa-45296a1813cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:23:13.005713 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d84de0-5b40-4211-9c8b-a3648890c69e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:13.006400 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d84de0-5b40-4211-9c8b-a3648890c69e admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:13.006690 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d84de0-5b40-4211-9c8b-a3648890c69e admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:13.006972 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d84de0-5b40-4211-9c8b-a3648890c69e admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:13.007706 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d84de0-5b40-4211-9c8b-a3648890c69e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:13.009324 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d84de0-5b40-4211-9c8b-a3648890c69e admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:13.019957 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1388/2757] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:23:12 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 10:23:13.030480 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d84de0-5b40-4211-9c8b-a3648890c69e admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:13.031161 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:23:13.031281 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-97d84de0-5b40-4211-9c8b-a3648890c69e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:23:13.042270 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d84de0-5b40-4211-9c8b-a3648890c69e admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:13.049122 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f397abc-2609-4b7e-b14a-086a4349fcfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:13.049306 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f397abc-2609-4b7e-b14a-086a4349fcfa admin admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:13.049636 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f397abc-2609-4b7e-b14a-086a4349fcfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:13.050047 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f397abc-2609-4b7e-b14a-086a4349fcfa admin admin] PATH_INFO: `/v3/projects/79a65a9067fb42aabe1cfe6d8438bb68/users/f91d14066ad8410993743b2f6f1d1df7/roles/9f88c83743f745a9a785a2f454753f06` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:13.069492 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f397abc-2609-4b7e-b14a-086a4349fcfa admin admin] RBAC: Authorizing `identity:create_grant(project_id=79a65a9067fb42aabe1cfe6d8438bb68, user_id=f91d14066ad8410993743b2f6f1d1df7, role_id=9f88c83743f745a9a785a2f454753f06)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:13.072669 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f397abc-2609-4b7e-b14a-086a4349fcfa admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:13.082343 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1370/2758] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:23:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:23:13.090782 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204d6a4d-867b-4a2b-bbbc-1739d6933f14 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:13.091078 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204d6a4d-867b-4a2b-bbbc-1739d6933f14 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:13.091364 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204d6a4d-867b-4a2b-bbbc-1739d6933f14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:13.099310 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1389/2759] 10.222.0.43 () {60 vars in 1482 bytes} [Wed Jun 22 10:23:13 2022] PUT /identity/v3/projects/79a65a9067fb42aabe1cfe6d8438bb68/users/f91d14066ad8410993743b2f6f1d1df7/roles/9f88c83743f745a9a785a2f454753f06 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:23:13.111019 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83624241-9130-4093-89e5-ce8a4d6985e9 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:13.111753 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83624241-9130-4093-89e5-ce8a4d6985e9 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:13.112810 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83624241-9130-4093-89e5-ce8a4d6985e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:13.120351 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-204d6a4d-867b-4a2b-bbbc-1739d6933f14 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:23:13.121546 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-204d6a4d-867b-4a2b-bbbc-1739d6933f14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:23:13.146220 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-83624241-9130-4093-89e5-ce8a4d6985e9 None None] MFA Rules not processed for user `f91d14066ad8410993743b2f6f1d1df7`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:23:13.147488 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-83624241-9130-4093-89e5-ce8a4d6985e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:23:13.178518 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:23:13.186309 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1371/2760] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:23:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:23:13.190722 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204d6a4d-867b-4a2b-bbbc-1739d6933f14 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:13.199964 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204d6a4d-867b-4a2b-bbbc-1739d6933f14 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:13.204998 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f787a4bc-6d3a-45f1-bf04-8ee3188e2ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:13.205761 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f787a4bc-6d3a-45f1-bf04-8ee3188e2ef1 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:13.206069 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f787a4bc-6d3a-45f1-bf04-8ee3188e2ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:13.206337 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f787a4bc-6d3a-45f1-bf04-8ee3188e2ef1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:13.207066 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f787a4bc-6d3a-45f1-bf04-8ee3188e2ef1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:23:13.207377 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f787a4bc-6d3a-45f1-bf04-8ee3188e2ef1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:13.208979 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f787a4bc-6d3a-45f1-bf04-8ee3188e2ef1 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:13.215932 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1390/2761] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:23:13 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:23:13.220905 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83624241-9130-4093-89e5-ce8a4d6985e9 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:13.223169 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1372/2762] 10.222.0.43 () {58 vars in 1152 bytes} [Wed Jun 22 10:23:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:23:13.227309 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f787a4bc-6d3a-45f1-bf04-8ee3188e2ef1 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:13.231936 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83624241-9130-4093-89e5-ce8a4d6985e9 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:13.237408 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f787a4bc-6d3a-45f1-bf04-8ee3188e2ef1 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:13.239468 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af9d115-d931-4d21-9bf2-6de3dda99ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:13.240162 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af9d115-d931-4d21-9bf2-6de3dda99ba4 admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:13.240439 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af9d115-d931-4d21-9bf2-6de3dda99ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:13.240723 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af9d115-d931-4d21-9bf2-6de3dda99ba4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:13.241425 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af9d115-d931-4d21-9bf2-6de3dda99ba4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:13.243000 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b871b269-e84e-446b-a3f7-d1d9e1732d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:13.243656 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b871b269-e84e-446b-a3f7-d1d9e1732d6c admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:13.243791 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af9d115-d931-4d21-9bf2-6de3dda99ba4 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:13.243973 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b871b269-e84e-446b-a3f7-d1d9e1732d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:13.244219 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b871b269-e84e-446b-a3f7-d1d9e1732d6c admin admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:13.244910 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b871b269-e84e-446b-a3f7-d1d9e1732d6c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:13.246838 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b871b269-e84e-446b-a3f7-d1d9e1732d6c admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:13.273538 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1391/2763] 10.222.0.43 () {60 vars in 1152 bytes} [Wed Jun 22 10:23:13 2022] POST /identity/v3/projects => generated 375 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 10:23:13.277378 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af9d115-d931-4d21-9bf2-6de3dda99ba4 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:13.281376 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1373/2764] 10.222.0.43 () {60 vars in 1152 bytes} [Wed Jun 22 10:23:13 2022] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 10:23:13.282348 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b871b269-e84e-446b-a3f7-d1d9e1732d6c admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:13.345576 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af9d115-d931-4d21-9bf2-6de3dda99ba4 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:13.357345 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b871b269-e84e-446b-a3f7-d1d9e1732d6c admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:13.364471 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc0104a-0cc8-41ff-aadf-ca1cdfb210bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:13.365160 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc0104a-0cc8-41ff-aadf-ca1cdfb210bc admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:13.365513 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc0104a-0cc8-41ff-aadf-ca1cdfb210bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:13.365852 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc0104a-0cc8-41ff-aadf-ca1cdfb210bc admin admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:13.366573 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc0104a-0cc8-41ff-aadf-ca1cdfb210bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:13.368567 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc0104a-0cc8-41ff-aadf-ca1cdfb210bc admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:13.393880 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1374/2765] 10.222.0.43 () {60 vars in 1143 bytes} [Wed Jun 22 10:23:13 2022] POST /identity/v3/users => generated 287 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 10:23:13.395413 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc0104a-0cc8-41ff-aadf-ca1cdfb210bc admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:13.408481 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc0104a-0cc8-41ff-aadf-ca1cdfb210bc admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:13.415074 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b39a076-ee5c-423c-b4e3-6879349fd533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:13.415371 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e288d07-69cd-43c9-aac6-09a14737efa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:13.415767 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b39a076-ee5c-423c-b4e3-6879349fd533 admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:13.416144 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b39a076-ee5c-423c-b4e3-6879349fd533 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:13.416354 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e288d07-69cd-43c9-aac6-09a14737efa7 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:13.416760 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e288d07-69cd-43c9-aac6-09a14737efa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:13.417116 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b39a076-ee5c-423c-b4e3-6879349fd533 admin admin] PATH_INFO: `/v3/users` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:13.417238 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e288d07-69cd-43c9-aac6-09a14737efa7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:13.417852 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b39a076-ee5c-423c-b4e3-6879349fd533 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:13.418074 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e288d07-69cd-43c9-aac6-09a14737efa7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:13.419796 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b39a076-ee5c-423c-b4e3-6879349fd533 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:13.419906 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e288d07-69cd-43c9-aac6-09a14737efa7 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:13.443046 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1375/2766] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:23:13 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 10:23:13.444122 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e288d07-69cd-43c9-aac6-09a14737efa7 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:13.447882 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1392/2767] 10.222.0.43 () {60 vars in 1143 bytes} [Wed Jun 22 10:23:13 2022] POST /identity/v3/users => generated 294 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 10:23:13.451556 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b39a076-ee5c-423c-b4e3-6879349fd533 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:13.461054 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e288d07-69cd-43c9-aac6-09a14737efa7 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:13.462221 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b39a076-ee5c-423c-b4e3-6879349fd533 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:13.465776 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6576112d-5887-4a67-9574-ded1bcfcffb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:13.466444 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6576112d-5887-4a67-9574-ded1bcfcffb8 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:13.466732 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6576112d-5887-4a67-9574-ded1bcfcffb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:13.466860 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f86e7e-7b7e-4ce2-b45b-7d94eed793df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:13.467059 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6576112d-5887-4a67-9574-ded1bcfcffb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:13.467449 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f86e7e-7b7e-4ce2-b45b-7d94eed793df admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:13.467733 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f86e7e-7b7e-4ce2-b45b-7d94eed793df admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:13.468009 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f86e7e-7b7e-4ce2-b45b-7d94eed793df admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:13.468124 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6576112d-5887-4a67-9574-ded1bcfcffb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:13.468736 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f86e7e-7b7e-4ce2-b45b-7d94eed793df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:13.469802 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6576112d-5887-4a67-9574-ded1bcfcffb8 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:13.472682 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f86e7e-7b7e-4ce2-b45b-7d94eed793df admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:13.486146 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1376/2768] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:23:13 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:23:13.487874 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1393/2769] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:23:13 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 10:23:13.490171 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6576112d-5887-4a67-9574-ded1bcfcffb8 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:13.491940 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f86e7e-7b7e-4ce2-b45b-7d94eed793df admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:13.503665 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6576112d-5887-4a67-9574-ded1bcfcffb8 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:13.504420 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f86e7e-7b7e-4ce2-b45b-7d94eed793df admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:13.504615 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:23:13.509912 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcecb97-91a4-4558-b60b-9ab1eff04670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:13.510063 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d17c19-40a2-4bd3-b8b4-7782d82126f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:13.510751 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d17c19-40a2-4bd3-b8b4-7782d82126f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:13.510920 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcecb97-91a4-4558-b60b-9ab1eff04670 admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:13.511045 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d17c19-40a2-4bd3-b8b4-7782d82126f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:13.511191 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcecb97-91a4-4558-b60b-9ab1eff04670 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:13.511294 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d17c19-40a2-4bd3-b8b4-7782d82126f0 admin admin] PATH_INFO: `/v3/projects/f1c4b8d10e1649bcb2db2aa755acc673/users/923595831f144ec5b6b17d65f629b359/roles/26d9c2ab5dfc4e6d9ca80c6014123906` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:13.511453 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcecb97-91a4-4558-b60b-9ab1eff04670 admin admin] PATH_INFO: `/v3/projects/45d8b3859d924fcaa318f72b91799462/users/f7e44f80ad284117a2f49c8959e333e5/roles/9f88c83743f745a9a785a2f454753f06` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:13.527146 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d17c19-40a2-4bd3-b8b4-7782d82126f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1c4b8d10e1649bcb2db2aa755acc673, user_id=923595831f144ec5b6b17d65f629b359, role_id=26d9c2ab5dfc4e6d9ca80c6014123906)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:13.528426 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcecb97-91a4-4558-b60b-9ab1eff04670 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45d8b3859d924fcaa318f72b91799462, user_id=f7e44f80ad284117a2f49c8959e333e5, role_id=9f88c83743f745a9a785a2f454753f06)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:13.530164 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d17c19-40a2-4bd3-b8b4-7782d82126f0 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:13.531707 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcecb97-91a4-4558-b60b-9ab1eff04670 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:13.544096 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1394/2770] 10.222.0.43 () {60 vars in 1482 bytes} [Wed Jun 22 10:23:13 2022] PUT /identity/v3/projects/f1c4b8d10e1649bcb2db2aa755acc673/users/923595831f144ec5b6b17d65f629b359/roles/26d9c2ab5dfc4e6d9ca80c6014123906 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:23:13.548365 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1377/2771] 10.222.0.43 () {60 vars in 1482 bytes} [Wed Jun 22 10:23:13 2022] PUT /identity/v3/projects/45d8b3859d924fcaa318f72b91799462/users/f7e44f80ad284117a2f49c8959e333e5/roles/9f88c83743f745a9a785a2f454753f06 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:23:13.548766 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d17c19-40a2-4bd3-b8b4-7782d82126f0 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:13.560008 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:23:13.560567 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214ab126-6b6d-4686-a33b-ddbc9e4e40f8 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:13.560858 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214ab126-6b6d-4686-a33b-ddbc9e4e40f8 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:13.561832 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214ab126-6b6d-4686-a33b-ddbc9e4e40f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:13.590400 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-214ab126-6b6d-4686-a33b-ddbc9e4e40f8 None None] MFA Rules not processed for user `f7e44f80ad284117a2f49c8959e333e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:23:13.591979 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-214ab126-6b6d-4686-a33b-ddbc9e4e40f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:23:13.618270 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d17c19-40a2-4bd3-b8b4-7782d82126f0 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:13.662225 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1378/2772] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:23:13 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:23:13.674041 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214ab126-6b6d-4686-a33b-ddbc9e4e40f8 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:13.675416 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-214ab126-6b6d-4686-a33b-ddbc9e4e40f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:23:13.677530 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b882ea35-2030-40a4-968e-9288f7df98b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:13.678240 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b882ea35-2030-40a4-968e-9288f7df98b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:13.678526 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b882ea35-2030-40a4-968e-9288f7df98b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:13.678808 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b882ea35-2030-40a4-968e-9288f7df98b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:13.679541 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b882ea35-2030-40a4-968e-9288f7df98b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:13.681149 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b882ea35-2030-40a4-968e-9288f7df98b7 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:13.694917 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1395/2773] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:23:13 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 10:23:13.696184 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b882ea35-2030-40a4-968e-9288f7df98b7 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:13.707023 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b882ea35-2030-40a4-968e-9288f7df98b7 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:13.711916 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb7e974-78ed-40d9-a370-91d56563d7a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:13.712803 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb7e974-78ed-40d9-a370-91d56563d7a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:13.713096 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb7e974-78ed-40d9-a370-91d56563d7a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:13.713377 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb7e974-78ed-40d9-a370-91d56563d7a2 admin admin] PATH_INFO: `/v3/projects/f1c4b8d10e1649bcb2db2aa755acc673/users/923595831f144ec5b6b17d65f629b359/roles/26d9c2ab5dfc4e6d9ca80c6014123906` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:13.715440 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb7e974-78ed-40d9-a370-91d56563d7a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1c4b8d10e1649bcb2db2aa755acc673, user_id=923595831f144ec5b6b17d65f629b359, role_id=26d9c2ab5dfc4e6d9ca80c6014123906)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:13.718771 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb7e974-78ed-40d9-a370-91d56563d7a2 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:13.729533 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1396/2774] 10.222.0.43 () {60 vars in 1482 bytes} [Wed Jun 22 10:23:13 2022] PUT /identity/v3/projects/f1c4b8d10e1649bcb2db2aa755acc673/users/923595831f144ec5b6b17d65f629b359/roles/26d9c2ab5dfc4e6d9ca80c6014123906 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:23:13.735786 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214ab126-6b6d-4686-a33b-ddbc9e4e40f8 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:13.740333 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a9f1c3-500a-4335-935e-a63ab234f019 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:13.740630 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a9f1c3-500a-4335-935e-a63ab234f019 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:13.740915 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a9f1c3-500a-4335-935e-a63ab234f019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:13.769832 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-c9a9f1c3-500a-4335-935e-a63ab234f019 None None] MFA Rules not processed for user `923595831f144ec5b6b17d65f629b359`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:23:13.771038 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-c9a9f1c3-500a-4335-935e-a63ab234f019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:23:13.787295 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33839b28-33d3-4074-926f-da7f8f8e297a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bbcb3d4dc704dfdb0097abc594ca855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:13.787951 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33839b28-33d3-4074-926f-da7f8f8e297a service cinder] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:13.788234 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33839b28-33d3-4074-926f-da7f8f8e297a service cinder] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:13.788533 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33839b28-33d3-4074-926f-da7f8f8e297a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:13.833368 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:23:13.859096 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1397/2775] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:23:13 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 10:23:13.859339 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33839b28-33d3-4074-926f-da7f8f8e297a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:13.859339 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33839b28-33d3-4074-926f-da7f8f8e297a service cinder] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:13.868457 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1379/2776] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:23:13 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 10:23:13.878297 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a9f1c3-500a-4335-935e-a63ab234f019 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:13.879739 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-c9a9f1c3-500a-4335-935e-a63ab234f019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:23:13.892365 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a9f1c3-500a-4335-935e-a63ab234f019 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:13.896602 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d106895-1a4e-4080-b293-c3116842bc05 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bbcb3d4dc704dfdb0097abc594ca855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:13.897249 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d106895-1a4e-4080-b293-c3116842bc05 service cinder] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:13.897526 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d106895-1a4e-4080-b293-c3116842bc05 service cinder] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:13.897838 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d106895-1a4e-4080-b293-c3116842bc05 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:13.899802 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-8d106895-1a4e-4080-b293-c3116842bc05 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:23:13.929026 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:23:13.973362 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d106895-1a4e-4080-b293-c3116842bc05 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:13.974973 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d106895-1a4e-4080-b293-c3116842bc05 service cinder] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:13.986151 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1398/2777] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:23:13 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:23:15.571595 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33839b28-33d3-4074-926f-da7f8f8e297a service cinder] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:15.582855 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33839b28-33d3-4074-926f-da7f8f8e297a service cinder] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:15.586734 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a4d489-4a33-44e2-934a-bb75c487c764 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bbcb3d4dc704dfdb0097abc594ca855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:15.587414 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a4d489-4a33-44e2-934a-bb75c487c764 service cinder] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:15.587694 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a4d489-4a33-44e2-934a-bb75c487c764 service cinder] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:15.587970 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a4d489-4a33-44e2-934a-bb75c487c764 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:15.657790 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a4d489-4a33-44e2-934a-bb75c487c764 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:15.659737 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a4d489-4a33-44e2-934a-bb75c487c764 service cinder] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:15.669570 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1380/2778] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:23:15 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:23:16.412504 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d106895-1a4e-4080-b293-c3116842bc05 service cinder] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:16.422244 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d106895-1a4e-4080-b293-c3116842bc05 service cinder] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:16.425950 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ec8c31-e9ad-4b2a-b7e1-d9c82213d1e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bbcb3d4dc704dfdb0097abc594ca855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:16.426569 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ec8c31-e9ad-4b2a-b7e1-d9c82213d1e8 service cinder] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:16.426859 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ec8c31-e9ad-4b2a-b7e1-d9c82213d1e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:16.427142 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ec8c31-e9ad-4b2a-b7e1-d9c82213d1e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:16.436693 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ec8c31-e9ad-4b2a-b7e1-d9c82213d1e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:16.438289 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ec8c31-e9ad-4b2a-b7e1-d9c82213d1e8 service cinder] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:16.450835 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1399/2779] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:23:16 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:23:20.359530 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a4d489-4a33-44e2-934a-bb75c487c764 service cinder] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:20.429496 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a4d489-4a33-44e2-934a-bb75c487c764 service cinder] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:20.434077 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f5ff63-c3ec-445f-b763-a3d43eba3ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:20.434955 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f5ff63-c3ec-445f-b763-a3d43eba3ea6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:20.435233 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f5ff63-c3ec-445f-b763-a3d43eba3ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:20.435505 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f5ff63-c3ec-445f-b763-a3d43eba3ea6 admin admin] PATH_INFO: `/v3/users/02988c92ca6e45bdba927d895d04a084` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:20.437272 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f5ff63-c3ec-445f-b763-a3d43eba3ea6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=02988c92ca6e45bdba927d895d04a084)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:20.439243 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f5ff63-c3ec-445f-b763-a3d43eba3ea6 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:20.491228 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-39f5ff63-c3ec-445f-b763-a3d43eba3ea6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02988c92ca6e45bdba927d895d04a084'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:20.504723 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-39f5ff63-c3ec-445f-b763-a3d43eba3ea6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02988c92ca6e45bdba927d895d04a084'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:20.514660 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-39f5ff63-c3ec-445f-b763-a3d43eba3ea6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02988c92ca6e45bdba927d895d04a084'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:20.515300 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-39f5ff63-c3ec-445f-b763-a3d43eba3ea6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02988c92ca6e45bdba927d895d04a084'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:20.522133 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:23:20.525235 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-39f5ff63-c3ec-445f-b763-a3d43eba3ea6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02988c92ca6e45bdba927d895d04a084'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:20.533856 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1381/2780] 10.222.0.43 () {58 vars in 1223 bytes} [Wed Jun 22 10:23:20 2022] DELETE /identity/v3/users/02988c92ca6e45bdba927d895d04a084 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:23:20.538665 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562a19a4-1784-48d2-bb6c-2af3a959d7bd None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:20.539186 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562a19a4-1784-48d2-bb6c-2af3a959d7bd None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:20.539294 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562a19a4-1784-48d2-bb6c-2af3a959d7bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:20.561557 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-562a19a4-1784-48d2-bb6c-2af3a959d7bd None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:23:20.562796 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-562a19a4-1784-48d2-bb6c-2af3a959d7bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:23:20.630237 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1400/2781] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:23:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:23:20.641216 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f5ff63-c3ec-445f-b763-a3d43eba3ea6 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:20.642713 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-39f5ff63-c3ec-445f-b763-a3d43eba3ea6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:23:20.702543 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f5ff63-c3ec-445f-b763-a3d43eba3ea6 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:20.707313 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c69b05-7bbd-44d2-81b4-5b714c9b6404 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe93d4c0737249fd8623bb5ce188e34e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:20.708622 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c69b05-7bbd-44d2-81b4-5b714c9b6404 service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:20.708915 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c69b05-7bbd-44d2-81b4-5b714c9b6404 service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:20.709197 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c69b05-7bbd-44d2-81b4-5b714c9b6404 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:20.720042 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c69b05-7bbd-44d2-81b4-5b714c9b6404 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:20.721550 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c69b05-7bbd-44d2-81b4-5b714c9b6404 service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:20.731669 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1382/2782] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:23:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:23:21.018163 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562a19a4-1784-48d2-bb6c-2af3a959d7bd None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:21.019787 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-562a19a4-1784-48d2-bb6c-2af3a959d7bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:23:21.033775 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562a19a4-1784-48d2-bb6c-2af3a959d7bd None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:21.043925 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bcde12-e923-4c37-a1f2-8f9c8a305a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:21.044811 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bcde12-e923-4c37-a1f2-8f9c8a305a03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:21.045183 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bcde12-e923-4c37-a1f2-8f9c8a305a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:21.046059 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bcde12-e923-4c37-a1f2-8f9c8a305a03 admin admin] PATH_INFO: `/v3/projects/200fdb76f1b14c8d983cff798a4ecb65` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:21.047257 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bcde12-e923-4c37-a1f2-8f9c8a305a03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=200fdb76f1b14c8d983cff798a4ecb65)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:21.049122 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bcde12-e923-4c37-a1f2-8f9c8a305a03 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:21.098702 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-04bcde12-e923-4c37-a1f2-8f9c8a305a03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '200fdb76f1b14c8d983cff798a4ecb65', 'request_id': 'req-04bcde12-e923-4c37-a1f2-8f9c8a305a03'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:21.107356 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-04bcde12-e923-4c37-a1f2-8f9c8a305a03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '200fdb76f1b14c8d983cff798a4ecb65', 'request_id': 'req-04bcde12-e923-4c37-a1f2-8f9c8a305a03'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:21.113619 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-04bcde12-e923-4c37-a1f2-8f9c8a305a03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '200fdb76f1b14c8d983cff798a4ecb65', 'request_id': 'req-04bcde12-e923-4c37-a1f2-8f9c8a305a03'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:21.126983 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-04bcde12-e923-4c37-a1f2-8f9c8a305a03 admin admin] The token cache is being invalidate because project 200fdb76f1b14c8d983cff798a4ecb65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:23:21.127268 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-04bcde12-e923-4c37-a1f2-8f9c8a305a03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:21.127882 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-04bcde12-e923-4c37-a1f2-8f9c8a305a03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:21.129404 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1401/2783] 10.222.0.43 () {58 vars in 1232 bytes} [Wed Jun 22 10:23:21 2022] DELETE /identity/v3/projects/200fdb76f1b14c8d983cff798a4ecb65 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:23:21.133444 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c69b05-7bbd-44d2-81b4-5b714c9b6404 service neutron] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:21.143188 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c69b05-7bbd-44d2-81b4-5b714c9b6404 service neutron] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:21.202161 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d0a808-c16f-4901-b835-da31cee7d509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:21.203289 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d0a808-c16f-4901-b835-da31cee7d509 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:21.203597 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d0a808-c16f-4901-b835-da31cee7d509 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:21.203956 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d0a808-c16f-4901-b835-da31cee7d509 admin admin] PATH_INFO: `/v3/users/f91d14066ad8410993743b2f6f1d1df7` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:21.205284 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d0a808-c16f-4901-b835-da31cee7d509 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f91d14066ad8410993743b2f6f1d1df7)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:21.207787 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d0a808-c16f-4901-b835-da31cee7d509 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:21.257048 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-97d0a808-c16f-4901-b835-da31cee7d509 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f91d14066ad8410993743b2f6f1d1df7'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:21.269284 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-97d0a808-c16f-4901-b835-da31cee7d509 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f91d14066ad8410993743b2f6f1d1df7'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:21.277108 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-97d0a808-c16f-4901-b835-da31cee7d509 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f91d14066ad8410993743b2f6f1d1df7'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:21.277822 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-97d0a808-c16f-4901-b835-da31cee7d509 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f91d14066ad8410993743b2f6f1d1df7'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:21.285960 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-97d0a808-c16f-4901-b835-da31cee7d509 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f91d14066ad8410993743b2f6f1d1df7'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:21.291805 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1383/2784] 10.222.0.43 () {58 vars in 1223 bytes} [Wed Jun 22 10:23:21 2022] DELETE /identity/v3/users/f91d14066ad8410993743b2f6f1d1df7 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:23:21.572970 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bcde12-e923-4c37-a1f2-8f9c8a305a03 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:21.574843 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-04bcde12-e923-4c37-a1f2-8f9c8a305a03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:23:21.588648 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bcde12-e923-4c37-a1f2-8f9c8a305a03 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:21.629750 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:23:21.669031 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e5c687-4a5a-4320-9302-c8076a509c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:21.669932 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e5c687-4a5a-4320-9302-c8076a509c48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:21.670314 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e5c687-4a5a-4320-9302-c8076a509c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:21.670640 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e5c687-4a5a-4320-9302-c8076a509c48 admin admin] PATH_INFO: `/v3/projects/79a65a9067fb42aabe1cfe6d8438bb68` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:21.672359 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e5c687-4a5a-4320-9302-c8076a509c48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=79a65a9067fb42aabe1cfe6d8438bb68)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:21.674744 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e5c687-4a5a-4320-9302-c8076a509c48 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:21.729306 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-62e5c687-4a5a-4320-9302-c8076a509c48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79a65a9067fb42aabe1cfe6d8438bb68', 'request_id': 'req-62e5c687-4a5a-4320-9302-c8076a509c48'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:21.735711 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-62e5c687-4a5a-4320-9302-c8076a509c48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79a65a9067fb42aabe1cfe6d8438bb68', 'request_id': 'req-62e5c687-4a5a-4320-9302-c8076a509c48'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:21.741370 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-62e5c687-4a5a-4320-9302-c8076a509c48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79a65a9067fb42aabe1cfe6d8438bb68', 'request_id': 'req-62e5c687-4a5a-4320-9302-c8076a509c48'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:21.754071 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-62e5c687-4a5a-4320-9302-c8076a509c48 admin admin] The token cache is being invalidate because project 79a65a9067fb42aabe1cfe6d8438bb68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:23:21.754360 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-62e5c687-4a5a-4320-9302-c8076a509c48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:21.755087 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-62e5c687-4a5a-4320-9302-c8076a509c48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:21.756694 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1402/2785] 10.222.0.43 () {58 vars in 1232 bytes} [Wed Jun 22 10:23:21 2022] DELETE /identity/v3/projects/79a65a9067fb42aabe1cfe6d8438bb68 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:23:21.760851 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d0a808-c16f-4901-b835-da31cee7d509 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:21.762298 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-97d0a808-c16f-4901-b835-da31cee7d509 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:23:21.775950 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d0a808-c16f-4901-b835-da31cee7d509 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:21.789670 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:23:21.839846 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98937ae2-5cd8-4bb1-bdc9-a211503571a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:21.840728 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98937ae2-5cd8-4bb1-bdc9-a211503571a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:21.841016 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98937ae2-5cd8-4bb1-bdc9-a211503571a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:21.841301 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98937ae2-5cd8-4bb1-bdc9-a211503571a6 admin admin] PATH_INFO: `/v3/users/923595831f144ec5b6b17d65f629b359` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:21.843099 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98937ae2-5cd8-4bb1-bdc9-a211503571a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=923595831f144ec5b6b17d65f629b359)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:21.845103 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98937ae2-5cd8-4bb1-bdc9-a211503571a6 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:21.894370 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-98937ae2-5cd8-4bb1-bdc9-a211503571a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '923595831f144ec5b6b17d65f629b359'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:21.914383 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-98937ae2-5cd8-4bb1-bdc9-a211503571a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '923595831f144ec5b6b17d65f629b359'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:21.922258 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-98937ae2-5cd8-4bb1-bdc9-a211503571a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '923595831f144ec5b6b17d65f629b359'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:21.922945 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-98937ae2-5cd8-4bb1-bdc9-a211503571a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '923595831f144ec5b6b17d65f629b359'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:21.929989 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-98937ae2-5cd8-4bb1-bdc9-a211503571a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '923595831f144ec5b6b17d65f629b359'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:21.936324 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1384/2786] 10.222.0.43 () {58 vars in 1223 bytes} [Wed Jun 22 10:23:21 2022] DELETE /identity/v3/users/923595831f144ec5b6b17d65f629b359 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:23:22.240425 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e5c687-4a5a-4320-9302-c8076a509c48 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:22.242337 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-62e5c687-4a5a-4320-9302-c8076a509c48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:23:22.261766 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e5c687-4a5a-4320-9302-c8076a509c48 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:22.321223 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cf45c5-0734-4cb7-b763-f748cc57669b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:22.322035 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cf45c5-0734-4cb7-b763-f748cc57669b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:22.322316 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cf45c5-0734-4cb7-b763-f748cc57669b admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:22.322591 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cf45c5-0734-4cb7-b763-f748cc57669b admin admin] PATH_INFO: `/v3/projects/f1c4b8d10e1649bcb2db2aa755acc673` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:22.323770 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cf45c5-0734-4cb7-b763-f748cc57669b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1c4b8d10e1649bcb2db2aa755acc673)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:22.325710 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cf45c5-0734-4cb7-b763-f748cc57669b admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:22.375025 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-33cf45c5-0734-4cb7-b763-f748cc57669b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1c4b8d10e1649bcb2db2aa755acc673', 'request_id': 'req-33cf45c5-0734-4cb7-b763-f748cc57669b'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:22.381187 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-33cf45c5-0734-4cb7-b763-f748cc57669b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1c4b8d10e1649bcb2db2aa755acc673', 'request_id': 'req-33cf45c5-0734-4cb7-b763-f748cc57669b'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:22.386676 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-33cf45c5-0734-4cb7-b763-f748cc57669b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1c4b8d10e1649bcb2db2aa755acc673', 'request_id': 'req-33cf45c5-0734-4cb7-b763-f748cc57669b'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:22.389563 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:23:22.401422 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-33cf45c5-0734-4cb7-b763-f748cc57669b admin admin] The token cache is being invalidate because project f1c4b8d10e1649bcb2db2aa755acc673 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:23:22.401737 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-33cf45c5-0734-4cb7-b763-f748cc57669b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:22.402358 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-33cf45c5-0734-4cb7-b763-f748cc57669b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:22.403873 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1403/2787] 10.222.0.43 () {58 vars in 1232 bytes} [Wed Jun 22 10:23:22 2022] DELETE /identity/v3/projects/f1c4b8d10e1649bcb2db2aa755acc673 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:23:22.408711 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026f7aa5-d2d4-4274-ad32-37fa633e6e1d None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:22.409014 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026f7aa5-d2d4-4274-ad32-37fa633e6e1d None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:22.409301 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026f7aa5-d2d4-4274-ad32-37fa633e6e1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:22.430975 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-026f7aa5-d2d4-4274-ad32-37fa633e6e1d None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:23:22.432229 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-026f7aa5-d2d4-4274-ad32-37fa633e6e1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:23:22.494603 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1385/2788] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:23:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:23:22.502974 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277b0a01-44f1-4435-be29-d1216e9ef425 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:22.503266 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277b0a01-44f1-4435-be29-d1216e9ef425 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:22.503543 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277b0a01-44f1-4435-be29-d1216e9ef425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:22.521233 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-277b0a01-44f1-4435-be29-d1216e9ef425 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:23:22.522525 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-277b0a01-44f1-4435-be29-d1216e9ef425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:23:22.530291 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1404/2789] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:23:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:23:22.534608 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026f7aa5-d2d4-4274-ad32-37fa633e6e1d None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:22.546455 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026f7aa5-d2d4-4274-ad32-37fa633e6e1d None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:22.551353 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150d049a-cab4-4e51-8e63-86c59dab77cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:22.552038 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150d049a-cab4-4e51-8e63-86c59dab77cb admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:22.552322 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150d049a-cab4-4e51-8e63-86c59dab77cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:22.552600 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150d049a-cab4-4e51-8e63-86c59dab77cb admin admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:22.553340 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150d049a-cab4-4e51-8e63-86c59dab77cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:23:22.553645 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150d049a-cab4-4e51-8e63-86c59dab77cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:22.555504 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150d049a-cab4-4e51-8e63-86c59dab77cb admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:22.569226 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1386/2790] 10.222.0.43 () {58 vars in 1152 bytes} [Wed Jun 22 10:23:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 10:23:22.574092 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277b0a01-44f1-4435-be29-d1216e9ef425 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:22.584443 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277b0a01-44f1-4435-be29-d1216e9ef425 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:22.589196 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903582d3-6459-45ec-9e9b-f910ef9cec6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:22.589942 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903582d3-6459-45ec-9e9b-f910ef9cec6d admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:22.590223 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903582d3-6459-45ec-9e9b-f910ef9cec6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:22.590498 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903582d3-6459-45ec-9e9b-f910ef9cec6d admin admin] PATH_INFO: `/v3/projects` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:22.591477 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903582d3-6459-45ec-9e9b-f910ef9cec6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:22.594337 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903582d3-6459-45ec-9e9b-f910ef9cec6d admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:22.625894 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1405/2791] 10.222.0.43 () {60 vars in 1152 bytes} [Wed Jun 22 10:23:22 2022] POST /identity/v3/projects => generated 363 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 10:23:22.630218 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150d049a-cab4-4e51-8e63-86c59dab77cb admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:22.640901 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150d049a-cab4-4e51-8e63-86c59dab77cb admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:22.665261 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:23:22.718757 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5159cd6d-03c3-4159-bae9-920af172d119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:22.718757 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5159cd6d-03c3-4159-bae9-920af172d119 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:22.718757 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5159cd6d-03c3-4159-bae9-920af172d119 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:22.718757 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5159cd6d-03c3-4159-bae9-920af172d119 admin admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:22.719161 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5159cd6d-03c3-4159-bae9-920af172d119 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:22.719993 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5159cd6d-03c3-4159-bae9-920af172d119 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:22.743962 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1387/2792] 10.222.0.43 () {60 vars in 1143 bytes} [Wed Jun 22 10:23:22 2022] POST /identity/v3/users => generated 282 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:23:22.748269 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903582d3-6459-45ec-9e9b-f910ef9cec6d admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:22.761037 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903582d3-6459-45ec-9e9b-f910ef9cec6d admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:22.770439 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0093557b-4c5f-420f-bc33-a73d4d0a33dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:22.771165 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0093557b-4c5f-420f-bc33-a73d4d0a33dd admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:22.771451 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0093557b-4c5f-420f-bc33-a73d4d0a33dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:22.771726 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0093557b-4c5f-420f-bc33-a73d4d0a33dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:22.772470 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0093557b-4c5f-420f-bc33-a73d4d0a33dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:22.774150 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0093557b-4c5f-420f-bc33-a73d4d0a33dd admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:22.791393 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1406/2793] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:23:22 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:23:22.792179 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5159cd6d-03c3-4159-bae9-920af172d119 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:22.803720 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5159cd6d-03c3-4159-bae9-920af172d119 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:22.808797 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457b16a7-8630-4a53-8727-4f2e200d7c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:22.809638 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457b16a7-8630-4a53-8727-4f2e200d7c52 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:22.809965 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457b16a7-8630-4a53-8727-4f2e200d7c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:22.810278 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457b16a7-8630-4a53-8727-4f2e200d7c52 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:22.811151 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457b16a7-8630-4a53-8727-4f2e200d7c52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:22.812958 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457b16a7-8630-4a53-8727-4f2e200d7c52 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:22.823474 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1388/2794] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:23:22 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:23:22.828181 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0093557b-4c5f-420f-bc33-a73d4d0a33dd admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:22.842590 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0093557b-4c5f-420f-bc33-a73d4d0a33dd admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:22.844452 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ebbcc2-abec-41b6-ba77-7552e5d8eeee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:22.845405 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ebbcc2-abec-41b6-ba77-7552e5d8eeee admin admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:22.845703 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ebbcc2-abec-41b6-ba77-7552e5d8eeee admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:22.845985 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ebbcc2-abec-41b6-ba77-7552e5d8eeee admin admin] PATH_INFO: `/v3/projects/6d53c5c733bf45aea23c6cb46cf3a155/users/1a7d198b5c0346d0b1328cc781fb8893/roles/9f88c83743f745a9a785a2f454753f06` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:22.862391 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ebbcc2-abec-41b6-ba77-7552e5d8eeee admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d53c5c733bf45aea23c6cb46cf3a155, user_id=1a7d198b5c0346d0b1328cc781fb8893, role_id=9f88c83743f745a9a785a2f454753f06)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:22.865732 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ebbcc2-abec-41b6-ba77-7552e5d8eeee admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:22.895422 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1407/2795] 10.222.0.43 () {60 vars in 1482 bytes} [Wed Jun 22 10:23:22 2022] PUT /identity/v3/projects/6d53c5c733bf45aea23c6cb46cf3a155/users/1a7d198b5c0346d0b1328cc781fb8893/roles/9f88c83743f745a9a785a2f454753f06 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:23:22.906389 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b21e7a-6776-4c3f-99f2-50b9076df311 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:22.906681 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b21e7a-6776-4c3f-99f2-50b9076df311 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:22.906961 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b21e7a-6776-4c3f-99f2-50b9076df311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:22.934719 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-75b21e7a-6776-4c3f-99f2-50b9076df311 None None] MFA Rules not processed for user `1a7d198b5c0346d0b1328cc781fb8893`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:23:22.935979 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-75b21e7a-6776-4c3f-99f2-50b9076df311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:23:23.006136 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1389/2796] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:23:22 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:23:23.017862 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ebbcc2-abec-41b6-ba77-7552e5d8eeee admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:23.019556 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-a1ebbcc2-abec-41b6-ba77-7552e5d8eeee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:23:23.080443 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ebbcc2-abec-41b6-ba77-7552e5d8eeee admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:23.084057 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94074d87-e2ae-4e6e-96d8-c1e592406930 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bbcb3d4dc704dfdb0097abc594ca855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:23.084703 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94074d87-e2ae-4e6e-96d8-c1e592406930 service cinder] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:23.084985 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94074d87-e2ae-4e6e-96d8-c1e592406930 service cinder] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:23.085262 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94074d87-e2ae-4e6e-96d8-c1e592406930 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:23.094394 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94074d87-e2ae-4e6e-96d8-c1e592406930 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:23.095824 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94074d87-e2ae-4e6e-96d8-c1e592406930 service cinder] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:23.105039 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1408/2797] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:23:23 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:23:23.869954 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b21e7a-6776-4c3f-99f2-50b9076df311 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:23.871398 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-75b21e7a-6776-4c3f-99f2-50b9076df311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:23:23.939805 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b21e7a-6776-4c3f-99f2-50b9076df311 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:23.944245 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3088ae22-6f9e-4041-9a8e-155336b8019f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:23.945113 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3088ae22-6f9e-4041-9a8e-155336b8019f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:23.945395 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3088ae22-6f9e-4041-9a8e-155336b8019f admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:23.945672 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3088ae22-6f9e-4041-9a8e-155336b8019f admin admin] PATH_INFO: `/v3/users/f7e44f80ad284117a2f49c8959e333e5` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:23.946877 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3088ae22-6f9e-4041-9a8e-155336b8019f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7e44f80ad284117a2f49c8959e333e5)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:23.948802 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3088ae22-6f9e-4041-9a8e-155336b8019f admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:23.987867 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:23:23.998370 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-3088ae22-6f9e-4041-9a8e-155336b8019f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7e44f80ad284117a2f49c8959e333e5'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:24.010197 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-3088ae22-6f9e-4041-9a8e-155336b8019f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7e44f80ad284117a2f49c8959e333e5'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:24.017850 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-3088ae22-6f9e-4041-9a8e-155336b8019f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7e44f80ad284117a2f49c8959e333e5'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:24.018590 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-3088ae22-6f9e-4041-9a8e-155336b8019f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7e44f80ad284117a2f49c8959e333e5'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:24.025601 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-3088ae22-6f9e-4041-9a8e-155336b8019f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7e44f80ad284117a2f49c8959e333e5'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:24.032760 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1390/2798] 10.222.0.43 () {58 vars in 1223 bytes} [Wed Jun 22 10:23:23 2022] DELETE /identity/v3/users/f7e44f80ad284117a2f49c8959e333e5 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:23:24.037248 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d054ea-6976-40c3-9843-d2e9e2c26f81 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:24.037746 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d054ea-6976-40c3-9843-d2e9e2c26f81 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:24.037895 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d054ea-6976-40c3-9843-d2e9e2c26f81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:24.056081 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-c8d054ea-6976-40c3-9843-d2e9e2c26f81 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:23:24.057284 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-c8d054ea-6976-40c3-9843-d2e9e2c26f81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:23:24.118262 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1409/2799] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:23:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:23:24.128006 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3088ae22-6f9e-4041-9a8e-155336b8019f admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:24.129425 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-3088ae22-6f9e-4041-9a8e-155336b8019f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:23:24.186238 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3088ae22-6f9e-4041-9a8e-155336b8019f admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:24.189903 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5700d50e-c819-45ae-82a5-435d474883ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe93d4c0737249fd8623bb5ce188e34e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:24.190546 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5700d50e-c819-45ae-82a5-435d474883ad service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:24.190834 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5700d50e-c819-45ae-82a5-435d474883ad service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:24.191114 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5700d50e-c819-45ae-82a5-435d474883ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:24.200072 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5700d50e-c819-45ae-82a5-435d474883ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:24.201502 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5700d50e-c819-45ae-82a5-435d474883ad service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:24.210911 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1391/2800] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:23:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:23:24.483661 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d054ea-6976-40c3-9843-d2e9e2c26f81 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:24.491667 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-c8d054ea-6976-40c3-9843-d2e9e2c26f81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:23:24.505134 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d054ea-6976-40c3-9843-d2e9e2c26f81 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:24.509729 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2865a65a-230e-4db1-98b9-20cceecf69a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:24.510629 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2865a65a-230e-4db1-98b9-20cceecf69a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:24.510908 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2865a65a-230e-4db1-98b9-20cceecf69a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:24.511181 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2865a65a-230e-4db1-98b9-20cceecf69a2 admin admin] PATH_INFO: `/v3/projects/45d8b3859d924fcaa318f72b91799462` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:24.512364 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2865a65a-230e-4db1-98b9-20cceecf69a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=45d8b3859d924fcaa318f72b91799462)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:24.515242 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2865a65a-230e-4db1-98b9-20cceecf69a2 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:24.556713 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:23:24.576101 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-2865a65a-230e-4db1-98b9-20cceecf69a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45d8b3859d924fcaa318f72b91799462', 'request_id': 'req-2865a65a-230e-4db1-98b9-20cceecf69a2'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:24.582649 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-2865a65a-230e-4db1-98b9-20cceecf69a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45d8b3859d924fcaa318f72b91799462', 'request_id': 'req-2865a65a-230e-4db1-98b9-20cceecf69a2'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:24.588700 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-2865a65a-230e-4db1-98b9-20cceecf69a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45d8b3859d924fcaa318f72b91799462', 'request_id': 'req-2865a65a-230e-4db1-98b9-20cceecf69a2'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:24.603123 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-2865a65a-230e-4db1-98b9-20cceecf69a2 admin admin] The token cache is being invalidate because project 45d8b3859d924fcaa318f72b91799462 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:23:24.603411 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-2865a65a-230e-4db1-98b9-20cceecf69a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:24.604062 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-2865a65a-230e-4db1-98b9-20cceecf69a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:24.605544 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1410/2801] 10.222.0.43 () {58 vars in 1232 bytes} [Wed Jun 22 10:23:24 2022] DELETE /identity/v3/projects/45d8b3859d924fcaa318f72b91799462 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:23:24.610796 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7817e4-303a-4401-8d02-6f91aa1de7e6 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:24.610993 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7817e4-303a-4401-8d02-6f91aa1de7e6 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:24.611277 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7817e4-303a-4401-8d02-6f91aa1de7e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:24.630501 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-8a7817e4-303a-4401-8d02-6f91aa1de7e6 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:23:24.631811 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-8a7817e4-303a-4401-8d02-6f91aa1de7e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:23:24.695167 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1392/2802] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:23:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:23:24.758190 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5322cf3d-71f8-496d-88e4-796a7df9f50c None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:24.758474 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5322cf3d-71f8-496d-88e4-796a7df9f50c None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:24.758754 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5322cf3d-71f8-496d-88e4-796a7df9f50c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:24.780081 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-5322cf3d-71f8-496d-88e4-796a7df9f50c None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:23:24.781872 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-5322cf3d-71f8-496d-88e4-796a7df9f50c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:23:24.790885 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1411/2803] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:23:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:23:24.795424 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7817e4-303a-4401-8d02-6f91aa1de7e6 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:24.805962 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7817e4-303a-4401-8d02-6f91aa1de7e6 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:24.812060 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2f5b38-d2c0-41ec-8636-31ca8a8dce8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:24.812734 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2f5b38-d2c0-41ec-8636-31ca8a8dce8d admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:24.813024 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2f5b38-d2c0-41ec-8636-31ca8a8dce8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:24.813302 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2f5b38-d2c0-41ec-8636-31ca8a8dce8d admin admin] PATH_INFO: `/v3/domains` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:24.814073 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2f5b38-d2c0-41ec-8636-31ca8a8dce8d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:23:24.814384 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2f5b38-d2c0-41ec-8636-31ca8a8dce8d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:24.815993 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2f5b38-d2c0-41ec-8636-31ca8a8dce8d admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:24.829644 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1393/2804] 10.222.0.43 () {58 vars in 1152 bytes} [Wed Jun 22 10:23:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:23:24.833939 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5322cf3d-71f8-496d-88e4-796a7df9f50c None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:24.843745 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5322cf3d-71f8-496d-88e4-796a7df9f50c None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:24.849652 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e25178-a74d-4e13-8354-378e95e955e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:24.850457 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e25178-a74d-4e13-8354-378e95e955e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:24.850836 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e25178-a74d-4e13-8354-378e95e955e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:24.851425 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e25178-a74d-4e13-8354-378e95e955e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:24.852292 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e25178-a74d-4e13-8354-378e95e955e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:24.854322 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e25178-a74d-4e13-8354-378e95e955e2 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:24.890230 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1412/2805] 10.222.0.43 () {60 vars in 1152 bytes} [Wed Jun 22 10:23:24 2022] POST /identity/v3/projects => generated 373 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 10:23:24.896485 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2f5b38-d2c0-41ec-8636-31ca8a8dce8d admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:24.909173 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2f5b38-d2c0-41ec-8636-31ca8a8dce8d admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:24.964977 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:23:24.984751 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118025ed-e946-48de-9c13-a1e14f29bf52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:24.985439 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118025ed-e946-48de-9c13-a1e14f29bf52 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:24.985774 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118025ed-e946-48de-9c13-a1e14f29bf52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:24.986063 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118025ed-e946-48de-9c13-a1e14f29bf52 admin admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:24.986760 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118025ed-e946-48de-9c13-a1e14f29bf52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:24.988701 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118025ed-e946-48de-9c13-a1e14f29bf52 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:25.009492 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1394/2806] 10.222.0.43 () {60 vars in 1143 bytes} [Wed Jun 22 10:23:24 2022] POST /identity/v3/users => generated 287 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:23:25.013664 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e25178-a74d-4e13-8354-378e95e955e2 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:25.024307 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e25178-a74d-4e13-8354-378e95e955e2 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:25.028756 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb486bc4-37e8-46a9-9458-91bb5a3f69bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:25.029406 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb486bc4-37e8-46a9-9458-91bb5a3f69bf admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:25.029774 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb486bc4-37e8-46a9-9458-91bb5a3f69bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:25.030054 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb486bc4-37e8-46a9-9458-91bb5a3f69bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:25.030775 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb486bc4-37e8-46a9-9458-91bb5a3f69bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:25.032381 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb486bc4-37e8-46a9-9458-91bb5a3f69bf admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:25.042652 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1413/2807] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:23:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:23:25.047302 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118025ed-e946-48de-9c13-a1e14f29bf52 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:25.057231 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118025ed-e946-48de-9c13-a1e14f29bf52 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:25.062547 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cd3e82-6a3b-4e08-9649-a28e6b32fd30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:25.063212 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cd3e82-6a3b-4e08-9649-a28e6b32fd30 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:25.063503 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cd3e82-6a3b-4e08-9649-a28e6b32fd30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:25.063811 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cd3e82-6a3b-4e08-9649-a28e6b32fd30 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:25.064771 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cd3e82-6a3b-4e08-9649-a28e6b32fd30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:25.066463 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cd3e82-6a3b-4e08-9649-a28e6b32fd30 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:25.078602 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1395/2808] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:23:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:23:25.080580 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb486bc4-37e8-46a9-9458-91bb5a3f69bf admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:25.090387 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb486bc4-37e8-46a9-9458-91bb5a3f69bf admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:25.095227 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db351de-9c9c-4a65-99ae-bb3d577a1654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:25.096104 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db351de-9c9c-4a65-99ae-bb3d577a1654 admin admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:25.096386 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db351de-9c9c-4a65-99ae-bb3d577a1654 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:25.096662 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db351de-9c9c-4a65-99ae-bb3d577a1654 admin admin] PATH_INFO: `/v3/projects/aa9a1da5cb5a4279abb88ec7bdb1ef6b/users/d6428e56cd9b46feb6a7b04e4d00c162/roles/9f88c83743f745a9a785a2f454753f06` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:25.112775 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db351de-9c9c-4a65-99ae-bb3d577a1654 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa9a1da5cb5a4279abb88ec7bdb1ef6b, user_id=d6428e56cd9b46feb6a7b04e4d00c162, role_id=9f88c83743f745a9a785a2f454753f06)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:25.115502 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db351de-9c9c-4a65-99ae-bb3d577a1654 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:25.129190 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1414/2809] 10.222.0.43 () {60 vars in 1482 bytes} [Wed Jun 22 10:23:25 2022] PUT /identity/v3/projects/aa9a1da5cb5a4279abb88ec7bdb1ef6b/users/d6428e56cd9b46feb6a7b04e4d00c162/roles/9f88c83743f745a9a785a2f454753f06 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:23:25.134332 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d6e853-96b4-48c8-9c2d-c12713495a45 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:25.134629 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d6e853-96b4-48c8-9c2d-c12713495a45 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:25.134917 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d6e853-96b4-48c8-9c2d-c12713495a45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:25.152411 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-a3d6e853-96b4-48c8-9c2d-c12713495a45 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:23:25.153607 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-a3d6e853-96b4-48c8-9c2d-c12713495a45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:23:25.214603 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1396/2810] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:23:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:23:25.224618 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db351de-9c9c-4a65-99ae-bb3d577a1654 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:25.226655 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-2db351de-9c9c-4a65-99ae-bb3d577a1654 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:23:25.286785 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db351de-9c9c-4a65-99ae-bb3d577a1654 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:25.290343 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a14e289-50ea-4652-9330-a256aae55a3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe93d4c0737249fd8623bb5ce188e34e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:25.290981 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a14e289-50ea-4652-9330-a256aae55a3e service neutron] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:25.291286 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a14e289-50ea-4652-9330-a256aae55a3e service neutron] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:25.291563 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a14e289-50ea-4652-9330-a256aae55a3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:25.300335 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a14e289-50ea-4652-9330-a256aae55a3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:25.301791 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a14e289-50ea-4652-9330-a256aae55a3e service neutron] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:25.311050 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1415/2811] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:23:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:23:29.504902 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd7fdf5-4cc5-41ed-acdf-d02ab6cd384e None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:29.505438 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd7fdf5-4cc5-41ed-acdf-d02ab6cd384e None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:29.505854 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd7fdf5-4cc5-41ed-acdf-d02ab6cd384e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:29.542266 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-edd7fdf5-4cc5-41ed-acdf-d02ab6cd384e None None] MFA Rules not processed for user `d6428e56cd9b46feb6a7b04e4d00c162`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:23:29.543681 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-edd7fdf5-4cc5-41ed-acdf-d02ab6cd384e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:23:29.626429 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1397/2812] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:23:29 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:23:29.630686 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a14e289-50ea-4652-9330-a256aae55a3e service neutron] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:29.643080 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a14e289-50ea-4652-9330-a256aae55a3e service neutron] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:29.648041 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b939473-f9e5-4075-876b-baa104136ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:29.648797 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b939473-f9e5-4075-876b-baa104136ecd admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:29.649089 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b939473-f9e5-4075-876b-baa104136ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:29.649370 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b939473-f9e5-4075-876b-baa104136ecd admin admin] PATH_INFO: `/v3/projects` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:29.650396 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b939473-f9e5-4075-876b-baa104136ecd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:29.653223 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b939473-f9e5-4075-876b-baa104136ecd admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:29.693281 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1416/2813] 10.222.0.43 () {60 vars in 1152 bytes} [Wed Jun 22 10:23:29 2022] POST /identity/v3/projects => generated 373 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 10:23:29.694603 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd7fdf5-4cc5-41ed-acdf-d02ab6cd384e None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:29.708957 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd7fdf5-4cc5-41ed-acdf-d02ab6cd384e None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:29.779367 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:23:29.799656 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9975e4-a861-4d51-adc3-0216477e5898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:29.800374 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9975e4-a861-4d51-adc3-0216477e5898 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:29.800694 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9975e4-a861-4d51-adc3-0216477e5898 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:29.800975 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9975e4-a861-4d51-adc3-0216477e5898 admin admin] PATH_INFO: `/v3/users` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:29.801697 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9975e4-a861-4d51-adc3-0216477e5898 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:29.803729 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9975e4-a861-4d51-adc3-0216477e5898 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:29.828454 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1398/2814] 10.222.0.43 () {60 vars in 1143 bytes} [Wed Jun 22 10:23:29 2022] POST /identity/v3/users => generated 293 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:23:29.832481 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b939473-f9e5-4075-876b-baa104136ecd admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:29.844733 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b939473-f9e5-4075-876b-baa104136ecd admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:29.849958 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f831e65a-f86b-4bd7-8482-ad35dd4cb48d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:29.850827 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f831e65a-f86b-4bd7-8482-ad35dd4cb48d admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:29.851435 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f831e65a-f86b-4bd7-8482-ad35dd4cb48d admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:29.851794 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f831e65a-f86b-4bd7-8482-ad35dd4cb48d admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:29.852608 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f831e65a-f86b-4bd7-8482-ad35dd4cb48d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:29.854366 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f831e65a-f86b-4bd7-8482-ad35dd4cb48d admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:29.867196 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1417/2815] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:23:29 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:23:29.871390 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9975e4-a861-4d51-adc3-0216477e5898 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:29.885299 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9975e4-a861-4d51-adc3-0216477e5898 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:29.891252 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc23a9c-0a29-4652-8daa-5701fb8df92a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:29.892437 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc23a9c-0a29-4652-8daa-5701fb8df92a admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:29.892808 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc23a9c-0a29-4652-8daa-5701fb8df92a admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:29.893183 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc23a9c-0a29-4652-8daa-5701fb8df92a admin admin] PATH_INFO: `/v3/projects/075b1eca291346f7926e033f55b31878/users/51dd4cc38b6040428a010170dd2ce071/roles/26d9c2ab5dfc4e6d9ca80c6014123906` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:29.911242 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc23a9c-0a29-4652-8daa-5701fb8df92a admin admin] RBAC: Authorizing `identity:create_grant(project_id=075b1eca291346f7926e033f55b31878, user_id=51dd4cc38b6040428a010170dd2ce071, role_id=26d9c2ab5dfc4e6d9ca80c6014123906)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:29.914083 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc23a9c-0a29-4652-8daa-5701fb8df92a admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:29.930445 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1399/2816] 10.222.0.43 () {60 vars in 1482 bytes} [Wed Jun 22 10:23:29 2022] PUT /identity/v3/projects/075b1eca291346f7926e033f55b31878/users/51dd4cc38b6040428a010170dd2ce071/roles/26d9c2ab5dfc4e6d9ca80c6014123906 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:23:29.934181 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f831e65a-f86b-4bd7-8482-ad35dd4cb48d admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:29.948470 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f831e65a-f86b-4bd7-8482-ad35dd4cb48d admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:29.973618 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:23:30.025554 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e705fa8a-504d-420a-93e8-5954148d6c5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:30.026305 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e705fa8a-504d-420a-93e8-5954148d6c5a admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:30.026598 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e705fa8a-504d-420a-93e8-5954148d6c5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:30.026884 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e705fa8a-504d-420a-93e8-5954148d6c5a admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:30.027640 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e705fa8a-504d-420a-93e8-5954148d6c5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:30.029948 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e705fa8a-504d-420a-93e8-5954148d6c5a admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:30.042628 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1418/2817] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:23:29 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:23:30.046874 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc23a9c-0a29-4652-8daa-5701fb8df92a admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:30.057620 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc23a9c-0a29-4652-8daa-5701fb8df92a admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:30.063086 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df5a1a3-677f-4180-9f22-583cf47b2d4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:30.064076 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df5a1a3-677f-4180-9f22-583cf47b2d4f admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:30.064431 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df5a1a3-677f-4180-9f22-583cf47b2d4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:30.064806 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df5a1a3-677f-4180-9f22-583cf47b2d4f admin admin] PATH_INFO: `/v3/projects/075b1eca291346f7926e033f55b31878/users/51dd4cc38b6040428a010170dd2ce071/roles/26d9c2ab5dfc4e6d9ca80c6014123906` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:30.067228 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df5a1a3-677f-4180-9f22-583cf47b2d4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=075b1eca291346f7926e033f55b31878, user_id=51dd4cc38b6040428a010170dd2ce071, role_id=26d9c2ab5dfc4e6d9ca80c6014123906)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:30.070496 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df5a1a3-677f-4180-9f22-583cf47b2d4f admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:30.083466 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1400/2818] 10.222.0.43 () {60 vars in 1482 bytes} [Wed Jun 22 10:23:30 2022] PUT /identity/v3/projects/075b1eca291346f7926e033f55b31878/users/51dd4cc38b6040428a010170dd2ce071/roles/26d9c2ab5dfc4e6d9ca80c6014123906 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:23:34.655585 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e5262e-8486-4d7e-9cce-c53bca351719 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:34.656058 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e5262e-8486-4d7e-9cce-c53bca351719 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:34.656154 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e5262e-8486-4d7e-9cce-c53bca351719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:34.717174 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-61e5262e-8486-4d7e-9cce-c53bca351719 None None] MFA Rules not processed for user `51dd4cc38b6040428a010170dd2ce071`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:23:34.719903 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-61e5262e-8486-4d7e-9cce-c53bca351719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:23:34.862189 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1419/2819] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:23:34 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:23:34.879494 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df5a1a3-677f-4180-9f22-583cf47b2d4f admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:34.881192 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-7df5a1a3-677f-4180-9f22-583cf47b2d4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:23:34.981514 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df5a1a3-677f-4180-9f22-583cf47b2d4f admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:34.989824 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beafded-37d3-4a6b-b1bf-00b77e2b3fa4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '158a49aa3750478a84bf71b9aad24397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:34.990515 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beafded-37d3-4a6b-b1bf-00b77e2b3fa4 service nova] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:34.990803 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beafded-37d3-4a6b-b1bf-00b77e2b3fa4 service nova] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:34.991086 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beafded-37d3-4a6b-b1bf-00b77e2b3fa4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:35.073858 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2beafded-37d3-4a6b-b1bf-00b77e2b3fa4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:35.077084 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2beafded-37d3-4a6b-b1bf-00b77e2b3fa4 service nova] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:35.094345 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1401/2820] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:23:34 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:23:36.139315 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0b5467-0f51-4050-a702-e94be0fb499a None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:36.139855 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0b5467-0f51-4050-a702-e94be0fb499a None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:36.139855 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0b5467-0f51-4050-a702-e94be0fb499a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:36.160870 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-6e0b5467-0f51-4050-a702-e94be0fb499a None None] MFA Rules not processed for user `d6428e56cd9b46feb6a7b04e4d00c162`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:23:36.162107 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-6e0b5467-0f51-4050-a702-e94be0fb499a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:23:36.169383 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1420/2821] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:23:36 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:23:40.904094 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beafded-37d3-4a6b-b1bf-00b77e2b3fa4 service nova] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:40.906291 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-2beafded-37d3-4a6b-b1bf-00b77e2b3fa4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:23:40.964829 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:23:40.996364 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beafded-37d3-4a6b-b1bf-00b77e2b3fa4 service nova] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:41.001290 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2f4ece-8375-406e-ab35-cd8acc298c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:41.002205 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2f4ece-8375-406e-ab35-cd8acc298c32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:41.002493 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2f4ece-8375-406e-ab35-cd8acc298c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:41.002778 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2f4ece-8375-406e-ab35-cd8acc298c32 admin admin] PATH_INFO: `/v3/users/a390b7507e8347e2bd301b0e7a089a03` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:41.004011 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2f4ece-8375-406e-ab35-cd8acc298c32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a390b7507e8347e2bd301b0e7a089a03)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:41.005981 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2f4ece-8375-406e-ab35-cd8acc298c32 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:41.056483 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-fc2f4ece-8375-406e-ab35-cd8acc298c32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a390b7507e8347e2bd301b0e7a089a03'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:41.069719 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-fc2f4ece-8375-406e-ab35-cd8acc298c32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a390b7507e8347e2bd301b0e7a089a03'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:41.077565 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-fc2f4ece-8375-406e-ab35-cd8acc298c32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a390b7507e8347e2bd301b0e7a089a03'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:41.078236 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-fc2f4ece-8375-406e-ab35-cd8acc298c32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a390b7507e8347e2bd301b0e7a089a03'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:41.086193 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-fc2f4ece-8375-406e-ab35-cd8acc298c32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a390b7507e8347e2bd301b0e7a089a03'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:41.096283 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1402/2822] 10.222.0.43 () {58 vars in 1223 bytes} [Wed Jun 22 10:23:40 2022] DELETE /identity/v3/users/a390b7507e8347e2bd301b0e7a089a03 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:23:41.100777 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c12401-6d42-46ff-bb3e-450629518581 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:41.101518 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c12401-6d42-46ff-bb3e-450629518581 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:41.101618 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c12401-6d42-46ff-bb3e-450629518581 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:41.122755 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-38c12401-6d42-46ff-bb3e-450629518581 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:23:41.124551 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-38c12401-6d42-46ff-bb3e-450629518581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:23:41.185158 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1421/2823] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:23:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:23:41.195028 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2f4ece-8375-406e-ab35-cd8acc298c32 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:41.196508 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-fc2f4ece-8375-406e-ab35-cd8acc298c32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:23:41.260900 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2f4ece-8375-406e-ab35-cd8acc298c32 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:41.265086 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be4eb54-5ba9-4884-af3e-0a2b8747f56a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe93d4c0737249fd8623bb5ce188e34e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:41.265833 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be4eb54-5ba9-4884-af3e-0a2b8747f56a service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:41.266107 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be4eb54-5ba9-4884-af3e-0a2b8747f56a service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:41.266391 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be4eb54-5ba9-4884-af3e-0a2b8747f56a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:41.276985 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be4eb54-5ba9-4884-af3e-0a2b8747f56a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:41.278610 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be4eb54-5ba9-4884-af3e-0a2b8747f56a service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:41.289827 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1403/2824] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:23:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:23:41.568317 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c12401-6d42-46ff-bb3e-450629518581 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:41.569790 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-38c12401-6d42-46ff-bb3e-450629518581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:23:41.582602 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c12401-6d42-46ff-bb3e-450629518581 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:41.588096 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32f87ba-7357-46c0-b831-ff03902f8c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:41.588974 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32f87ba-7357-46c0-b831-ff03902f8c13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:41.589256 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32f87ba-7357-46c0-b831-ff03902f8c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:41.589638 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32f87ba-7357-46c0-b831-ff03902f8c13 admin admin] PATH_INFO: `/v3/projects/c607f48c2a624e21b0e72b5d6075b43d` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:41.591073 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32f87ba-7357-46c0-b831-ff03902f8c13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c607f48c2a624e21b0e72b5d6075b43d)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:41.594307 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32f87ba-7357-46c0-b831-ff03902f8c13 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:41.633590 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:23:41.647023 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-f32f87ba-7357-46c0-b831-ff03902f8c13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c607f48c2a624e21b0e72b5d6075b43d', 'request_id': 'req-f32f87ba-7357-46c0-b831-ff03902f8c13'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:41.653533 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-f32f87ba-7357-46c0-b831-ff03902f8c13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c607f48c2a624e21b0e72b5d6075b43d', 'request_id': 'req-f32f87ba-7357-46c0-b831-ff03902f8c13'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:41.661147 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-f32f87ba-7357-46c0-b831-ff03902f8c13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c607f48c2a624e21b0e72b5d6075b43d', 'request_id': 'req-f32f87ba-7357-46c0-b831-ff03902f8c13'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:41.674320 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-f32f87ba-7357-46c0-b831-ff03902f8c13 admin admin] The token cache is being invalidate because project c607f48c2a624e21b0e72b5d6075b43d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:23:41.674612 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-f32f87ba-7357-46c0-b831-ff03902f8c13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:41.675253 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-f32f87ba-7357-46c0-b831-ff03902f8c13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:23:41.676813 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1422/2825] 10.222.0.43 () {58 vars in 1232 bytes} [Wed Jun 22 10:23:41 2022] DELETE /identity/v3/projects/c607f48c2a624e21b0e72b5d6075b43d => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:23:51.285168 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=61,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:23:51.671343 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=12,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:23:51.859063 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be4eb54-5ba9-4884-af3e-0a2b8747f56a service neutron] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:23:51.860449 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-5be4eb54-5ba9-4884-af3e-0a2b8747f56a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:23:51.935544 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be4eb54-5ba9-4884-af3e-0a2b8747f56a service neutron] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:23:51.998822 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61c2f0a-8f7f-4abd-a98a-046ac63c6af7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '341ec95408c94dae8539ccff7225e3ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:23:52.000218 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61c2f0a-8f7f-4abd-a98a-046ac63c6af7 service placement] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:23:52.000508 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61c2f0a-8f7f-4abd-a98a-046ac63c6af7 service placement] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:23:52.000789 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61c2f0a-8f7f-4abd-a98a-046ac63c6af7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:23:52.002606 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-a61c2f0a-8f7f-4abd-a98a-046ac63c6af7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:23:52.014249 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61c2f0a-8f7f-4abd-a98a-046ac63c6af7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:23:52.016098 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61c2f0a-8f7f-4abd-a98a-046ac63c6af7 service placement] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:23:52.026329 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1404/2826] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:23:51 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:24:02.021966 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=58 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:24:04.770640 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32f87ba-7357-46c0-b831-ff03902f8c13 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:24:04.772089 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-f32f87ba-7357-46c0-b831-ff03902f8c13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:24:04.836402 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32f87ba-7357-46c0-b831-ff03902f8c13 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:24:04.840954 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776a9820-30d5-42c2-869a-71af1415834e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:24:04.841859 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776a9820-30d5-42c2-869a-71af1415834e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:24:04.842144 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776a9820-30d5-42c2-869a-71af1415834e admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:24:04.842421 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776a9820-30d5-42c2-869a-71af1415834e admin admin] PATH_INFO: `/v3/users/1a7d198b5c0346d0b1328cc781fb8893` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:24:04.843622 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776a9820-30d5-42c2-869a-71af1415834e admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a7d198b5c0346d0b1328cc781fb8893)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:24:04.846219 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776a9820-30d5-42c2-869a-71af1415834e admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:24:04.891598 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-776a9820-30d5-42c2-869a-71af1415834e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a7d198b5c0346d0b1328cc781fb8893'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:24:04.903274 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-776a9820-30d5-42c2-869a-71af1415834e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a7d198b5c0346d0b1328cc781fb8893'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:24:04.911415 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-776a9820-30d5-42c2-869a-71af1415834e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a7d198b5c0346d0b1328cc781fb8893'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:24:04.919500 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-776a9820-30d5-42c2-869a-71af1415834e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a7d198b5c0346d0b1328cc781fb8893'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:24:04.920144 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-776a9820-30d5-42c2-869a-71af1415834e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a7d198b5c0346d0b1328cc781fb8893'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:24:04.926608 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1423/2827] 10.222.0.43 () {58 vars in 1223 bytes} [Wed Jun 22 10:24:04 2022] DELETE /identity/v3/users/1a7d198b5c0346d0b1328cc781fb8893 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:24:04.931066 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f03e739-4f0d-45d1-b091-49e6a57eeaea None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:24:04.931528 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f03e739-4f0d-45d1-b091-49e6a57eeaea None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:24:04.931645 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f03e739-4f0d-45d1-b091-49e6a57eeaea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:24:04.950262 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-1f03e739-4f0d-45d1-b091-49e6a57eeaea None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:24:04.951480 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-1f03e739-4f0d-45d1-b091-49e6a57eeaea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:24:05.013853 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1405/2828] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:24:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:24:05.024301 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776a9820-30d5-42c2-869a-71af1415834e admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:24:05.025710 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-776a9820-30d5-42c2-869a-71af1415834e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:24:05.084976 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776a9820-30d5-42c2-869a-71af1415834e admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:24:05.088637 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf14c15-d13a-4ca9-bd39-a7efd308d0cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe93d4c0737249fd8623bb5ce188e34e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:24:05.089296 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf14c15-d13a-4ca9-bd39-a7efd308d0cb service neutron] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:24:05.089581 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf14c15-d13a-4ca9-bd39-a7efd308d0cb service neutron] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:24:05.089887 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf14c15-d13a-4ca9-bd39-a7efd308d0cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:24:05.100978 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf14c15-d13a-4ca9-bd39-a7efd308d0cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:24:05.102470 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf14c15-d13a-4ca9-bd39-a7efd308d0cb service neutron] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:24:05.112274 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1424/2829] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:24:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:24:05.387055 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f03e739-4f0d-45d1-b091-49e6a57eeaea None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:24:05.388613 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-1f03e739-4f0d-45d1-b091-49e6a57eeaea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:24:05.402329 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f03e739-4f0d-45d1-b091-49e6a57eeaea None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:24:05.407567 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5521e0d2-29f6-4451-bc2d-ad428fd10f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:24:05.408667 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5521e0d2-29f6-4451-bc2d-ad428fd10f5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:24:05.409661 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5521e0d2-29f6-4451-bc2d-ad428fd10f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:24:05.410305 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5521e0d2-29f6-4451-bc2d-ad428fd10f5b admin admin] PATH_INFO: `/v3/projects/6d53c5c733bf45aea23c6cb46cf3a155` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:24:05.411615 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5521e0d2-29f6-4451-bc2d-ad428fd10f5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d53c5c733bf45aea23c6cb46cf3a155)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:24:05.413501 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5521e0d2-29f6-4451-bc2d-ad428fd10f5b admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:24:05.461915 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-5521e0d2-29f6-4451-bc2d-ad428fd10f5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d53c5c733bf45aea23c6cb46cf3a155', 'request_id': 'req-5521e0d2-29f6-4451-bc2d-ad428fd10f5b'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:24:05.467587 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-5521e0d2-29f6-4451-bc2d-ad428fd10f5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d53c5c733bf45aea23c6cb46cf3a155', 'request_id': 'req-5521e0d2-29f6-4451-bc2d-ad428fd10f5b'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:24:05.475990 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-5521e0d2-29f6-4451-bc2d-ad428fd10f5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d53c5c733bf45aea23c6cb46cf3a155', 'request_id': 'req-5521e0d2-29f6-4451-bc2d-ad428fd10f5b'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:24:05.486845 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-5521e0d2-29f6-4451-bc2d-ad428fd10f5b admin admin] The token cache is being invalidate because project 6d53c5c733bf45aea23c6cb46cf3a155 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:24:05.487167 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-5521e0d2-29f6-4451-bc2d-ad428fd10f5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:24:05.487799 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-5521e0d2-29f6-4451-bc2d-ad428fd10f5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:24:05.489378 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1406/2830] 10.222.0.43 () {58 vars in 1232 bytes} [Wed Jun 22 10:24:05 2022] DELETE /identity/v3/projects/6d53c5c733bf45aea23c6cb46cf3a155 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:24:05.494350 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eef500-2f26-4907-841f-4be04a5ca501 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:24:05.494714 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eef500-2f26-4907-841f-4be04a5ca501 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:24:05.495005 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eef500-2f26-4907-841f-4be04a5ca501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:24:05.513033 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-29eef500-2f26-4907-841f-4be04a5ca501 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:24:05.514336 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-29eef500-2f26-4907-841f-4be04a5ca501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:24:05.532702 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:24:05.587376 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1425/2831] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:24:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:24:05.642824 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30775274-3861-4851-b7d2-995b7c92c143 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:24:05.643123 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30775274-3861-4851-b7d2-995b7c92c143 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:24:05.643413 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30775274-3861-4851-b7d2-995b7c92c143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:24:05.662563 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-30775274-3861-4851-b7d2-995b7c92c143 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:24:05.663841 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-30775274-3861-4851-b7d2-995b7c92c143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:24:05.674262 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1407/2832] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:24:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:24:05.679976 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eef500-2f26-4907-841f-4be04a5ca501 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:24:05.690420 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eef500-2f26-4907-841f-4be04a5ca501 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:24:05.694967 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabe6efb-ed17-4f5c-b4ed-26978081283d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:24:05.695614 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabe6efb-ed17-4f5c-b4ed-26978081283d admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:24:05.695899 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabe6efb-ed17-4f5c-b4ed-26978081283d admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:24:05.696176 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabe6efb-ed17-4f5c-b4ed-26978081283d admin admin] PATH_INFO: `/v3/domains` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:24:05.696918 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabe6efb-ed17-4f5c-b4ed-26978081283d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:24:05.697230 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabe6efb-ed17-4f5c-b4ed-26978081283d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:24:05.698856 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabe6efb-ed17-4f5c-b4ed-26978081283d admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:24:05.711476 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1426/2833] 10.222.0.43 () {58 vars in 1152 bytes} [Wed Jun 22 10:24:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:24:05.716748 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30775274-3861-4851-b7d2-995b7c92c143 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:24:05.727264 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30775274-3861-4851-b7d2-995b7c92c143 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:24:05.732102 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28430363-9ce1-4cb2-86e5-b12c05c55d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:24:05.732772 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28430363-9ce1-4cb2-86e5-b12c05c55d22 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:24:05.733058 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28430363-9ce1-4cb2-86e5-b12c05c55d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:24:05.733335 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28430363-9ce1-4cb2-86e5-b12c05c55d22 admin admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:24:05.734063 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28430363-9ce1-4cb2-86e5-b12c05c55d22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:24:05.737122 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28430363-9ce1-4cb2-86e5-b12c05c55d22 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:24:05.764257 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1408/2834] 10.222.0.43 () {60 vars in 1152 bytes} [Wed Jun 22 10:24:05 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:24:05.768463 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabe6efb-ed17-4f5c-b4ed-26978081283d admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:24:05.778455 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabe6efb-ed17-4f5c-b4ed-26978081283d admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:24:05.834356 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f446a524-ad47-4b38-8c64-b34213bc4be5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:24:05.835017 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f446a524-ad47-4b38-8c64-b34213bc4be5 admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:24:05.835298 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f446a524-ad47-4b38-8c64-b34213bc4be5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:24:05.835574 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f446a524-ad47-4b38-8c64-b34213bc4be5 admin admin] PATH_INFO: `/v3/users` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:24:05.836252 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f446a524-ad47-4b38-8c64-b34213bc4be5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:24:05.838195 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f446a524-ad47-4b38-8c64-b34213bc4be5 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:24:05.859220 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1427/2835] 10.222.0.43 () {60 vars in 1143 bytes} [Wed Jun 22 10:24:05 2022] POST /identity/v3/users => generated 292 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:24:05.864233 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28430363-9ce1-4cb2-86e5-b12c05c55d22 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:24:05.874512 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28430363-9ce1-4cb2-86e5-b12c05c55d22 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:24:05.879317 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1d58c1-017a-41d0-a49c-ac64022d7ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:24:05.879978 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1d58c1-017a-41d0-a49c-ac64022d7ff3 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:24:05.880268 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1d58c1-017a-41d0-a49c-ac64022d7ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:24:05.880548 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1d58c1-017a-41d0-a49c-ac64022d7ff3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:24:05.881441 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1d58c1-017a-41d0-a49c-ac64022d7ff3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:24:05.883166 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1d58c1-017a-41d0-a49c-ac64022d7ff3 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:24:05.893925 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1409/2836] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:24:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:24:05.897531 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f446a524-ad47-4b38-8c64-b34213bc4be5 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:24:05.908351 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f446a524-ad47-4b38-8c64-b34213bc4be5 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:24:05.912831 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b12af5d-5bbd-4c5b-a433-11cb9e3466f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:24:05.913514 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b12af5d-5bbd-4c5b-a433-11cb9e3466f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:24:05.913837 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b12af5d-5bbd-4c5b-a433-11cb9e3466f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:24:05.914139 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b12af5d-5bbd-4c5b-a433-11cb9e3466f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:24:05.914951 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b12af5d-5bbd-4c5b-a433-11cb9e3466f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:24:05.916769 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b12af5d-5bbd-4c5b-a433-11cb9e3466f9 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:24:05.927545 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1428/2837] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:24:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:24:05.931777 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1d58c1-017a-41d0-a49c-ac64022d7ff3 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:24:05.942348 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1d58c1-017a-41d0-a49c-ac64022d7ff3 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:24:05.946872 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f87198e-1396-4378-8808-fbe97740293c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:24:05.947743 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f87198e-1396-4378-8808-fbe97740293c admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:24:05.948029 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f87198e-1396-4378-8808-fbe97740293c admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:24:05.948304 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f87198e-1396-4378-8808-fbe97740293c admin admin] PATH_INFO: `/v3/projects/60103a2f42f244e3af1d92a8a378fece/users/b402c2d3251a411a818b61b872dca060/roles/9f88c83743f745a9a785a2f454753f06` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:24:05.963701 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f87198e-1396-4378-8808-fbe97740293c admin admin] RBAC: Authorizing `identity:create_grant(project_id=60103a2f42f244e3af1d92a8a378fece, user_id=b402c2d3251a411a818b61b872dca060, role_id=9f88c83743f745a9a785a2f454753f06)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:24:05.966441 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f87198e-1396-4378-8808-fbe97740293c admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:24:05.981864 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1410/2838] 10.222.0.43 () {60 vars in 1482 bytes} [Wed Jun 22 10:24:05 2022] PUT /identity/v3/projects/60103a2f42f244e3af1d92a8a378fece/users/b402c2d3251a411a818b61b872dca060/roles/9f88c83743f745a9a785a2f454753f06 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:24:05.987006 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df302436-8f92-4f85-b357-2fd0b5ec48c9 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:24:05.987297 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df302436-8f92-4f85-b357-2fd0b5ec48c9 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:24:05.987576 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df302436-8f92-4f85-b357-2fd0b5ec48c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:24:06.006667 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-df302436-8f92-4f85-b357-2fd0b5ec48c9 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:24:06.007878 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-df302436-8f92-4f85-b357-2fd0b5ec48c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:24:06.069073 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1429/2839] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:24:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:24:06.078617 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f87198e-1396-4378-8808-fbe97740293c admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:24:06.080894 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-1f87198e-1396-4378-8808-fbe97740293c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:24:06.104837 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:24:06.142537 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f87198e-1396-4378-8808-fbe97740293c admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:24:06.146184 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43081448-031a-4aa9-a7cd-afa1145dbcef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe93d4c0737249fd8623bb5ce188e34e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:24:06.146831 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43081448-031a-4aa9-a7cd-afa1145dbcef service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:24:06.147117 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43081448-031a-4aa9-a7cd-afa1145dbcef service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:24:06.147400 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43081448-031a-4aa9-a7cd-afa1145dbcef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:24:06.156444 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43081448-031a-4aa9-a7cd-afa1145dbcef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:24:06.157913 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43081448-031a-4aa9-a7cd-afa1145dbcef service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:24:06.167325 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1411/2840] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:24:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:24:06.760882 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882b7e30-861b-4e96-9933-24494a4f4638 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:24:06.761175 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882b7e30-861b-4e96-9933-24494a4f4638 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:24:06.761456 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882b7e30-861b-4e96-9933-24494a4f4638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:24:06.793527 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-882b7e30-861b-4e96-9933-24494a4f4638 None None] MFA Rules not processed for user `b402c2d3251a411a818b61b872dca060`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:24:06.794794 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-882b7e30-861b-4e96-9933-24494a4f4638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:24:06.816359 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:24:06.882079 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1430/2841] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:24:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:24:06.893592 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43081448-031a-4aa9-a7cd-afa1145dbcef service neutron] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:24:06.895172 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-43081448-031a-4aa9-a7cd-afa1145dbcef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:24:06.959537 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43081448-031a-4aa9-a7cd-afa1145dbcef service neutron] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:24:06.963627 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe55b30-ca8c-4e8f-b4d1-8230101fb441 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bbcb3d4dc704dfdb0097abc594ca855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:24:06.964301 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe55b30-ca8c-4e8f-b4d1-8230101fb441 service cinder] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:24:06.964583 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe55b30-ca8c-4e8f-b4d1-8230101fb441 service cinder] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:24:06.964868 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe55b30-ca8c-4e8f-b4d1-8230101fb441 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:24:06.974180 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe55b30-ca8c-4e8f-b4d1-8230101fb441 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:24:06.976054 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe55b30-ca8c-4e8f-b4d1-8230101fb441 service cinder] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:24:06.986312 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1412/2842] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:24:06 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:24:08.359268 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f002d67-9918-4e5a-9e8f-bd5d6fe34e1d None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:24:08.359791 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f002d67-9918-4e5a-9e8f-bd5d6fe34e1d None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:24:08.359907 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f002d67-9918-4e5a-9e8f-bd5d6fe34e1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:24:08.378656 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-8f002d67-9918-4e5a-9e8f-bd5d6fe34e1d None None] MFA Rules not processed for user `b402c2d3251a411a818b61b872dca060`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:24:08.379869 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-8f002d67-9918-4e5a-9e8f-bd5d6fe34e1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:24:08.386847 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1431/2843] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:24:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:24:11.827749 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe55b30-ca8c-4e8f-b4d1-8230101fb441 service cinder] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:24:11.837999 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe55b30-ca8c-4e8f-b4d1-8230101fb441 service cinder] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:24:11.841611 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8941c8ed-0d76-45ba-94eb-eaa31ce7bb43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe93d4c0737249fd8623bb5ce188e34e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:24:11.842315 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8941c8ed-0d76-45ba-94eb-eaa31ce7bb43 service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:24:11.842610 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8941c8ed-0d76-45ba-94eb-eaa31ce7bb43 service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:24:11.842892 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8941c8ed-0d76-45ba-94eb-eaa31ce7bb43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:24:11.844692 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-8941c8ed-0d76-45ba-94eb-eaa31ce7bb43 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:24:11.912956 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8941c8ed-0d76-45ba-94eb-eaa31ce7bb43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:24:11.914502 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8941c8ed-0d76-45ba-94eb-eaa31ce7bb43 service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:24:11.926427 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1413/2844] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:24:11 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:24:13.969319 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f002d67-9918-4e5a-9e8f-bd5d6fe34e1d None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:24:13.972111 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-8f002d67-9918-4e5a-9e8f-bd5d6fe34e1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:24:14.059962 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f002d67-9918-4e5a-9e8f-bd5d6fe34e1d None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:24:14.067488 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2fd9df-8acb-4128-8b68-63b2174c13cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '158a49aa3750478a84bf71b9aad24397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:24:14.068374 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2fd9df-8acb-4128-8b68-63b2174c13cf service nova] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:24:14.068974 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2fd9df-8acb-4128-8b68-63b2174c13cf service nova] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:24:14.069375 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2fd9df-8acb-4128-8b68-63b2174c13cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:24:14.071397 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-2f2fd9df-8acb-4128-8b68-63b2174c13cf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:24:14.085460 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2fd9df-8acb-4128-8b68-63b2174c13cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:24:14.090912 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2fd9df-8acb-4128-8b68-63b2174c13cf service nova] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:24:14.103953 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1432/2845] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:24:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:24:21.921031 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=73 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:24:24.098318 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=56 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:24:45.608665 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8941c8ed-0d76-45ba-94eb-eaa31ce7bb43 service neutron] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:24:45.610104 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-8941c8ed-0d76-45ba-94eb-eaa31ce7bb43 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:24:45.624508 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8941c8ed-0d76-45ba-94eb-eaa31ce7bb43 service neutron] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:24:45.628942 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a27ee34-e385-4ac9-9aab-d5fed4d1e31d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bbcb3d4dc704dfdb0097abc594ca855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:24:45.629602 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a27ee34-e385-4ac9-9aab-d5fed4d1e31d service cinder] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:24:45.630005 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a27ee34-e385-4ac9-9aab-d5fed4d1e31d service cinder] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:24:45.630338 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a27ee34-e385-4ac9-9aab-d5fed4d1e31d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:24:45.632090 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-2a27ee34-e385-4ac9-9aab-d5fed4d1e31d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:24:45.694142 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a27ee34-e385-4ac9-9aab-d5fed4d1e31d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:24:45.695582 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a27ee34-e385-4ac9-9aab-d5fed4d1e31d service cinder] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:24:45.704715 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1414/2846] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:24:45 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:24:52.484225 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd684d2-2f98-43bb-b1c5-6df9d0b6fe55 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:24:52.484840 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd684d2-2f98-43bb-b1c5-6df9d0b6fe55 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:24:52.484840 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd684d2-2f98-43bb-b1c5-6df9d0b6fe55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:24:52.502503 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-efd684d2-2f98-43bb-b1c5-6df9d0b6fe55 None None] MFA Rules not processed for user `b2d3aa18a0a146808f584127411a1cf5`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:24:52.503700 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-efd684d2-2f98-43bb-b1c5-6df9d0b6fe55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:24:52.511096 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1433/2847] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:24:52 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:24:55.700579 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=28 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:25:02.497190 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=3 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:25:18.441513 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16f321b-72d9-4ffb-9bc1-e36722c47e97 None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:25:18.442069 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16f321b-72d9-4ffb-9bc1-e36722c47e97 None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:25:18.442177 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16f321b-72d9-4ffb-9bc1-e36722c47e97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:25:18.459571 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-e16f321b-72d9-4ffb-9bc1-e36722c47e97 None None] MFA Rules not processed for user `b402c2d3251a411a818b61b872dca060`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:25:18.460770 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-e16f321b-72d9-4ffb-9bc1-e36722c47e97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:25:18.468088 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1415/2848] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:25:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:25:28.454275 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=3 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:25:45.870113 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd684d2-2f98-43bb-b1c5-6df9d0b6fe55 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:25:45.880596 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd684d2-2f98-43bb-b1c5-6df9d0b6fe55 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:25:45.884850 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f28895-bd61-4541-915c-1eef8622e190 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bbcb3d4dc704dfdb0097abc594ca855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:25:45.885506 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f28895-bd61-4541-915c-1eef8622e190 service cinder] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:25:45.885816 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f28895-bd61-4541-915c-1eef8622e190 service cinder] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:25:45.886100 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f28895-bd61-4541-915c-1eef8622e190 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:25:45.887885 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-10f28895-bd61-4541-915c-1eef8622e190 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:25:45.907097 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f28895-bd61-4541-915c-1eef8622e190 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:25:45.908708 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f28895-bd61-4541-915c-1eef8622e190 service cinder] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:25:45.921572 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1434/2849] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:25:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:25:48.513017 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16f321b-72d9-4ffb-9bc1-e36722c47e97 None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:25:48.522903 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16f321b-72d9-4ffb-9bc1-e36722c47e97 None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:25:48.527224 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7cefb5-e0b3-47e8-b037-1011f31d499d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe93d4c0737249fd8623bb5ce188e34e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:25:48.527868 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7cefb5-e0b3-47e8-b037-1011f31d499d service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:25:48.528155 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7cefb5-e0b3-47e8-b037-1011f31d499d service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:25:48.528442 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7cefb5-e0b3-47e8-b037-1011f31d499d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:25:48.530227 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-af7cefb5-e0b3-47e8-b037-1011f31d499d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:25:48.544356 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7cefb5-e0b3-47e8-b037-1011f31d499d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:25:48.545802 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7cefb5-e0b3-47e8-b037-1011f31d499d service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:25:48.557009 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1416/2850] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:25:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:25:55.916195 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=6 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:25:58.551936 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=6 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:26:13.598517 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f28895-bd61-4541-915c-1eef8622e190 service cinder] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:26:13.610894 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f28895-bd61-4541-915c-1eef8622e190 service cinder] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:26:13.615498 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c929305-0b65-4c11-9e49-b6d2c64ac055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:26:13.616376 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c929305-0b65-4c11-9e49-b6d2c64ac055 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:26:13.616659 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c929305-0b65-4c11-9e49-b6d2c64ac055 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:26:13.616937 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c929305-0b65-4c11-9e49-b6d2c64ac055 admin admin] PATH_INFO: `/v3/users/b402c2d3251a411a818b61b872dca060` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:26:13.618149 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c929305-0b65-4c11-9e49-b6d2c64ac055 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b402c2d3251a411a818b61b872dca060)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:26:13.620425 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c929305-0b65-4c11-9e49-b6d2c64ac055 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:26:13.669359 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-6c929305-0b65-4c11-9e49-b6d2c64ac055 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b402c2d3251a411a818b61b872dca060'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:26:13.681050 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-6c929305-0b65-4c11-9e49-b6d2c64ac055 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b402c2d3251a411a818b61b872dca060'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:26:13.688942 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-6c929305-0b65-4c11-9e49-b6d2c64ac055 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b402c2d3251a411a818b61b872dca060'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:26:13.695833 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-6c929305-0b65-4c11-9e49-b6d2c64ac055 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b402c2d3251a411a818b61b872dca060'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:26:13.696526 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-6c929305-0b65-4c11-9e49-b6d2c64ac055 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b402c2d3251a411a818b61b872dca060'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:26:13.702382 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1435/2851] 10.222.0.43 () {58 vars in 1223 bytes} [Wed Jun 22 10:26:13 2022] DELETE /identity/v3/users/b402c2d3251a411a818b61b872dca060 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:26:13.877179 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7cefb5-e0b3-47e8-b037-1011f31d499d service neutron] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:26:13.888436 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7cefb5-e0b3-47e8-b037-1011f31d499d service neutron] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:26:13.948129 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932b7bf2-5108-4268-82f2-d66dfc10d963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:26:13.949006 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932b7bf2-5108-4268-82f2-d66dfc10d963 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:26:13.949290 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932b7bf2-5108-4268-82f2-d66dfc10d963 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:26:13.949589 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932b7bf2-5108-4268-82f2-d66dfc10d963 admin admin] PATH_INFO: `/v3/projects/60103a2f42f244e3af1d92a8a378fece` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:26:13.950805 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932b7bf2-5108-4268-82f2-d66dfc10d963 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60103a2f42f244e3af1d92a8a378fece)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:26:13.952750 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932b7bf2-5108-4268-82f2-d66dfc10d963 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:26:14.000011 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-932b7bf2-5108-4268-82f2-d66dfc10d963 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60103a2f42f244e3af1d92a8a378fece', 'request_id': 'req-932b7bf2-5108-4268-82f2-d66dfc10d963'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:26:14.005495 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-932b7bf2-5108-4268-82f2-d66dfc10d963 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60103a2f42f244e3af1d92a8a378fece', 'request_id': 'req-932b7bf2-5108-4268-82f2-d66dfc10d963'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:26:14.012699 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-932b7bf2-5108-4268-82f2-d66dfc10d963 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60103a2f42f244e3af1d92a8a378fece', 'request_id': 'req-932b7bf2-5108-4268-82f2-d66dfc10d963'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:26:14.023656 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-932b7bf2-5108-4268-82f2-d66dfc10d963 admin admin] The token cache is being invalidate because project 60103a2f42f244e3af1d92a8a378fece was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:26:14.023941 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-932b7bf2-5108-4268-82f2-d66dfc10d963 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:26:14.024590 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-932b7bf2-5108-4268-82f2-d66dfc10d963 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:26:14.026888 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1417/2852] 10.222.0.43 () {58 vars in 1232 bytes} [Wed Jun 22 10:26:13 2022] DELETE /identity/v3/projects/60103a2f42f244e3af1d92a8a378fece => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:26:14.031952 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f9fbed-b063-4b94-891e-05891fe38484 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:26:14.032250 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f9fbed-b063-4b94-891e-05891fe38484 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:26:14.032568 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f9fbed-b063-4b94-891e-05891fe38484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:26:14.050853 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-b5f9fbed-b063-4b94-891e-05891fe38484 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:26:14.052063 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-b5f9fbed-b063-4b94-891e-05891fe38484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:26:14.114228 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1436/2853] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:26:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:26:14.122225 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00a2b6a-5711-4661-9a5e-a60ca92d7a5f None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:26:14.122517 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00a2b6a-5711-4661-9a5e-a60ca92d7a5f None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:26:14.122798 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00a2b6a-5711-4661-9a5e-a60ca92d7a5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:26:14.141506 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-e00a2b6a-5711-4661-9a5e-a60ca92d7a5f None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:26:14.142728 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-e00a2b6a-5711-4661-9a5e-a60ca92d7a5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:26:14.150527 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1418/2854] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:26:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:26:14.155364 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f9fbed-b063-4b94-891e-05891fe38484 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:26:14.165040 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f9fbed-b063-4b94-891e-05891fe38484 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:26:14.170358 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53e9228-86ff-43f6-bb73-05be4f643987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:26:14.171078 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53e9228-86ff-43f6-bb73-05be4f643987 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:26:14.171369 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53e9228-86ff-43f6-bb73-05be4f643987 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:26:14.171650 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53e9228-86ff-43f6-bb73-05be4f643987 admin admin] PATH_INFO: `/v3/domains` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:26:14.172383 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53e9228-86ff-43f6-bb73-05be4f643987 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 10:26:14.172692 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53e9228-86ff-43f6-bb73-05be4f643987 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:26:14.174448 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53e9228-86ff-43f6-bb73-05be4f643987 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:26:14.186267 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1437/2855] 10.222.0.43 () {58 vars in 1152 bytes} [Wed Jun 22 10:26:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 10:26:14.190439 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00a2b6a-5711-4661-9a5e-a60ca92d7a5f None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:26:14.200646 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00a2b6a-5711-4661-9a5e-a60ca92d7a5f None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:26:14.205301 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59f5307-96a3-429f-8094-19f87d258479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:26:14.206006 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59f5307-96a3-429f-8094-19f87d258479 admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:26:14.206287 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59f5307-96a3-429f-8094-19f87d258479 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:26:14.206562 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59f5307-96a3-429f-8094-19f87d258479 admin admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:26:14.207258 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59f5307-96a3-429f-8094-19f87d258479 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:26:14.209184 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59f5307-96a3-429f-8094-19f87d258479 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:26:14.235724 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1419/2856] 10.222.0.43 () {60 vars in 1152 bytes} [Wed Jun 22 10:26:14 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:26:14.240608 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53e9228-86ff-43f6-bb73-05be4f643987 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:26:14.250732 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53e9228-86ff-43f6-bb73-05be4f643987 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:26:14.306119 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea839c9-5584-4a9c-8259-742db3d129bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:26:14.307016 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea839c9-5584-4a9c-8259-742db3d129bb admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:26:14.307369 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea839c9-5584-4a9c-8259-742db3d129bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:26:14.307646 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea839c9-5584-4a9c-8259-742db3d129bb admin admin] PATH_INFO: `/v3/users` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:26:14.308334 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea839c9-5584-4a9c-8259-742db3d129bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:26:14.310271 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea839c9-5584-4a9c-8259-742db3d129bb admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:26:14.316743 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:26:14.332269 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1438/2857] 10.222.0.43 () {60 vars in 1143 bytes} [Wed Jun 22 10:26:14 2022] POST /identity/v3/users => generated 293 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 10:26:14.336392 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59f5307-96a3-429f-8094-19f87d258479 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:26:14.346851 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59f5307-96a3-429f-8094-19f87d258479 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:26:14.351669 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875c1d04-41ef-443f-a0de-34004775fe9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:26:14.352323 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875c1d04-41ef-443f-a0de-34004775fe9e admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:26:14.352607 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875c1d04-41ef-443f-a0de-34004775fe9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:26:14.352887 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875c1d04-41ef-443f-a0de-34004775fe9e admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:26:14.354344 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875c1d04-41ef-443f-a0de-34004775fe9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:26:14.356014 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875c1d04-41ef-443f-a0de-34004775fe9e admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:26:14.366341 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1420/2858] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:26:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:26:14.371152 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea839c9-5584-4a9c-8259-742db3d129bb admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:26:14.381447 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea839c9-5584-4a9c-8259-742db3d129bb admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:26:14.386705 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8745dc6d-f899-4d19-90d7-f1e361f50dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:26:14.387364 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8745dc6d-f899-4d19-90d7-f1e361f50dd0 admin admin] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:26:14.387654 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8745dc6d-f899-4d19-90d7-f1e361f50dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:26:14.387937 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8745dc6d-f899-4d19-90d7-f1e361f50dd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:26:14.388682 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8745dc6d-f899-4d19-90d7-f1e361f50dd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:26:14.390315 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8745dc6d-f899-4d19-90d7-f1e361f50dd0 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:26:14.400180 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1439/2859] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:26:14 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:26:14.404280 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875c1d04-41ef-443f-a0de-34004775fe9e admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:26:14.414148 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875c1d04-41ef-443f-a0de-34004775fe9e admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:26:14.419237 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89faec79-a2f8-4c1c-95a3-a9dbe2513fae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:26:14.420133 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89faec79-a2f8-4c1c-95a3-a9dbe2513fae admin admin] REQUEST_METHOD: `PUT` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:26:14.420415 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89faec79-a2f8-4c1c-95a3-a9dbe2513fae admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:26:14.420699 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89faec79-a2f8-4c1c-95a3-a9dbe2513fae admin admin] PATH_INFO: `/v3/projects/f4d8e96d47af4667a2f478e6561353d4/users/21a35a18c4d74109ac1dacc120bbe0fc/roles/9f88c83743f745a9a785a2f454753f06` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:26:14.435518 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89faec79-a2f8-4c1c-95a3-a9dbe2513fae admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4d8e96d47af4667a2f478e6561353d4, user_id=21a35a18c4d74109ac1dacc120bbe0fc, role_id=9f88c83743f745a9a785a2f454753f06)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:26:14.438192 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89faec79-a2f8-4c1c-95a3-a9dbe2513fae admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:26:14.450767 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1421/2860] 10.222.0.43 () {60 vars in 1482 bytes} [Wed Jun 22 10:26:14 2022] PUT /identity/v3/projects/f4d8e96d47af4667a2f478e6561353d4/users/21a35a18c4d74109ac1dacc120bbe0fc/roles/9f88c83743f745a9a785a2f454753f06 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:26:14.455723 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5a53ff-98fb-48a7-ba6b-296a0d258006 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:26:14.456023 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5a53ff-98fb-48a7-ba6b-296a0d258006 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:26:14.456393 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5a53ff-98fb-48a7-ba6b-296a0d258006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:26:14.474270 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-0f5a53ff-98fb-48a7-ba6b-296a0d258006 None None] MFA Rules not processed for user `3557bebdc4d94a16b885094566c2bc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:26:14.475712 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-0f5a53ff-98fb-48a7-ba6b-296a0d258006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:26:14.536840 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1440/2861] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:26:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:26:14.547666 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89faec79-a2f8-4c1c-95a3-a9dbe2513fae admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:26:14.549557 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-89faec79-a2f8-4c1c-95a3-a9dbe2513fae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:26:14.581440 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:26:14.613361 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89faec79-a2f8-4c1c-95a3-a9dbe2513fae admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:26:14.617259 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d87bfe-3a29-450e-87f5-0416b70f966f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe93d4c0737249fd8623bb5ce188e34e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:26:14.617935 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d87bfe-3a29-450e-87f5-0416b70f966f service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:26:14.618218 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d87bfe-3a29-450e-87f5-0416b70f966f service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:26:14.618494 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d87bfe-3a29-450e-87f5-0416b70f966f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:26:14.627993 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d87bfe-3a29-450e-87f5-0416b70f966f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:26:14.629430 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d87bfe-3a29-450e-87f5-0416b70f966f service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:26:14.639484 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1422/2862] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:26:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:26:19.015942 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f7cfd7-7221-4648-9f3d-b7854c4e0483 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:26:19.016433 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f7cfd7-7221-4648-9f3d-b7854c4e0483 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:26:19.016542 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f7cfd7-7221-4648-9f3d-b7854c4e0483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:26:19.051170 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-82f7cfd7-7221-4648-9f3d-b7854c4e0483 None None] MFA Rules not processed for user `21a35a18c4d74109ac1dacc120bbe0fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:26:19.052387 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-82f7cfd7-7221-4648-9f3d-b7854c4e0483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:26:19.130220 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1441/2863] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:26:19 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:26:19.134818 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d87bfe-3a29-450e-87f5-0416b70f966f service neutron] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:26:19.148313 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d87bfe-3a29-450e-87f5-0416b70f966f service neutron] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:26:19.154670 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8256046f-597c-4349-911d-1fcdefc1964c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:26:19.155425 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8256046f-597c-4349-911d-1fcdefc1964c admin admin] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:26:19.155740 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8256046f-597c-4349-911d-1fcdefc1964c admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:26:19.156027 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8256046f-597c-4349-911d-1fcdefc1964c admin admin] PATH_INFO: `/v3/projects` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:26:19.156748 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8256046f-597c-4349-911d-1fcdefc1964c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:26:19.159044 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8256046f-597c-4349-911d-1fcdefc1964c admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:26:19.206965 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1423/2864] 10.222.0.43 () {60 vars in 1152 bytes} [Wed Jun 22 10:26:19 2022] POST /identity/v3/projects => generated 385 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 10:26:19.211981 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f7cfd7-7221-4648-9f3d-b7854c4e0483 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:26:19.225420 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f7cfd7-7221-4648-9f3d-b7854c4e0483 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:26:19.284937 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97db0436-d32f-4737-bfd5-0af2ea78baf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:26:19.285617 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97db0436-d32f-4737-bfd5-0af2ea78baf2 admin admin] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:26:19.285937 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97db0436-d32f-4737-bfd5-0af2ea78baf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:26:19.286219 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97db0436-d32f-4737-bfd5-0af2ea78baf2 admin admin] PATH_INFO: `/v3/users` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:26:19.286920 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97db0436-d32f-4737-bfd5-0af2ea78baf2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:26:19.288851 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97db0436-d32f-4737-bfd5-0af2ea78baf2 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:26:19.303503 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:26:19.310829 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1442/2865] 10.222.0.43 () {60 vars in 1143 bytes} [Wed Jun 22 10:26:19 2022] POST /identity/v3/users => generated 299 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 10:26:19.314508 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8256046f-597c-4349-911d-1fcdefc1964c admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:26:19.324737 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8256046f-597c-4349-911d-1fcdefc1964c admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:26:19.329240 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35949cd8-9917-4b19-bef4-cdc474021d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:26:19.329928 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35949cd8-9917-4b19-bef4-cdc474021d36 admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:26:19.330213 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35949cd8-9917-4b19-bef4-cdc474021d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:26:19.330493 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35949cd8-9917-4b19-bef4-cdc474021d36 admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:26:19.331208 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35949cd8-9917-4b19-bef4-cdc474021d36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:26:19.332793 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35949cd8-9917-4b19-bef4-cdc474021d36 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:26:19.343784 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1424/2866] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:26:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:26:19.348116 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97db0436-d32f-4737-bfd5-0af2ea78baf2 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:26:19.358656 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97db0436-d32f-4737-bfd5-0af2ea78baf2 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:26:19.363204 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7663079b-9235-4167-94cd-c45e4b5c5f56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:26:19.364059 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7663079b-9235-4167-94cd-c45e4b5c5f56 admin admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:26:19.364336 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7663079b-9235-4167-94cd-c45e4b5c5f56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:26:19.364607 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7663079b-9235-4167-94cd-c45e4b5c5f56 admin admin] PATH_INFO: `/v3/projects/d85294bd0d8c475da36b80caf9b3153a/users/d7f22ecc23004a379c5135930cdb329e/roles/26d9c2ab5dfc4e6d9ca80c6014123906` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:26:19.378967 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7663079b-9235-4167-94cd-c45e4b5c5f56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d85294bd0d8c475da36b80caf9b3153a, user_id=d7f22ecc23004a379c5135930cdb329e, role_id=26d9c2ab5dfc4e6d9ca80c6014123906)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:26:19.381609 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7663079b-9235-4167-94cd-c45e4b5c5f56 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:26:19.394581 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1443/2867] 10.222.0.43 () {60 vars in 1482 bytes} [Wed Jun 22 10:26:19 2022] PUT /identity/v3/projects/d85294bd0d8c475da36b80caf9b3153a/users/d7f22ecc23004a379c5135930cdb329e/roles/26d9c2ab5dfc4e6d9ca80c6014123906 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:26:19.398482 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35949cd8-9917-4b19-bef4-cdc474021d36 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:26:19.409132 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35949cd8-9917-4b19-bef4-cdc474021d36 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:26:19.472838 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d36293-54b3-45f9-a434-abf14d0df72a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:26:19.473620 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d36293-54b3-45f9-a434-abf14d0df72a admin admin] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:26:19.473947 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d36293-54b3-45f9-a434-abf14d0df72a admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:26:19.474227 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d36293-54b3-45f9-a434-abf14d0df72a admin admin] PATH_INFO: `/v3/roles` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:26:19.475264 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d36293-54b3-45f9-a434-abf14d0df72a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:26:19.476888 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d36293-54b3-45f9-a434-abf14d0df72a admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:26:19.487151 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1425/2868] 10.222.0.43 () {58 vars in 1121 bytes} [Wed Jun 22 10:26:19 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 10:26:19.491207 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7663079b-9235-4167-94cd-c45e4b5c5f56 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:26:19.501795 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7663079b-9235-4167-94cd-c45e4b5c5f56 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:26:19.506468 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9295ab2d-0093-43b5-9efe-76eb6ccfbbca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:26:19.507362 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9295ab2d-0093-43b5-9efe-76eb6ccfbbca admin admin] REQUEST_METHOD: `PUT` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:26:19.507646 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9295ab2d-0093-43b5-9efe-76eb6ccfbbca admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:26:19.507931 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9295ab2d-0093-43b5-9efe-76eb6ccfbbca admin admin] PATH_INFO: `/v3/projects/d85294bd0d8c475da36b80caf9b3153a/users/d7f22ecc23004a379c5135930cdb329e/roles/26d9c2ab5dfc4e6d9ca80c6014123906` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:26:19.510467 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9295ab2d-0093-43b5-9efe-76eb6ccfbbca admin admin] RBAC: Authorizing `identity:create_grant(project_id=d85294bd0d8c475da36b80caf9b3153a, user_id=d7f22ecc23004a379c5135930cdb329e, role_id=26d9c2ab5dfc4e6d9ca80c6014123906)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:26:19.513118 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9295ab2d-0093-43b5-9efe-76eb6ccfbbca admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:26:19.523766 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1444/2869] 10.222.0.43 () {60 vars in 1482 bytes} [Wed Jun 22 10:26:19 2022] PUT /identity/v3/projects/d85294bd0d8c475da36b80caf9b3153a/users/d7f22ecc23004a379c5135930cdb329e/roles/26d9c2ab5dfc4e6d9ca80c6014123906 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:26:23.432006 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d36293-54b3-45f9-a434-abf14d0df72a admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:26:23.434325 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-08d36293-54b3-45f9-a434-abf14d0df72a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:26:23.584194 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d36293-54b3-45f9-a434-abf14d0df72a admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:26:23.702612 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:26:23.711492 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c7fc45-2d39-46c5-9289-7ffd73eda7c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe93d4c0737249fd8623bb5ce188e34e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:26:23.713165 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c7fc45-2d39-46c5-9289-7ffd73eda7c5 service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:26:23.714745 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c7fc45-2d39-46c5-9289-7ffd73eda7c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:26:23.715259 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c7fc45-2d39-46c5-9289-7ffd73eda7c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:26:23.718914 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-84c7fc45-2d39-46c5-9289-7ffd73eda7c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:26:23.738114 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c7fc45-2d39-46c5-9289-7ffd73eda7c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:26:23.739690 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c7fc45-2d39-46c5-9289-7ffd73eda7c5 service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:26:23.762190 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1426/2870] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:26:23 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:26:24.561556 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c97ba4-6c6e-4335-8d81-80f7f5c2ab5e None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:26:24.562198 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c97ba4-6c6e-4335-8d81-80f7f5c2ab5e None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:26:24.562198 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c97ba4-6c6e-4335-8d81-80f7f5c2ab5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:26:24.590378 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-d7c97ba4-6c6e-4335-8d81-80f7f5c2ab5e None None] MFA Rules not processed for user `d7f22ecc23004a379c5135930cdb329e`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:26:24.591593 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-d7c97ba4-6c6e-4335-8d81-80f7f5c2ab5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:26:24.706157 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1445/2871] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:26:24 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:26:24.722243 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c7fc45-2d39-46c5-9289-7ffd73eda7c5 service neutron] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:26:24.723669 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-84c7fc45-2d39-46c5-9289-7ffd73eda7c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:26:24.795241 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c7fc45-2d39-46c5-9289-7ffd73eda7c5 service neutron] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:26:24.799260 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d85644c-75fa-48fa-9e85-fdceb8c6912d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2418acec46b4db48346129004827853', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:26:24.799922 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d85644c-75fa-48fa-9e85-fdceb8c6912d service glance] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:26:24.800247 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d85644c-75fa-48fa-9e85-fdceb8c6912d service glance] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:26:24.800477 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d85644c-75fa-48fa-9e85-fdceb8c6912d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:26:24.884136 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d85644c-75fa-48fa-9e85-fdceb8c6912d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:26:24.885893 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d85644c-75fa-48fa-9e85-fdceb8c6912d service glance] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:26:24.897233 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1427/2872] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:26:24 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:26:25.001576 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0388f8-274b-40a5-a356-4673e76a7021 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:26:25.001919 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0388f8-274b-40a5-a356-4673e76a7021 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:26:25.002206 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0388f8-274b-40a5-a356-4673e76a7021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:26:25.022662 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-ce0388f8-274b-40a5-a356-4673e76a7021 None None] MFA Rules not processed for user `317e7e7dd5c741d49d34a1fd949a7c07`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:26:25.023873 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-ce0388f8-274b-40a5-a356-4673e76a7021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:26:25.089995 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1446/2873] 10.222.0.43 () {58 vars in 1009 bytes} [Wed Jun 22 10:26:25 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:26:25.146063 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d85644c-75fa-48fa-9e85-fdceb8c6912d service glance] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:26:25.147571 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-9d85644c-75fa-48fa-9e85-fdceb8c6912d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:26:25.220724 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d85644c-75fa-48fa-9e85-fdceb8c6912d service glance] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:26:25.225988 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab34d84-b632-47dc-8250-d8ba3d255bf7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9566f8cca2574f4cb5edcbf384f368a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:26:25.226643 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab34d84-b632-47dc-8250-d8ba3d255bf7 service swift] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:26:25.226929 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab34d84-b632-47dc-8250-d8ba3d255bf7 service swift] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:26:25.227208 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab34d84-b632-47dc-8250-d8ba3d255bf7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:26:25.235840 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab34d84-b632-47dc-8250-d8ba3d255bf7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:26:25.237436 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab34d84-b632-47dc-8250-d8ba3d255bf7 service swift] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:26:25.245484 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1428/2874] 10.222.0.43 () {60 vars in 1384 bytes} [Wed Jun 22 10:26:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 22 10:26:34.515590 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ca1921-ba8f-4a1f-9468-b0e9e6899793 None None] REQUEST_METHOD: `POST` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:26:34.516144 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ca1921-ba8f-4a1f-9468-b0e9e6899793 None None] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:26:34.516144 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ca1921-ba8f-4a1f-9468-b0e9e6899793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:26:34.534015 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.auth.core [None req-57ca1921-ba8f-4a1f-9468-b0e9e6899793 None None] MFA Rules not processed for user `21a35a18c4d74109ac1dacc120bbe0fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:26:34.535288 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-57ca1921-ba8f-4a1f-9468-b0e9e6899793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:26:34.542276 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1447/2875] 10.222.0.43 () {58 vars in 957 bytes} [Wed Jun 22 10:26:34 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:26:34.786075 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab34d84-b632-47dc-8250-d8ba3d255bf7 service swift] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:26:34.796039 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab34d84-b632-47dc-8250-d8ba3d255bf7 service swift] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:26:34.799604 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4bc665-6175-4505-b45d-109b43c1436c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe93d4c0737249fd8623bb5ce188e34e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:26:34.800236 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4bc665-6175-4505-b45d-109b43c1436c service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:26:34.800518 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4bc665-6175-4505-b45d-109b43c1436c service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:26:34.800799 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4bc665-6175-4505-b45d-109b43c1436c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:26:34.802553 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-4f4bc665-6175-4505-b45d-109b43c1436c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:26:34.812715 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4bc665-6175-4505-b45d-109b43c1436c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:26:34.814217 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4bc665-6175-4505-b45d-109b43c1436c service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:26:34.823817 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1429/2876] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:26:34 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:26:35.160278 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ca1921-ba8f-4a1f-9468-b0e9e6899793 None None] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:26:35.161882 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-57ca1921-ba8f-4a1f-9468-b0e9e6899793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:26:35.229000 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:26:35.253652 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ca1921-ba8f-4a1f-9468-b0e9e6899793 None None] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:26:35.258633 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6177ef-cddd-4e3c-aa49-cc1768019b0f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '341ec95408c94dae8539ccff7225e3ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:26:35.260054 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6177ef-cddd-4e3c-aa49-cc1768019b0f service placement] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:26:35.260343 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6177ef-cddd-4e3c-aa49-cc1768019b0f service placement] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:26:35.260624 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6177ef-cddd-4e3c-aa49-cc1768019b0f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:26:35.262451 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-8f6177ef-cddd-4e3c-aa49-cc1768019b0f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:26:35.273605 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6177ef-cddd-4e3c-aa49-cc1768019b0f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:26:35.275253 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6177ef-cddd-4e3c-aa49-cc1768019b0f service placement] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:26:35.285049 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1448/2877] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:26:35 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:26:36.835746 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e2a383-aefe-4714-9ee3-d4c54a305d5f None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:26:36.836277 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e2a383-aefe-4714-9ee3-d4c54a305d5f None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:26:36.836386 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e2a383-aefe-4714-9ee3-d4c54a305d5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:26:36.856481 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-a2e2a383-aefe-4714-9ee3-d4c54a305d5f None None] MFA Rules not processed for user `317e7e7dd5c741d49d34a1fd949a7c07`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:26:36.857852 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-a2e2a383-aefe-4714-9ee3-d4c54a305d5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:26:36.865666 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1430/2878] 10.222.0.43 () {58 vars in 1009 bytes} [Wed Jun 22 10:26:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:26:36.877924 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6177ef-cddd-4e3c-aa49-cc1768019b0f service placement] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:26:36.892005 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6177ef-cddd-4e3c-aa49-cc1768019b0f service placement] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:26:36.897203 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8f424a-b0ff-437f-86d3-d4eebd9d8c24 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9566f8cca2574f4cb5edcbf384f368a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:26:36.897896 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8f424a-b0ff-437f-86d3-d4eebd9d8c24 service swift] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:26:36.898175 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8f424a-b0ff-437f-86d3-d4eebd9d8c24 service swift] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:26:36.898451 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8f424a-b0ff-437f-86d3-d4eebd9d8c24 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:26:36.907253 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8f424a-b0ff-437f-86d3-d4eebd9d8c24 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:26:36.908835 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8f424a-b0ff-437f-86d3-d4eebd9d8c24 service swift] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:26:36.920173 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1449/2879] 10.222.0.43 () {60 vars in 1384 bytes} [Wed Jun 22 10:26:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 22 10:26:40.482011 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e2a383-aefe-4714-9ee3-d4c54a305d5f None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:26:40.484195 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-a2e2a383-aefe-4714-9ee3-d4c54a305d5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:26:40.507736 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=100 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:26:40.601225 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e2a383-aefe-4714-9ee3-d4c54a305d5f None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:26:40.619392 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae581c8-d7af-4cb9-93b2-498bcee0cb69 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '158a49aa3750478a84bf71b9aad24397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:26:40.620943 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae581c8-d7af-4cb9-93b2-498bcee0cb69 service nova] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:26:40.621617 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae581c8-d7af-4cb9-93b2-498bcee0cb69 service nova] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:26:40.622176 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae581c8-d7af-4cb9-93b2-498bcee0cb69 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:26:40.624671 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-3ae581c8-d7af-4cb9-93b2-498bcee0cb69 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:26:40.639983 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae581c8-d7af-4cb9-93b2-498bcee0cb69 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:26:40.641566 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae581c8-d7af-4cb9-93b2-498bcee0cb69 service nova] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:26:40.652563 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1431/2880] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:26:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:26:46.913848 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=18 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:26:50.647579 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=27 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:27:05.461465 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8f424a-b0ff-437f-86d3-d4eebd9d8c24 service swift] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:27:05.474210 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8f424a-b0ff-437f-86d3-d4eebd9d8c24 service swift] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:27:05.480828 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00516819-5243-4e5e-9c05-5c9441e21be8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '158a49aa3750478a84bf71b9aad24397', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:27:05.481467 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00516819-5243-4e5e-9c05-5c9441e21be8 service nova] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:27:05.481794 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00516819-5243-4e5e-9c05-5c9441e21be8 service nova] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:27:05.482074 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00516819-5243-4e5e-9c05-5c9441e21be8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:27:05.483840 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-00516819-5243-4e5e-9c05-5c9441e21be8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:27:05.496725 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00516819-5243-4e5e-9c05-5c9441e21be8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:27:05.498273 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00516819-5243-4e5e-9c05-5c9441e21be8 service nova] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:27:05.509003 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1450/2881] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:27:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:27:06.346325 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae581c8-d7af-4cb9-93b2-498bcee0cb69 service nova] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:27:06.356245 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae581c8-d7af-4cb9-93b2-498bcee0cb69 service nova] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:27:06.359767 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a0b51e-46ce-46c1-ade6-f70e763d7e33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe93d4c0737249fd8623bb5ce188e34e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:27:06.360400 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a0b51e-46ce-46c1-ade6-f70e763d7e33 service neutron] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:27:06.360681 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a0b51e-46ce-46c1-ade6-f70e763d7e33 service neutron] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:27:06.360954 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a0b51e-46ce-46c1-ade6-f70e763d7e33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:27:06.370648 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a0b51e-46ce-46c1-ade6-f70e763d7e33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:27:06.372118 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a0b51e-46ce-46c1-ade6-f70e763d7e33 service neutron] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:27:06.381754 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1432/2882] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:27:06 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:27:08.735461 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00516819-5243-4e5e-9c05-5c9441e21be8 service nova] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:27:08.748529 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00516819-5243-4e5e-9c05-5c9441e21be8 service nova] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:27:08.753481 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dfec63-c4f6-41aa-a6f5-248b1bf22da1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe93d4c0737249fd8623bb5ce188e34e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:27:08.754488 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dfec63-c4f6-41aa-a6f5-248b1bf22da1 service neutron] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:27:08.755801 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dfec63-c4f6-41aa-a6f5-248b1bf22da1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:27:08.755801 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dfec63-c4f6-41aa-a6f5-248b1bf22da1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:27:08.758164 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-d5dfec63-c4f6-41aa-a6f5-248b1bf22da1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:27:08.842814 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dfec63-c4f6-41aa-a6f5-248b1bf22da1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:27:08.844312 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dfec63-c4f6-41aa-a6f5-248b1bf22da1 service neutron] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:27:08.859004 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1451/2883] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:27:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:27:16.249373 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a0b51e-46ce-46c1-ade6-f70e763d7e33 service neutron] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:27:16.250877 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-72a0b51e-46ce-46c1-ade6-f70e763d7e33 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:27:16.265677 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a0b51e-46ce-46c1-ade6-f70e763d7e33 service neutron] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:27:16.270741 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3751304-1ace-4011-aa67-301ff5527bd2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '341ec95408c94dae8539ccff7225e3ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:27:16.271449 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3751304-1ace-4011-aa67-301ff5527bd2 service placement] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:27:16.271789 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3751304-1ace-4011-aa67-301ff5527bd2 service placement] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:27:16.272129 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3751304-1ace-4011-aa67-301ff5527bd2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:27:16.274634 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-a3751304-1ace-4011-aa67-301ff5527bd2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:27:16.286947 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3751304-1ace-4011-aa67-301ff5527bd2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:27:16.288522 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3751304-1ace-4011-aa67-301ff5527bd2 service placement] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:27:16.299799 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1433/2884] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:27:16 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:27:16.312150 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dfec63-c4f6-41aa-a6f5-248b1bf22da1 service neutron] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:27:16.313785 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-d5dfec63-c4f6-41aa-a6f5-248b1bf22da1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:27:16.325788 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dfec63-c4f6-41aa-a6f5-248b1bf22da1 service neutron] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:27:16.334328 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ced26f5-7706-498c-bbf8-86e10fe488b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:27:16.335223 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ced26f5-7706-498c-bbf8-86e10fe488b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:27:16.335532 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ced26f5-7706-498c-bbf8-86e10fe488b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:27:16.336718 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ced26f5-7706-498c-bbf8-86e10fe488b3 admin admin] PATH_INFO: `/v3/users/b2d3aa18a0a146808f584127411a1cf5` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:27:16.338319 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ced26f5-7706-498c-bbf8-86e10fe488b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2d3aa18a0a146808f584127411a1cf5)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:27:16.340263 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ced26f5-7706-498c-bbf8-86e10fe488b3 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:27:16.386737 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-5ced26f5-7706-498c-bbf8-86e10fe488b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2d3aa18a0a146808f584127411a1cf5'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:27:16.400154 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-5ced26f5-7706-498c-bbf8-86e10fe488b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2d3aa18a0a146808f584127411a1cf5'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:27:16.408204 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-5ced26f5-7706-498c-bbf8-86e10fe488b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2d3aa18a0a146808f584127411a1cf5'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:27:16.415886 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-5ced26f5-7706-498c-bbf8-86e10fe488b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2d3aa18a0a146808f584127411a1cf5'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:27:16.416534 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-5ced26f5-7706-498c-bbf8-86e10fe488b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2d3aa18a0a146808f584127411a1cf5'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:27:16.422497 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1452/2885] 10.222.0.43 () {58 vars in 1223 bytes} [Wed Jun 22 10:27:16 2022] DELETE /identity/v3/users/b2d3aa18a0a146808f584127411a1cf5 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:27:16.601138 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3751304-1ace-4011-aa67-301ff5527bd2 service placement] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:27:16.612542 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3751304-1ace-4011-aa67-301ff5527bd2 service placement] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:27:16.676673 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbb0dcd-8433-405a-8755-81a70764096e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:27:16.677529 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbb0dcd-8433-405a-8755-81a70764096e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:27:16.677849 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbb0dcd-8433-405a-8755-81a70764096e admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:27:16.678131 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbb0dcd-8433-405a-8755-81a70764096e admin admin] PATH_INFO: `/v3/projects/1cb1af845e594466b12a11b7cab99a7c` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:27:16.679335 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbb0dcd-8433-405a-8755-81a70764096e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1cb1af845e594466b12a11b7cab99a7c)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:27:16.681892 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbb0dcd-8433-405a-8755-81a70764096e admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:27:16.738967 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-acbb0dcd-8433-405a-8755-81a70764096e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1cb1af845e594466b12a11b7cab99a7c', 'request_id': 'req-acbb0dcd-8433-405a-8755-81a70764096e'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:27:16.746964 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-acbb0dcd-8433-405a-8755-81a70764096e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1cb1af845e594466b12a11b7cab99a7c', 'request_id': 'req-acbb0dcd-8433-405a-8755-81a70764096e'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:27:16.755960 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-acbb0dcd-8433-405a-8755-81a70764096e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1cb1af845e594466b12a11b7cab99a7c', 'request_id': 'req-acbb0dcd-8433-405a-8755-81a70764096e'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:27:16.769257 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-acbb0dcd-8433-405a-8755-81a70764096e admin admin] The token cache is being invalidate because project 1cb1af845e594466b12a11b7cab99a7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:27:16.769468 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-acbb0dcd-8433-405a-8755-81a70764096e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:27:16.770139 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-acbb0dcd-8433-405a-8755-81a70764096e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:27:16.772010 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1434/2886] 10.222.0.43 () {58 vars in 1232 bytes} [Wed Jun 22 10:27:16 2022] DELETE /identity/v3/projects/1cb1af845e594466b12a11b7cab99a7c => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:27:16.776317 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ced26f5-7706-498c-bbf8-86e10fe488b3 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:27:16.777763 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-5ced26f5-7706-498c-bbf8-86e10fe488b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:27:16.799537 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ced26f5-7706-498c-bbf8-86e10fe488b3 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:27:16.851652 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:27:16.862479 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35ec33d-95b9-460c-a5ff-2cf48c0b41f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:27:16.863508 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35ec33d-95b9-460c-a5ff-2cf48c0b41f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:27:16.863887 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35ec33d-95b9-460c-a5ff-2cf48c0b41f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:27:16.864343 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35ec33d-95b9-460c-a5ff-2cf48c0b41f5 admin admin] PATH_INFO: `/v3/users/926314de5db8403b9a0cba2e286d6ac5` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:27:16.865574 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35ec33d-95b9-460c-a5ff-2cf48c0b41f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=926314de5db8403b9a0cba2e286d6ac5)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:27:16.868152 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35ec33d-95b9-460c-a5ff-2cf48c0b41f5 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:27:16.912772 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-a35ec33d-95b9-460c-a5ff-2cf48c0b41f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '926314de5db8403b9a0cba2e286d6ac5'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:27:16.925633 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-a35ec33d-95b9-460c-a5ff-2cf48c0b41f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '926314de5db8403b9a0cba2e286d6ac5'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:27:16.934745 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-a35ec33d-95b9-460c-a5ff-2cf48c0b41f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '926314de5db8403b9a0cba2e286d6ac5'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:27:16.941996 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-a35ec33d-95b9-460c-a5ff-2cf48c0b41f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '926314de5db8403b9a0cba2e286d6ac5'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:27:16.942641 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-a35ec33d-95b9-460c-a5ff-2cf48c0b41f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '926314de5db8403b9a0cba2e286d6ac5'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:27:16.948548 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1453/2887] 10.222.0.43 () {58 vars in 1223 bytes} [Wed Jun 22 10:27:16 2022] DELETE /identity/v3/users/926314de5db8403b9a0cba2e286d6ac5 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:27:17.120882 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbb0dcd-8433-405a-8755-81a70764096e admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:27:17.122348 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-acbb0dcd-8433-405a-8755-81a70764096e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:27:17.137330 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbb0dcd-8433-405a-8755-81a70764096e admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:27:17.193836 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d3e89e-6ae1-47ab-8d51-16800dc72cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:27:17.194708 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d3e89e-6ae1-47ab-8d51-16800dc72cac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:27:17.195024 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d3e89e-6ae1-47ab-8d51-16800dc72cac admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:27:17.195300 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d3e89e-6ae1-47ab-8d51-16800dc72cac admin admin] PATH_INFO: `/v3/projects/0188989ab8b745338bb087d10c570c5f` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:27:17.197086 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d3e89e-6ae1-47ab-8d51-16800dc72cac admin admin] RBAC: Authorizing `identity:delete_project(project_id=0188989ab8b745338bb087d10c570c5f)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:27:17.199031 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d3e89e-6ae1-47ab-8d51-16800dc72cac admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:27:17.205622 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:27:17.249613 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-c2d3e89e-6ae1-47ab-8d51-16800dc72cac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0188989ab8b745338bb087d10c570c5f', 'request_id': 'req-c2d3e89e-6ae1-47ab-8d51-16800dc72cac'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:27:17.256907 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-c2d3e89e-6ae1-47ab-8d51-16800dc72cac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0188989ab8b745338bb087d10c570c5f', 'request_id': 'req-c2d3e89e-6ae1-47ab-8d51-16800dc72cac'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:27:17.265825 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-c2d3e89e-6ae1-47ab-8d51-16800dc72cac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0188989ab8b745338bb087d10c570c5f', 'request_id': 'req-c2d3e89e-6ae1-47ab-8d51-16800dc72cac'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:27:17.278061 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-c2d3e89e-6ae1-47ab-8d51-16800dc72cac admin admin] The token cache is being invalidate because project 0188989ab8b745338bb087d10c570c5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:27:17.278351 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-c2d3e89e-6ae1-47ab-8d51-16800dc72cac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:27:17.278969 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-c2d3e89e-6ae1-47ab-8d51-16800dc72cac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:27:17.280528 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1435/2888] 10.222.0.43 () {58 vars in 1232 bytes} [Wed Jun 22 10:27:17 2022] DELETE /identity/v3/projects/0188989ab8b745338bb087d10c570c5f => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:27:26.945076 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=29,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:27:27.274479 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=22,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:28:11.153682 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35ec33d-95b9-460c-a5ff-2cf48c0b41f5 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:28:11.155276 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-a35ec33d-95b9-460c-a5ff-2cf48c0b41f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:28:11.239303 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35ec33d-95b9-460c-a5ff-2cf48c0b41f5 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:28:11.307812 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bf13d8-5d5b-4071-b1ce-bb6f881e14c9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '341ec95408c94dae8539ccff7225e3ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:28:11.308715 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bf13d8-5d5b-4071-b1ce-bb6f881e14c9 service placement] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:28:11.309003 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bf13d8-5d5b-4071-b1ce-bb6f881e14c9 service placement] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:28:11.309288 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bf13d8-5d5b-4071-b1ce-bb6f881e14c9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:28:11.311186 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-d3bf13d8-5d5b-4071-b1ce-bb6f881e14c9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:28:11.323127 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bf13d8-5d5b-4071-b1ce-bb6f881e14c9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:28:11.325554 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bf13d8-5d5b-4071-b1ce-bb6f881e14c9 service placement] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:28:11.335836 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1454/2889] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:28:11 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 10:28:14.415747 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d3e89e-6ae1-47ab-8d51-16800dc72cac admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:28:14.417980 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-c2d3e89e-6ae1-47ab-8d51-16800dc72cac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:28:14.487489 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d3e89e-6ae1-47ab-8d51-16800dc72cac admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:28:14.492151 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32624a5-d704-4e97-90fe-70d5a4ada80a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:28:14.493034 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32624a5-d704-4e97-90fe-70d5a4ada80a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:28:14.493326 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32624a5-d704-4e97-90fe-70d5a4ada80a admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:28:14.493612 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32624a5-d704-4e97-90fe-70d5a4ada80a admin admin] PATH_INFO: `/v3/users/d6428e56cd9b46feb6a7b04e4d00c162` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:28:14.494919 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32624a5-d704-4e97-90fe-70d5a4ada80a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6428e56cd9b46feb6a7b04e4d00c162)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:28:14.496986 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32624a5-d704-4e97-90fe-70d5a4ada80a admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:28:14.547547 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-d32624a5-d704-4e97-90fe-70d5a4ada80a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6428e56cd9b46feb6a7b04e4d00c162'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:28:14.561115 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-d32624a5-d704-4e97-90fe-70d5a4ada80a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6428e56cd9b46feb6a7b04e4d00c162'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:28:14.568575 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-d32624a5-d704-4e97-90fe-70d5a4ada80a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6428e56cd9b46feb6a7b04e4d00c162'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:28:14.569207 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-d32624a5-d704-4e97-90fe-70d5a4ada80a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6428e56cd9b46feb6a7b04e4d00c162'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:28:14.576121 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-d32624a5-d704-4e97-90fe-70d5a4ada80a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6428e56cd9b46feb6a7b04e4d00c162'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:28:14.582068 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1436/2890] 10.222.0.43 () {58 vars in 1223 bytes} [Wed Jun 22 10:28:14 2022] DELETE /identity/v3/users/d6428e56cd9b46feb6a7b04e4d00c162 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:28:14.761856 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bf13d8-5d5b-4071-b1ce-bb6f881e14c9 service placement] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:28:14.774554 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bf13d8-5d5b-4071-b1ce-bb6f881e14c9 service placement] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:28:14.837411 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d17afee-59af-4c53-98d3-cf57a0fb5bb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:28:14.838261 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d17afee-59af-4c53-98d3-cf57a0fb5bb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:28:14.838552 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d17afee-59af-4c53-98d3-cf57a0fb5bb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:28:14.838837 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d17afee-59af-4c53-98d3-cf57a0fb5bb5 admin admin] PATH_INFO: `/v3/projects/aa9a1da5cb5a4279abb88ec7bdb1ef6b` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:28:14.841012 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d17afee-59af-4c53-98d3-cf57a0fb5bb5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa9a1da5cb5a4279abb88ec7bdb1ef6b)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:28:14.842995 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d17afee-59af-4c53-98d3-cf57a0fb5bb5 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:28:14.882641 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:28:14.892855 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-0d17afee-59af-4c53-98d3-cf57a0fb5bb5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa9a1da5cb5a4279abb88ec7bdb1ef6b', 'request_id': 'req-0d17afee-59af-4c53-98d3-cf57a0fb5bb5'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:28:14.899040 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-0d17afee-59af-4c53-98d3-cf57a0fb5bb5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa9a1da5cb5a4279abb88ec7bdb1ef6b', 'request_id': 'req-0d17afee-59af-4c53-98d3-cf57a0fb5bb5'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:28:14.904531 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-0d17afee-59af-4c53-98d3-cf57a0fb5bb5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa9a1da5cb5a4279abb88ec7bdb1ef6b', 'request_id': 'req-0d17afee-59af-4c53-98d3-cf57a0fb5bb5'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:28:14.916914 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-0d17afee-59af-4c53-98d3-cf57a0fb5bb5 admin admin] The token cache is being invalidate because project aa9a1da5cb5a4279abb88ec7bdb1ef6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:28:14.917740 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-0d17afee-59af-4c53-98d3-cf57a0fb5bb5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:28:14.918414 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-0d17afee-59af-4c53-98d3-cf57a0fb5bb5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:28:14.919886 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1455/2891] 10.222.0.43 () {58 vars in 1232 bytes} [Wed Jun 22 10:28:14 2022] DELETE /identity/v3/projects/aa9a1da5cb5a4279abb88ec7bdb1ef6b => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:28:14.923946 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32624a5-d704-4e97-90fe-70d5a4ada80a admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:28:14.925350 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-d32624a5-d704-4e97-90fe-70d5a4ada80a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:28:14.939572 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32624a5-d704-4e97-90fe-70d5a4ada80a admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:28:14.997194 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6998de-6ba7-4c1d-be9a-58af16dbedf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:28:14.998113 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6998de-6ba7-4c1d-be9a-58af16dbedf9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:28:14.998397 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6998de-6ba7-4c1d-be9a-58af16dbedf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:28:14.998670 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6998de-6ba7-4c1d-be9a-58af16dbedf9 admin admin] PATH_INFO: `/v3/users/51dd4cc38b6040428a010170dd2ce071` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:28:14.999853 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6998de-6ba7-4c1d-be9a-58af16dbedf9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=51dd4cc38b6040428a010170dd2ce071)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:28:15.001825 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6998de-6ba7-4c1d-be9a-58af16dbedf9 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:28:15.023243 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:28:15.048465 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-af6998de-6ba7-4c1d-be9a-58af16dbedf9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51dd4cc38b6040428a010170dd2ce071'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:28:15.060875 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-af6998de-6ba7-4c1d-be9a-58af16dbedf9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51dd4cc38b6040428a010170dd2ce071'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:28:15.068171 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-af6998de-6ba7-4c1d-be9a-58af16dbedf9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51dd4cc38b6040428a010170dd2ce071'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:28:15.068825 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-af6998de-6ba7-4c1d-be9a-58af16dbedf9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51dd4cc38b6040428a010170dd2ce071'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:28:15.075712 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-af6998de-6ba7-4c1d-be9a-58af16dbedf9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51dd4cc38b6040428a010170dd2ce071'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:28:15.081555 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1437/2892] 10.222.0.43 () {58 vars in 1223 bytes} [Wed Jun 22 10:28:14 2022] DELETE /identity/v3/users/51dd4cc38b6040428a010170dd2ce071 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:28:15.264030 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d17afee-59af-4c53-98d3-cf57a0fb5bb5 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:28:15.265625 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-0d17afee-59af-4c53-98d3-cf57a0fb5bb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:28:15.312326 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d17afee-59af-4c53-98d3-cf57a0fb5bb5 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:28:15.370278 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6abfc3-4136-4e1b-9183-32a01b29e737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:28:15.371584 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6abfc3-4136-4e1b-9183-32a01b29e737 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:28:15.371895 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6abfc3-4136-4e1b-9183-32a01b29e737 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:28:15.372172 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6abfc3-4136-4e1b-9183-32a01b29e737 admin admin] PATH_INFO: `/v3/projects/075b1eca291346f7926e033f55b31878` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:28:15.373383 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6abfc3-4136-4e1b-9183-32a01b29e737 admin admin] RBAC: Authorizing `identity:delete_project(project_id=075b1eca291346f7926e033f55b31878)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:28:15.375360 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6abfc3-4136-4e1b-9183-32a01b29e737 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:28:15.421980 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-dc6abfc3-4136-4e1b-9183-32a01b29e737 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '075b1eca291346f7926e033f55b31878', 'request_id': 'req-dc6abfc3-4136-4e1b-9183-32a01b29e737'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:28:15.428069 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-dc6abfc3-4136-4e1b-9183-32a01b29e737 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '075b1eca291346f7926e033f55b31878', 'request_id': 'req-dc6abfc3-4136-4e1b-9183-32a01b29e737'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:28:15.434191 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-dc6abfc3-4136-4e1b-9183-32a01b29e737 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '075b1eca291346f7926e033f55b31878', 'request_id': 'req-dc6abfc3-4136-4e1b-9183-32a01b29e737'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:28:15.446413 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-dc6abfc3-4136-4e1b-9183-32a01b29e737 admin admin] The token cache is being invalidate because project 075b1eca291346f7926e033f55b31878 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:28:15.446706 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-dc6abfc3-4136-4e1b-9183-32a01b29e737 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:28:15.447337 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-dc6abfc3-4136-4e1b-9183-32a01b29e737 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:28:15.448925 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1456/2893] 10.222.0.43 () {58 vars in 1232 bytes} [Wed Jun 22 10:28:15 2022] DELETE /identity/v3/projects/075b1eca291346f7926e033f55b31878 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:28:25.078168 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:DELETE=7,keystone:SELECT=20,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:28:25.443355 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:DELETE=12,keystone:SELECT=74,keystone:INSERT=2 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:28:25.740242 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a07dbeb-377a-4793-8f66-1d2219a9b78d None None] REQUEST_METHOD: `POST` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:28:25.740537 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a07dbeb-377a-4793-8f66-1d2219a9b78d None None] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:28:25.740823 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a07dbeb-377a-4793-8f66-1d2219a9b78d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:28:25.759250 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.auth.core [None req-1a07dbeb-377a-4793-8f66-1d2219a9b78d None None] MFA Rules not processed for user `317e7e7dd5c741d49d34a1fd949a7c07`. Rule list: `[]` (Enabled: `True`). {{(pid=80377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 10:28:25.760442 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-1a07dbeb-377a-4793-8f66-1d2219a9b78d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:28:25.816670 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1438/2894] 10.222.0.43 () {58 vars in 967 bytes} [Wed Jun 22 10:28:25 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 10:28:25.857074 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6abfc3-4136-4e1b-9183-32a01b29e737 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:28:25.858606 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-dc6abfc3-4136-4e1b-9183-32a01b29e737 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:28:25.928049 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6abfc3-4136-4e1b-9183-32a01b29e737 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:28:25.933712 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac33426-ff9a-4c6e-b1e4-114280810b94 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9566f8cca2574f4cb5edcbf384f368a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:28:25.934356 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac33426-ff9a-4c6e-b1e4-114280810b94 service swift] REQUEST_METHOD: `GET` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:28:25.934645 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac33426-ff9a-4c6e-b1e4-114280810b94 service swift] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:28:25.934927 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac33426-ff9a-4c6e-b1e4-114280810b94 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:28:25.943957 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac33426-ff9a-4c6e-b1e4-114280810b94 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:28:25.945561 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac33426-ff9a-4c6e-b1e4-114280810b94 service swift] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:28:25.954431 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1457/2895] 10.222.0.43 () {60 vars in 1384 bytes} [Wed Jun 22 10:28:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 22 10:28:32.661150 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a07dbeb-377a-4793-8f66-1d2219a9b78d None None] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:28:32.662636 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-1a07dbeb-377a-4793-8f66-1d2219a9b78d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:28:32.728769 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a07dbeb-377a-4793-8f66-1d2219a9b78d None None] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:28:32.734371 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac0a861-424a-4cbb-86e5-c6550233ae44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:28:32.735325 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac0a861-424a-4cbb-86e5-c6550233ae44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:28:32.735541 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac0a861-424a-4cbb-86e5-c6550233ae44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:28:32.735890 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac0a861-424a-4cbb-86e5-c6550233ae44 admin admin] PATH_INFO: `/v3/users/21a35a18c4d74109ac1dacc120bbe0fc` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:28:32.737177 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac0a861-424a-4cbb-86e5-c6550233ae44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=21a35a18c4d74109ac1dacc120bbe0fc)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:28:32.739176 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac0a861-424a-4cbb-86e5-c6550233ae44 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:28:32.793352 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-8ac0a861-424a-4cbb-86e5-c6550233ae44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21a35a18c4d74109ac1dacc120bbe0fc'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:28:32.804942 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-8ac0a861-424a-4cbb-86e5-c6550233ae44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21a35a18c4d74109ac1dacc120bbe0fc'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:28:32.813513 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-8ac0a861-424a-4cbb-86e5-c6550233ae44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21a35a18c4d74109ac1dacc120bbe0fc'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:28:32.814250 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-8ac0a861-424a-4cbb-86e5-c6550233ae44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21a35a18c4d74109ac1dacc120bbe0fc'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:28:32.822216 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-8ac0a861-424a-4cbb-86e5-c6550233ae44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21a35a18c4d74109ac1dacc120bbe0fc'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:28:32.831818 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1439/2896] 10.222.0.43 () {58 vars in 1223 bytes} [Wed Jun 22 10:28:32 2022] DELETE /identity/v3/users/21a35a18c4d74109ac1dacc120bbe0fc => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:28:33.006779 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac33426-ff9a-4c6e-b1e4-114280810b94 service swift] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:28:33.019476 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac33426-ff9a-4c6e-b1e4-114280810b94 service swift] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:28:33.076744 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d909b7-cc14-4093-be5e-db9c3b901117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:28:33.077601 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d909b7-cc14-4093-be5e-db9c3b901117 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:28:33.077910 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d909b7-cc14-4093-be5e-db9c3b901117 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:28:33.078188 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d909b7-cc14-4093-be5e-db9c3b901117 admin admin] PATH_INFO: `/v3/projects/f4d8e96d47af4667a2f478e6561353d4` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:28:33.079352 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d909b7-cc14-4093-be5e-db9c3b901117 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4d8e96d47af4667a2f478e6561353d4)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:28:33.081248 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d909b7-cc14-4093-be5e-db9c3b901117 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:28:33.130839 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-51d909b7-cc14-4093-be5e-db9c3b901117 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4d8e96d47af4667a2f478e6561353d4', 'request_id': 'req-51d909b7-cc14-4093-be5e-db9c3b901117'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:28:33.137339 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-51d909b7-cc14-4093-be5e-db9c3b901117 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4d8e96d47af4667a2f478e6561353d4', 'request_id': 'req-51d909b7-cc14-4093-be5e-db9c3b901117'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:28:33.142806 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-51d909b7-cc14-4093-be5e-db9c3b901117 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4d8e96d47af4667a2f478e6561353d4', 'request_id': 'req-51d909b7-cc14-4093-be5e-db9c3b901117'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:28:33.155495 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-51d909b7-cc14-4093-be5e-db9c3b901117 admin admin] The token cache is being invalidate because project f4d8e96d47af4667a2f478e6561353d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:28:33.155990 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-51d909b7-cc14-4093-be5e-db9c3b901117 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:28:33.156777 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-51d909b7-cc14-4093-be5e-db9c3b901117 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:28:33.158338 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1458/2897] 10.222.0.43 () {58 vars in 1232 bytes} [Wed Jun 22 10:28:33 2022] DELETE /identity/v3/projects/f4d8e96d47af4667a2f478e6561353d4 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:28:33.162341 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac0a861-424a-4cbb-86e5-c6550233ae44 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:28:33.163730 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-8ac0a861-424a-4cbb-86e5-c6550233ae44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:28:33.177268 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac0a861-424a-4cbb-86e5-c6550233ae44 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:28:33.196652 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:28:33.236695 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669f5a48-3acb-48ca-af86-2ec661fe9c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:28:33.237579 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669f5a48-3acb-48ca-af86-2ec661fe9c65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:28:33.237900 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669f5a48-3acb-48ca-af86-2ec661fe9c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:28:33.238183 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669f5a48-3acb-48ca-af86-2ec661fe9c65 admin admin] PATH_INFO: `/v3/users/d7f22ecc23004a379c5135930cdb329e` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:28:33.239366 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669f5a48-3acb-48ca-af86-2ec661fe9c65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7f22ecc23004a379c5135930cdb329e)` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:28:33.241294 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669f5a48-3acb-48ca-af86-2ec661fe9c65 admin admin] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:28:33.286778 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-669f5a48-3acb-48ca-af86-2ec661fe9c65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7f22ecc23004a379c5135930cdb329e'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:28:33.299260 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-669f5a48-3acb-48ca-af86-2ec661fe9c65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7f22ecc23004a379c5135930cdb329e'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:28:33.306474 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-669f5a48-3acb-48ca-af86-2ec661fe9c65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7f22ecc23004a379c5135930cdb329e'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:28:33.307082 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-669f5a48-3acb-48ca-af86-2ec661fe9c65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7f22ecc23004a379c5135930cdb329e'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:28:33.314039 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.notifications [None req-669f5a48-3acb-48ca-af86-2ec661fe9c65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7f22ecc23004a379c5135930cdb329e'} {{(pid=80377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:28:33.319997 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1440/2898] 10.222.0.43 () {58 vars in 1223 bytes} [Wed Jun 22 10:28:33 2022] DELETE /identity/v3/users/d7f22ecc23004a379c5135930cdb329e => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 10:28:33.500764 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d909b7-cc14-4093-be5e-db9c3b901117 admin admin] Authenticating user token {{(pid=80378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:28:33.502401 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.fernet_utils [None req-51d909b7-cc14-4093-be5e-db9c3b901117 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:28:33.516650 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d909b7-cc14-4093-be5e-db9c3b901117 admin admin] Validating token access rules against request {{(pid=80378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:28:33.535802 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:28:33.578727 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ee6b30-8f5e-4199-bf3e-519086ce6d75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3557bebdc4d94a16b885094566c2bc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24726cc2fba44a5087e961da4a7cd653', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:28:33.579586 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ee6b30-8f5e-4199-bf3e-519086ce6d75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:28:33.579870 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ee6b30-8f5e-4199-bf3e-519086ce6d75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:28:33.580146 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ee6b30-8f5e-4199-bf3e-519086ce6d75 admin admin] PATH_INFO: `/v3/projects/d85294bd0d8c475da36b80caf9b3153a` {{(pid=80378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:28:33.581624 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ee6b30-8f5e-4199-bf3e-519086ce6d75 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d85294bd0d8c475da36b80caf9b3153a)` {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:28:33.583557 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ee6b30-8f5e-4199-bf3e-519086ce6d75 admin admin] RBAC: Authorization granted {{(pid=80378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:28:33.629993 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-a8ee6b30-8f5e-4199-bf3e-519086ce6d75 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd85294bd0d8c475da36b80caf9b3153a', 'request_id': 'req-a8ee6b30-8f5e-4199-bf3e-519086ce6d75'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:28:33.636446 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-a8ee6b30-8f5e-4199-bf3e-519086ce6d75 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd85294bd0d8c475da36b80caf9b3153a', 'request_id': 'req-a8ee6b30-8f5e-4199-bf3e-519086ce6d75'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:28:33.643763 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-a8ee6b30-8f5e-4199-bf3e-519086ce6d75 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd85294bd0d8c475da36b80caf9b3153a', 'request_id': 'req-a8ee6b30-8f5e-4199-bf3e-519086ce6d75'} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:28:33.656214 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-a8ee6b30-8f5e-4199-bf3e-519086ce6d75 admin admin] The token cache is being invalidate because project d85294bd0d8c475da36b80caf9b3153a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 10:28:33.656536 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-a8ee6b30-8f5e-4199-bf3e-519086ce6d75 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:28:33.657157 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG keystone.notifications [None req-a8ee6b30-8f5e-4199-bf3e-519086ce6d75 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 10:28:33.658754 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: [pid: 80378|app: 0|req: 1459/2899] 10.222.0.43 () {58 vars in 1232 bytes} [Wed Jun 22 10:28:33 2022] DELETE /identity/v3/projects/d85294bd0d8c475da36b80caf9b3153a => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 10:28:43.316543 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=42,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:28:43.653212 dv-cinder-847131-1-iscsi devstack@keystone.service[80378]: DEBUG dbcounter [-] [80378] Writing DB stats keystone:SELECT=42,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:28:58.038631 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669f5a48-3acb-48ca-af86-2ec661fe9c65 admin admin] Authenticating user token {{(pid=80377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 10:28:58.040041 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-669f5a48-3acb-48ca-af86-2ec661fe9c65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:28:58.174559 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669f5a48-3acb-48ca-af86-2ec661fe9c65 admin admin] Validating token access rules against request {{(pid=80377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 10:28:58.237517 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbca77e0-71bb-48fa-8e86-957053fe1002 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '341ec95408c94dae8539ccff7225e3ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e03f1c17e0884f188231d2949dc6f956', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 10:28:58.238202 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbca77e0-71bb-48fa-8e86-957053fe1002 service placement] REQUEST_METHOD: `GET` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 10:28:58.238488 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbca77e0-71bb-48fa-8e86-957053fe1002 service placement] SCRIPT_NAME: `/identity` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 10:28:58.238770 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbca77e0-71bb-48fa-8e86-957053fe1002 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 10:28:58.240554 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.fernet_utils [None req-fbca77e0-71bb-48fa-8e86-957053fe1002 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 10:28:58.251872 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbca77e0-71bb-48fa-8e86-957053fe1002 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 10:28:58.253446 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbca77e0-71bb-48fa-8e86-957053fe1002 service placement] RBAC: Authorization granted {{(pid=80377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 10:28:58.264044 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: [pid: 80377|app: 0|req: 1441/2900] 10.222.0.43 () {60 vars in 1365 bytes} [Wed Jun 22 10:28:58 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 10:29:08.259099 dv-cinder-847131-1-iscsi devstack@keystone.service[80377]: DEBUG dbcounter [-] [80377] Writing DB stats keystone:SELECT=77 {{(pid=80377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}